ACM RecSys Challenge 2018


The RecSys Challenge 2018 will be organized by Spotify, The University of Massachusetts, Amherst, and Johannes Kepler University, Linz. Spotify is an online music streaming service with over 140 million active users and over 30 million tracks. One of its popular features is the ability to create playlists, and the service currently hosts over 2 billion playlists.

This year’s challenge focuses on music recommendation, specifically the challenge of automatic playlist continuation. By suggesting appropriate songs to add to a playlist, a Recommender System can increase user engagement by making playlist creation easier, as well as extending listening beyond the end of existing playlists.

As part of this challenge, Spotify will be releasing a public dataset of playlists, consisting of a large number of playlist titles and associated track listings. The evaluation set will contain a set of playlists from which a number of tracks have been withheld. The task will be to predict the missing tracks in those playlists.

A detailed description of the challenge can be found on this website (stay tuned!). Accepted contributions will be presented during the RecSys Challenge Workshop in 2018.

For more information about the recent challenges and visions in music recommender systems research please refer to the following paper recently published by the challenge organizers:

M. Schedl, H. Zamani, C.-W. Chen, Y. Deldjoo, M. Elahi. "Current Challenges and Visions in Music Recommender Systems Research".

Participation and Data

The data for this year's challenge is provided by Spotify and can be downloaded from http://recsys-challenge.spotify.com. You can access the data once you create an account and agree with the terms and conditions. The information on the challenge participation can also be found on this website.

Timeline top

Note: the timeline is subject to slight modifications.

When? What?
January 2018 Release of the "One Million Playlists" dataset
Early March 2018 RecSys Challenge starts.
  • Submission system will be available for offline evaluation.
  • Each team can submit at most 1 run per day.
  • A daily leaderboard will be available once the challenge starts. The submissions are evaluated based on 50% of a private test set.
End of June 2018 Final submission due
Early July 2018 Announcement of the final leaderboard.
  • The daily leaderboard is recalculated using the private test set.
  • The test set will be made publicly available.
Mid July 2018 Paper submission due
  • Note: paper submission is necessary for the winners.
Mid August 2018 Paper Acceptance Notifications
  • The submitted papers will be evaluated based on the novelty, the clarity, and the empirical results.
  • Each paper will be reviewed by at least three PC members.
  • Accepted papers should be presented in the RecSys Challenge Workshop.
Mid September 2018 Camera-ready due for the accepted papers.
October 2-7, 2018 Workshop will take place as part of the ACM RecSys conference in Vancouver, Canada.

Program Committee top

To be announced!

Challenge Organizers top

Advisors top

Spotify Organizers top

  • Cedric De Boom
  • Jean Garcia-Gathright
  • Paul Lamere
  • James McInerney
  • Vidhya Murali
  • Hugh Rawlinson
  • Sravana Reddy
  • Romain Yon

Github Twitter