Frequently Asked Questions
Where can I get the Million Playlist Dataset
Once you've registered with the system you can get the dataset from the
Where can I get the Challenge Dataset
Once you've registered with the system you can get the challenge set from the
How is the challenge scored?
See the Metrics
section of the Rules
What is the format for a submission?
See the Sample Submission
section of the Challenge Set Readme
When is the leaderboard updated?
Once we start accepting submissions (ETA End of March) we will update the leaderboard daily.
What are the prizes?
For each track, the top three teams will be awarded a share of prize money. The top team will receive $4,000, the second $2,000, and the third $1,000.
How can I make a team?
The team management support is coming soon.
What is the calendar?
- January 2018 - release of the Million Playlist Dataset
- End of February 2018 - release of the detailed, rules, evaluation metrics, challenge set.
- Mid-march 2018 - Team management
- End of March 2018 - Open for submissions, leaderboards updated daily.
- End of June 2018 - Final submissions due
- Early July 2018 - Announcement of the final leaderboard
- Mid July 2018 - Paper submissions due
- Mid August 2018 - Paper acceptance notifications
- Mid September 2018 - Camera-ready due for accepted papers
- October 2-7, 2018 - Workshp will take place as part of the ACM RecSys conference in Vancouver,
Can non-academic researchers particpate?
Yes - non-academic researchers can participate as advisors. See the Participation by non-academic researchers
of the rules
Why can't industry particpants get full access to the Million Playlist Dataset like academic researchers can?
We wanted to release a comprehensive dataset while protecting our both or users' privacy and our intellectual property
in an extremely competitive environment. Restricting the release of the dataset to academic researchers was the best
solution we could find and still participate in this project.
How can I register as a non-academic researcher ?
We will be adding this support to the registration form in the very near future.
How do I submit my teams's paper about the challenge?
Visit the main RecSys Challenge
page for information on the workshop, paper submission and selection.
Is there a support forum?
Yes! Join the
RecSys Challenge 2018 Google Group
to ask questions, share ideas and exchange
insights about the challenge with the organizers and other participants.
How does team management work?
From your Profile Page
you can create a team. When you do so you are considered to be the Team Lead
. As the Team Lead, you can
invite other researchers to your team, and you can submit your team results to the leaderboard. If you wish to join an already existing team, contact the Team Lead and ask
them to invite you to join the team. Be sure to give them the e-mail address that you used when you registered for the RecSys challenge
How do I switch teams?
From your Profile Page
in the My Team
section click on the 'leave your team' and follow the instructions to leave your team.
Once you have left your team, you are free to create a new team, or join another team at the invitation of another Team Lead.