A Rounded Evaluation of Recommender Systems
Registration and Leaderboard

EvalRS Challenge

Join us on the Data Challenge Slack for up-to-date communication and questions

Started! Join The Race!

Here you can read the full paper : evaluation scripts and artifacts will be shared publicly in our repository.

Standard and Behavioral Testing

We aim for a rounded testing of recommender system, to award not only point-wise metrics but also patterns that are important for humans.


Main Prize

5k USD total prize amount for winning teams

Support Prize

Free tickets at CIKM for the best systems (first) authored by students


Proudly sponsored by these amazing folks.

Important Dates

What When
Registration / Challenge Start August 5
We accept design papers starting September 10
Deadline paper submission September 25
Acceptance decision October 1
Final paper submission after review October 10
Challenge End (stop submission) October 10
Workshop during CIKM October 17



Jacopo Tagliabue

Coveo Labs


Ciro Greco

Coveo Labs


Tobias Schnabel

Microsoft Research


Patrick John Chia



Federico Bianchi

Stanford University


Giuseppe Attanasio

Bocconi University


Gabriel de Souza P. Moreira