EvalRS
A Rounded Evaluation of Recommender Systems
Registration and Leaderboard

EvalRS Challenge

Join us on the Data Challenge Slack for up-to-date communication and questions

Started! Join The Race!

Here you can read the full paper : evaluation scripts and artifacts will be shared publicly in our repository.

Standard and Behavioral Testing

We aim for a rounded testing of recommender system, to award not only point-wise metrics but also patterns that are important for humans.

Prize

Main Prize

5k USD total prize amount for winning teams

Support Prize

Free tickets at CIKM for the best systems (first) authored by students

Sponsors

Proudly sponsored by these amazing folks.

Important Dates

What When
Registration / Challenge Start August 5
We accept design papers starting September 10
Deadline paper submission September 25
Acceptance decision October 1
Final paper submission after review October 10
Challenge End (stop submission) October 10
Workshop during CIKM October 17

Organizers

...

Jacopo Tagliabue

Coveo Labs

...

Ciro Greco

Coveo Labs

...

Tobias Schnabel

Microsoft Research

...

Patrick John Chia

Coveo

...

Federico Bianchi

Stanford University

...

Giuseppe Attanasio

Bocconi University

...

Gabriel de Souza P. Moreira

NVIDIA