Timeline
The Crowd Analysis Project is a multi-year research project. We will collect prediction data in 2024 and publish the results in 2025. Research Teams can register in the fall of 2023 to contribute their aggregation algorithms in early 2024.
-
Registration opens
2 October 2023
Teams are invited to register for the Crowd Analysis Project.
-
Prediction Survey Design
Deadline: 17 November 2023
You will have the opportunity to review the questions included in the prediction survey and propose and vote on additional measures to be included.
-
Publication of Final Codebooks and Datasets
18 December 2023
Once the prediction survey has been finalized, we publish updated codebooks and datasets so you can start to develop and implement your aggregation algorithms.
-
Algorithm Submission
Deadline: 29 February 2024
Once the prediction survey has been finalized, we publish updated codebooks and datasets so you can develop and implement your aggregation algorithms.
-
Algorithm Peer Review
15 - 30 March 2024
While we are getting ready to collect the prediction data, you will be asked to assess the prediction accuracy of algorithms submitted by other teams.
-
Data Collection
March 2024 - August 2024
Once all teams have submitted their algorithms, we will conduct the prediction surveys. We will survey independent samples of US participants through Prolific every month for half a year.
-
Data Analysis and Publication
Early 2025
Once we have collected the prediction data, we will run the submitted algorithms on these datasets. We also bring in “ground truth” data to measure the accuracy of the aggregation results. We rank the algorithms by accuracy and the RT with the highest accuracy in a domain will get a cash prize of EUR 2.500.