Timeline

The Crowd Analysis Project is a multi-year research project. We will collect prediction data in 2024 and publish the results in 2025. Research Teams can register in the fall of 2023 to contribute their aggregation algorithms in early 2024.

  • Registration opens

    2 October 2023

    Teams are invited to register for the Crowd Analysis Project.

  • Prediction Survey Design

    Deadline: 17 November 2023

    You will have the opportunity to review the questions included in the prediction survey and propose and vote on additional measures to be included.

  • Publication of Final Codebooks and Datasets

    18 December 2023

    Once the prediction survey has been finalized, we publish updated codebooks and datasets so you can start to develop and implement your aggregation algorithms.

  • Algorithm Submission

    Deadline: 29 February 2024

    Once the prediction survey has been finalized, we publish updated codebooks and datasets so you can develop and implement your aggregation algorithms.

  • Algorithm Peer Review

    15 - 30 March 2024

    While we are getting ready to collect the prediction data, you will be asked to assess the prediction accuracy of algorithms submitted by other teams.

  • Data Collection

    March 2024 - August 2024

    Once all teams have submitted their algorithms, we will conduct the prediction surveys. We will survey independent samples of US participants through Prolific every month for half a year.

  • Data Analysis and Publication

    Early 2025

    Once we have collected the prediction data, we will run the submitted algorithms on these datasets. We also bring in “ground truth” data to measure the accuracy of the aggregation results. We rank the algorithms by accuracy and the RT with the highest accuracy in a domain will get a cash prize of EUR 2.500.