Home » Uncategorised » Papers Track, Post-Submission Report

Papers Track, Post-Submission Report

NB — The numbers might not always work out here, there are missing data from the analyses due to conflicts.

Increase in Submissions

CHI 2024’s Papers track has received 4046 complete submissions. This is a significant increase compared to 2023 (3,182, increase of 27%) and 2022 (2,579, increase of 57%). The chart below shows the number of complete submissions to the Papers track over the last ten iterations of the conference. The dip caused by the pandemic is visible in 2021-23. (Recall that although the 2020 conference was cancelled, the Papers track was finalized prior to the beginning of the pandemic.) A linear model has been fit to the pre-pandemic submission data and plotted along with the standard error. Although this year represents a very large increase in submissions over the last couple of years, the number received is on (linear) trend1.

A bar chart showing the number of Papers submissions to CHI over the last decade. A linear fit has been added to the plot.

Distribution of Submissions by Author

How many submissions have individual authors made? The 4046 complete submissions were produced through the collective efforts of 12924 authors (i.e., M=3.2 authors/submission). Looking at complete submissions only, the mean number of submissions per author is 1.5 (SD = 1.4) with a mode of one. Of the 12924 authors, 9896 are authors on a single submission. The 4046 complete submissions will, if they all go to full review, require 16,184 reviews. The 100 most prolific authors have made 1155 submissions between them (i.e., generated a review load of 4620 reviews). Any author making nine or more submissions is among the 100 most prolific authors.

Requests for reviews went out last week. Each submission has, on average, 3.2 authors. Where a submission has two authors, each author will need to provide two reviews to cover the load their submission has created. A mythical average paper, with 3.2 authors, will need each author to provide 1.25 reviews. Associate Chairs will be providing a huge amount of labour to this process, meaning the effective external load is lower. However, we really do need colleagues who have submitted papers to accept reviews where they have relevant expertise. If you’re contacted by an AC still struggling to find a reviewer, please do your best to help.

Once we are deeper into the review process, we will be producing an analysis of each paper’s review `coverage’, i.e., the extent to which the authors of a given submission have contributed reviews back to the pool.

Geographical Distribution of Submission Authors

CHI 2024 has received submissions from authors in 79 countries and territories2. Submissions were made from five countries in 2023 from which no submissions were made in 2024, but submissions were received from 16 countries from which no submissions were made in 2023. This means we have, net, eleven more countries represented at CHI 2024 than at CHI 2023. Here are the countries from which authors are
submitting:

A map of the world (without Antarctica) showing countries from which CHI 2024 Papers submissions were received highlighted

In which countries are authors’ institutions based? Of the 12924 authors in total, 10908 authors (84%) have primary affiliations in one of ten countries:

Country Number of Authors % of all authors
United States of America 4718 37%
China 1617 13%
Germany 1064 8%
United Kingdom 953 7%
Canada 624 5%
South Korea 528 4%
Japan 465 4%
Australia 454 4%
Netherlands 292 2%
Finland 193 1%

Thinking about the growth in authorship again, is growth geographically even, or is it coming from particular places? Let’s look at the country data again, but this time let’s look at the data for more countries, and let’s look at the numbers for 2023 alongside those for 2024. We include a country if fifty or more authors have affiliations there for 2024 submissions. Here are the data, sorted by year-on-year growth.

Country # Authors 2023 # Authors 2024 Growth from 2023 to 2024
Hong Kong S.A.R. 30 61 103%
China 885 1617 83%
Singapore 69 125 81%
Israel 31 54 74%
Japan 299 465 56%
South Korea 347 528 52%
Portugal 57 85 49%
Finland 130 193 48%
Australia 328 454 38%
Switzerland 149 192 29%
Netherlands 233 292 25%
Germany 853 1064 25%
United States of America 3848 4718 23%
Austria 97 118 22%
Canada 523 624 19%
United Kingdom 830 953 15%
Denmark 138 153 11%
Bangladesh 58 64 10%
France 136 148 9%
Sweden 94 97 3%

It’s clear from this table that a significant proportion of the growth in authorship (and therefore submissions) in 2024 are coming from authors based in China (732 authors more in 2024 than 2023) and the USA (870 more authors, albeit from a much higher base). Of the 24 countries from which fifty or more authors have made submissions in 2024, twenty have recorded growth in author numbers and four have recorded declines. The absolute increases in author counts for all countries with authors submitting in 2024 are plotted below:

A map of the world (without Antarctica) showing countries from which CHI 2024 Papers submissions were received. There are different graduations of colours to show how the number of submissions from each country changed between CHI 2023 and CHI 2024. Raw data are available in the final section of this post.

Subcommittee Load

Submissions to the CHI Papers track are made to one of eighteen subcommittees. These subcommittees have a topic focus (e.g., Health, Design, User Experience). Every subcommittee has received more submissions in 2024 than in 2023. The number of submissions to the Understanding People — Qualitative split increased by 58%. The number of submissions to the Visualisation subcommittee increased by 4%. The following chart orders subcommittees by the number of submissions they received in 2024. The number of submissions in 2023 is over-plotted to
give a sense of how the increases in submission numbers have been distributed.

A histogram showing the number of Papers submissions to each of the eighteen CHI 2024 subcommittees. The data are sorted from the highest number in 2024 (UX) to the lowest number in 2024 (Devices). Data from 2023 have been overplotted to show the change year-on-year. Raw data are available in the final section of this post.

Bonus Chartjunk

The review process for the CHI Papers track produces vast quantities of data. Some of this is more illuminating that others. We have tried to curate some of this illuminating data above. If you have suggestions, please do send them to analytics@chi2024.acm.org. The next post will focus on reviewing, reviewers, and how these relate to authorship. In the meantime, we leave you with two charts that tell an unsurprising story of working to deadlines:

THIS histogram showing the number of new submissions created for each day leading up to the Abstract Deadline. It shows, unsurprisingly, a strong peak at the deadline.
Thos plot is a histogram showing the date at which a given submission received its final edit. The peak at the deadline is even more pronounced here than in the hisotogram of creation times, with everyone making changes right up to the deadline.

Datatables

For data represented in this post in non-tabular form, we are currently working to make the underlying data tables interactive and accessible. For the moment, here are all results or the most recent results of each:

For the plot of submissions to the CHI Papers track over the last ten years:

Year Submissions
2024 4046
2023 3182
2022 2579
2021 2845
2020 3126
2019 2958
2018 2590
2017 2400
2016 2435
2015 2120

For the chart showing the changes in submissions to different subcommittees between 2023 and 2024, here are the data for all subcommittees:

Subcommittee # Submissions 2023 # Submissions 2024 Absolute Change 2023 to 2024 % Change
Accessibility and Aging 192 275 83 43%
Blending Interaction: Engineering Interactive Systems and Tools 198 262 64 32%
Computational Interaction 177 276 99 56%
Critical Computing, Sustainability, and Social Justice 177 190 13 7%
Design 239 265 26 11%
Developing Novel Devices: Hardware, Materials, and Fabrication 94 121 27 29%
Games and Play 131 149 18 14%
Health 206 276 70 34%
Interacting with Developing Novel Devices: Hardware, Materials, and Fabrication: Interaction Techniques and Modalities 217 286 69 32%
Interaction Beyond the Individual 151 172 21 14%
Learning, Education, and Families 186 236 50 27%
Privacy and Security 132 195 63 48%
Specific Application Areas 151 229 78 52%
Understanding People — Qualitative Methods 152 240 88 58%
Understanding People — Statistical and Quantitative MethodsMethods 148 225 77 52%
Understanding People — Mixed and Alternative Methods 158 200 43 18%
UX 244 287 43 18%
Visualization 151 157 6 4%

The data from the histograms showing the point of initial submission creation and the point of final submission are below:

Date Number of Submissions Created
2023-09-08 3
2023-09-07 866
2023-09-06 1046
2023-09-05 707
2023-09-04 407
2023-09-03 261
2023-09-02 101
2023-09-01 116
2023-08-31 146
2023-08-30 121
2023-08-29 80
2023-08-28 91
2023-08-27 49
2023-08-26 21
2023-08-25 33
2023-08-24 51
2023-08-23 64
2023-08-22 54
2023-08-21 39
2023-08-20 40
Date Number of Submissions Receiving Final Update
2023-09-15 306
2023-09-14 3163
2023-09-13 240
2023-09-12 52
2023-09-11 23
2023-09-10 26
2023-09-09 5
2023-09-08 7
2023-09-07 19
2023-09-06 11
2023-09-05 7
2023-09-04 7
2023-09-03 5
2023-09-02 1
2023-09-01 5
2023-08-31 5
2023-08-30 5
2023-08-29 1
2023-08-28 5
2023-08-27 1

  1. Extrapolating this trend has the conference receiving
    approximately 9,000 submissions by 2050; whether a linear model a good
    model, or whether linear growth is desireable, we will leave up to
    you.↩︎
  2. e.g., British Indian Ocean Territory is not a sovereign
    country, but it would not make sense to count it as part of the United
    Kingdom.↩︎