Models competing in the current choice prediction competition can make use of the data collected as part of CPC15 (Erev et al., 2017). These data include Problems 1-150 given in the link (Estimation Data) below. In addition, to supplement and extend the data (and the space of choice problems), we ran Experiment 1, and plan to run Experiment 2 at a later date. The data of the latter will be used as the competition set for one of the tracks of the choice prediction competition (see below). The apparatus and design of these two new experiments are very similar to those used in Erev et al. (2017) and the reader is referred there for more details. Hereinafter, we provide the essentials.
Experiment 1 includes Problems 151-210 listed in the link (Estimation data) below. These 60 choice problems were randomly selected according to the problem selection algorithm which is detailed here (add link). Two-hundred and forty participants (139 female, MAge = 24.5) participated in the experiment, half at the Technion and half at the Hebrew University of Jerusalem. Each participant faced one set of 30 problems: half faced Problems 151-180 and the other half faced problems 181-210. The order of the problems was randomized among participants. Each problem was faced for 25 trials consecutively. The first five trials without feedback and the rest with full feedback. Participants were paid for one randomly selected choice they made, in addition to a show-up fee. The final payoff ranged between 10 and 136 shekels, with a mean of 40 (about 11 USD).
Calibration Set data: https://zenodo.org/record/845873#.WeDg9GhSw2x
Please note: Zenodo is having some technical issues that do not currently allow to download a csv file in most web browsers (it opens it as a text file within the browser). If this happens to you, please right-click on “download” and choose “save link as”.
If you prefer a bird’s-eye view, here is a file that includes all 210 problems of the Calibration data, with complete detailed distributions of both options, and the aggregate choice rates for Option B by 5 blocks of 5 trials each.
Here, Option A provides av1 with probability ap1, av2 with probability ap2 etc. Option B provides bv1 with probability bp1, bv2 with probability bp2 etc.
Competition Set data:
Track I (Aggregate behavior):
Aggregate choice rates
Aggregate choice rates: Problems listed with complete distributions
Raw data
Track II (Individual behavior):
Individual choice rates by game and block
Raw data