You will evaluate {{ n_candidates }} candidates over {{ num_task_rounds }} independent rounds. In each round, a new set of candidates is drawn. Your job is to identify and hire the candidate with the highest true quality.
Each candidate has a hidden true quality between 40 and 100. You never observe true quality directly — you collect noisy signals about it.
{% if condition == 'aware' %}
⚠ Screening threshold: shown each round
{% else %}
Screening threshold: not disclosed
{% endif %}
HOW SIGNALS WORK
Each click on a candidate reveals one signal. A signal is a noisy draw from that candidate's true quality — specifically, true quality plus random noise with a standard deviation of 12 points. A candidate with true quality 70 might produce signals like 64, 75, or 58 on different clicks.
Your score for a candidate is the average of all signals you collect. The more clicks you spend on a candidate, the more accurate their score becomes, because averaging reduces noise. A candidate you never click receives a default score of {{ prior_mean }} — the prior mean — regardless of their true quality.
You have {{ total_clicks }} clicks in total per round, shared across all {{ n_candidates }} candidates. Every click spent on one candidate is a click unavailable for others.
STAGE 1 — RÉSUMÉ SIGNAL
Noise SD = {{ resume_sd }}
signal=?+?=?
Avg score50(no clicks yet)
STAGE 2 — INTERVIEW SIGNAL
Noise SD = {{ interview_sd }}
signal=?+?=?
Avg score50(one signal)
Each replay draws fresh signals — notice Stage 2 clusters tighter around true quality.
THE SCREENING THRESHOLD
{% if condition == 'aware' %}
The screening threshold is drawn fresh each round from between {{ threshold_low }} and {{ threshold_high }}. The realized value is shown to you at the start of each round.
After you submit your Stage 1 scores, every candidate whose score is at or above the realized threshold advances to Stage 2. Candidates below the realized threshold are eliminated — you will never see them again in this round.
In Stage 2, each advancing candidate receives one additional evaluation signal, and you choose one candidate to hire.
The threshold is the gate. A strong candidate who was under-evaluated in Stage 1 may score below the realized threshold and be permanently eliminated — even if their true quality was the highest in the pool.
{% else %}
A screening threshold is drawn each round but not disclosed to you. Some candidates will advance to Stage 2; others will not.
After you submit your Stage 1 scores, candidates above the hidden screening cutoff advance to Stage 2. You are not told what the cutoff is.
In Stage 2, each advancing candidate receives one additional evaluation signal, and you choose one candidate to hire.
The cutoff changes each round and is unknown to you. Evaluate all candidates carefully — a candidate you ignore in Stage 1 may fail to advance regardless of their true quality.
{% endif %}
HOW YOU ARE SCORED
Your performance is your top-catch rate — the fraction of rounds in which you successfully hire the candidate with the highest true quality among those who advanced to Stage 2. There are no partial points per round: it is a hit or a miss.