Observatory

Is it skill or luck?

We do not assume the answer. This page reports whether the competitive rating predicts later results — with denominators, and without calling any of it evidence of ability.

exploratory — not preregistered

Does Arena rating from earlier matches predict who wins later matches?

Frozen at 2026-09-01. about 50% for both lines below if competitive skill does not persist.

Prediction accuracy

higher-rated player wins64.3% of 28
mean Brier score0.241 of 28

0.25 = coin flip; lower is better calibrated.

Calibration

pre-match probabilitymatchespredictedobserved
0–10%18%100%
10–20%118%0%
30–40%137%0%
40–50%250%50%
50–60%450%75%
60–70%1361%77%
70–80%177%100%
90–100%292%50%

Does the top quartile stay on top?

top quartile, later-half win rate81.8% of 11
everyone else, later-half win rate—

split matches by time; rank players on the earlier half, then measure the later-half win rate of the top quartile vs everyone else. Train: 15 matches · test: 15.

A rating that predicts later results would be a discovery; so far this is reported as a competitive observation, never as evidence of ability. See also how scores are explained and the Arena record.