Receipts

We rewound 2025 and ran the model as of three checkpoints, using only what was known then, then checked it against the field the committee actually picked. How it works

Brier · Week 13
0.029
2025 playoff odds, lower is better
Playoff field
89%
Committee model, hidden seasons
70% favorites won
75%
1,990 games since 2014
Leans agree
83%
Résumé vs simulations

Two-Deep scorecard

67%

of the starters we called before kickoff led their group in that game's box score. 14,835 of 22,002 calls, Weeks 2–12.

Called = the official depth chart when the school published one, otherwise who'd been playing through the game before. The O-line isn't scored: there are no public snap counts to check it against. One game is a noisy referee, especially for running backs who split carries.

How the Two-Deep works →
  • Quarterback85%
  • Running back77%
  • Receivers70%
  • Tight end59%
  • D-line56%
  • Linebackers74%
  • Secondary64%

Selected setting

2025 backtest

SeasonAs ofBrierLog loss
2025Week 50.04380.1489
2025Week 90.03690.1189
2025Week 130.02860.0940

Starting point regressed 25% to average · fades to 20% by game 8 · team shock 6 pts · committee noise 2

Brier is the average squared gap between the playoff odds we gave and what happened, so lower is better. Giving every team the same 1-in-11 chance would score about 0.079. From Week 5 to Week 13 the score went from 0.044 to 0.029, 64% better than that baseline by the last checkpoint. Log loss punishes confident misses harder: a team we called a near-lock that missed costs far more than a coin flip that went the wrong way.

All three checkpoints

Calibration

00252550507575100100

Predicted playoff chance (across) vs how often those teams made it (up), in 10-point groups. Dots on the line mean the odds meant what they said. Bigger dots, more teams.

Most teams sit in the lowest group, near 0%, because most teams were never in the race, and those almost never made it. The groups that matter are the middle and the top. A dot below the line means we were too confident; above it means we undersold those teams. At the top, teams we had above 90% made it 5 of 7 times, so the high end runs a little hot.

Every FBS-vs-FBS game, 2014–2025

Game predictions

For each of 9,237 games we rebuilt the ratings from games played before that day only, then checked the pregame win chance against what happened.

How often 70% favorites actually won

75%

1,990 games where we had the favorite between 70% and 80% (average 75%).

Home-team win chance

Calibration

00252550507575100100

Predicted (across) vs how often it happened (up), in 10-point groups. Bigger dots, more games.

Us vs the closing market

BrierLog lossMargin miss
CFB Index0.18330.541013.5
Closing market0.16080.485212.1

Same 1,463 games, the only ones with a historical closing line on file so far. The market wins, and it should: it sees injuries, weather and money we don't. It's a benchmark, never an input here.

What we changed

  • Kept · sigma + home field · held-out Brier 0.1870 → 0.1865
  • Kept · tail shrink · held-out Brier 0.1865 → 0.1863
  • Dropped · early-season extra SD · held-out Brier 0.1863 → 0.1862

Now: spread 13 pts · home field 2 pts · 1% pulled toward a coin flip. All games: Brier 0.1881 before, 0.1873 after.

SeasonGamesBrierLog lossMargin miss
20147630.19930.579814.1
20157660.17040.511713.5
20167630.18940.556013.7
20177870.18180.537413.2
20187800.17800.528313.5
20197750.17400.520213.3
20206500.21630.630912.7
20217740.19140.565713.7
20227800.19880.580612.9
20237920.18090.538813.1
20247990.19140.560013.0
20258080.18050.534812.8

2014 has no 2013 season on file to start from, so every team opens at average; it's scored but left out of tuning. 2020 was short and strange.

GamesBrierMargin miss
By week
Week 10 on3,8170.188512.9
Weeks 1–42,2620.180414.5
Weeks 5–93,1580.190713.0
By matchup
G6-G63,8750.194012.9
P4-G61,2800.146315.8
P4-P44,0820.193812.9
By size of favorite
90%+9930.059514.5
50–60%2,4320.246612.8
60–70%2,2080.227013.2
70–80%1,9900.184413.1
80–90%1,6140.125713.7

Each season predicted without seeing it

Committee model

We hid one season at a time, taught the model on the other eleven, then asked it for that season's Selection Day top 25. Field = share of the playoff field it got right. Order = how closely the top 25 lined up (1.00 is perfect). Miss = average spots off.

FieldTop 12OrderMiss 12Miss 25
Committee model89%92%0.951.32.0
AP poll94%97%0.970.71.7
Record strength alone89%83%0.842.33.7
Our old committee model78%84%0.832.64.5
Losses, then rating68%66%0.754.97.2

Averages over 2014–2025. The AP poll at Selection Day comes out after a season of watching the committee, so it's a tough bar, and it beats us on most of these. Week to week, starting from the last real ranking, the model misses by 2.1 spots on average vs 2.7 for "nothing changes".

FieldTop 12OrderMiss 12Miss 25
201475%92%0.971.42.0
2015100%92%0.940.82.4
2016100%92%0.941.33.0
201775%83%0.931.82.3
201875%100%0.980.80.9
2019100%92%0.971.51.5
202075%75%0.883.23.8
2021100%100%0.970.81.8
2022100%92%0.970.91.4
202375%100%0.940.31.5
2024100%92%0.971.52.2
202592%100%0.951.01.6

2026

Projected vs committee

  • Week 10 · 6 exact · 11/12 in the top 12 · 2.4 spots off

    Missed: we had ···; they had ···.

  • Week 11 · 0 exact · 12/12 in the top 12 · 2.5 spots off

  • Week 12 · 11 exact · 12/12 in the top 12 · 1.3 spots off

Résumé vs simulations

Schedule leans

83%

Where the paired simulations clearly pick a side, how often the résumé reason points the same way. 439 game-and-team pairs from the latest run.

Résumé effectPairsSame way
Under 0.1 spot10062%
0.1 to 0.5 spot13073%
Half a spot or more20999%

They split more than we'd like. The résumé check only sees how the committee would rank you; the simulations also play out conference races and auto bids, so they win ties. When the simulations clearly disagree, Schedule shows their side or calls it a wash.

Our top 25 vs the committee

The committee has released its 2026 rankings. The side-by-side lands here with the next update.

Pate State Freights