NovaRunners vs. TullyRunners
Bill Meylan has rated cross country races since 1999 and publishes the ratings on TullyRunners.com. Our points scale uses the same convention, so we check how far apart the two systems land, meet by meet.
TullyRunners’ numbers are used only to check ours and to set where our scale sits. They never enter our calculation.
What is compared
Both systems turn a finish time into points with one number per race: roughly, points = the race’s number − time ÷ 3. Every TullyRunners rating in a race fits this form, so each race has one such number. We read it off the published ratings and call it TullyRunners’ race number.
- We compare 35 meets that both systems rated in 2022 to 2025, matched by MileSplit meet ID: 70 comparisons of one meet and one sex. No runner is matched by name.
- Each comparison is checked without that meet: our scale for that season is set from the other matched meets, so a meet cannot agree with TullyRunners just because it helped set the scale.
- 2026 is not compared. TullyRunners’ 2026 numbers stay unused for now.
- Our ratings are on the season scale described on the Method page, so each rating gap here includes its season’s constant, and the constant moves every rating gap of that season and sex by the same amount. The course gap and the course constants stay on TullyRunners’ own scale and do not move.
We report two gaps, both in points:
- Rating gap: our race number minus TullyRunners’, using the ratings we publish. A positive gap means we rate that meet’s runners faster than TullyRunners does.
- Course gap: the same comparison for the course and the day’s conditions alone, with the shared fitness curve taken out of ours. A positive gap means the course read slower to us.
Headline numbers
To read a gap: a rating gap of +3 means our ratings of that meet’s runners sit 3 points, about 9 seconds, above TullyRunners’. A gap is a disagreement, not an error.
Three findings
1. Early-season meets: mostly Knights Crossing
Before ratings were put on the day, we rated runners at early-season meets higher than TullyRunners did, and runners at November meets lower. On the day, Knights Crossing’s rating gap averages −1.5 points, down from +8.9.
For the courses alone the pattern flips: our early-season courses read faster than TullyRunners’. Course gaps average −8.0 points in September and +1.4 in November. Most of that is Knights Crossing. Without it, September averages −1.3, close to November, though the early-season pattern returns once the Class 1 to 3 state races are also left out. Our reading, not Meylan’s: TullyRunners judges runners against their recent ratings, so it may absorb some in-season improvement.
2. State courses: Oatlands runs harder, by more than TullyRunners allows
The VHSL Class 4 to 6 state meets are run at Oatlands Plantation; Class 1 to 3 at Green Hill Park (Virginia Tech in 2024). Both systems rate Oatlands as the harder course, but we separate the two by about 10 points more than TullyRunners does on average (3 to 17), in every season and sex.
Our reading is that TullyRunners underrates Oatlands. Its numbers for Nike Cross Regionals (NXR) New York 2025 at Bowdoin Park (503 boys, 506 girls) sit above its 2025 Oatlands state meets (499, 501), while ours for Oatlands, 503 to 510, sit at the Bowdoin level. A race’s number also carries the day’s conditions and field, so this cannot settle it.
3. TullyRunners is a comparison, not ground truth
TullyRunners adapts the Beyer speed figures used in horse racing. A race’s correction comes from how runners of known ability finished, how fast the course is known to run and the quality of the race, with judgment where data are thin. Both systems’ numbers for one course move from year to year, because a race’s number carries the day’s weather and field as well as the course. VHSL Class 1 girls at Green Hill Park moved 10 points for TullyRunners and 14 for us from 2022 to 2023. A gap says the two systems differ at that meet, not which one is right.
70 COMPARISONS · 2022–25
Every compared meet
Gaps beyond 6 points either way are marked with an asterisk. “Ours” is set without the meet. Meet pages set their course constant from all of the season’s matched meets, so theirs can differ slightly; the “Ours” tooltip gives that value.