SILT · Sentient Index Labs & Technology

Guides

The same subject three times, each one going deeper. Start at the top; stop wherever it stops being useful.

Guide 1 · no maths

What We Actually Do

What the two batteries are, why an outside lab is needed when AI companies grade their own homework, and what we explicitly do not claim.

For anyone, including someone who has never heard of us. · PDF

Guide 2 · how it works

Understanding the Method

The cell as the unit of measurement, blind judging, why a model's claim is asked rather than inferred from its prose, why half of each battery stays secret — and what an informed sceptic should still hold against us.

Assumes Guide 1. Still no equations. · PDF

Guide 3 · the arithmetic

The Maths

Every formula in both batteries, worked through with examples — the trimmed mean, the threat score, the four reliability statistics including the ones where we score badly, the Reliance Gap, Wilson intervals, the cluster bootstrap and d′.

For a reader who wants to check the arithmetic rather than take it on trust. · PDF

None of these carries a result figure that could go stale in a drawer — the live numbers are on the dashboards and change as we re-test. What they carry is the method, which changes far more slowly and is the part worth arguing with.