Norem

Imagine a learning environment that shapes around your thinking

You build an argument or a model of a phenomenon. As you're building it, the environment begins to discover what you understand. It then pressures the gaps in your understanding, builds exercises around distinctions you keep missing, and then introduces the next challenge that stretches your thinking.

AI already has the capacity to generate these encounters, so why haven't we seen this yet? To do this, a learning environment needs a reliable picture of what you can currently do, and evidence of what helps a learner in that state.

Remembering a date or applying a formula is relatively straightforward to test. It is harder to establish whether you can judge what conflicting historical sources justify, or explain how changing an assumption in a physics model changes its predictions.

Those are reasoning abilities. Teaching them adaptively requires metrics that capture the reasoning itself.

Norem develops instruments that make disciplinary reasoning measurable. We use those measures to build learning environments that take shape around your understanding.

The first tests go on the public record 20 November 2026. Results 19 February 2027, whichever way they go.

Below is the first instrument, in history. The learner builds an argument while the tutor presses on weak phrasings with primary sources and shapes the room around the gaps. Underneath, each commitment the learner makes is measured as historical reasoning. That measure is how the room knows where the gaps are.

0:00 1:52
alextimman@norem.ai

Alexander Timman, founder

Company thesis

Norem builds the verifier that education has never had: a measure of a learner's reasoning that stays valid when it is used to drive adaptive teaching, and the apparatus that keeps checking that measure against independent outcomes.

This document is about why that measurement can be trusted, what follows if it can, and the date on which that is decided.

Why education has never had a verifier

AI improved fastest where it could check its own work. Code has tests and mathematics has proofs; the loop between attempt and verdict closes in seconds and runs millions of times. Science and medicine move slowly because their verifier is the world, and the world takes months to answer. Education sits on the slow side with a worse problem. Its fast measures, exam scores and rubrics applied to prose, are destroyed by the act of optimizing against them. This is one of the best-documented facts in the field: scores on high-stakes tests rise for years while scores on low-stakes tests of the same material do not move (Campbell named the pattern in 1976; Koretz has documented score inflation across decades of testing programmes). The students learned the test. A model tutor steered by an exam rubric is that failure made cheap and fast. It will produce fluent test-takers without deep understanding of the subject.

Everyone building in education with models can see this, and there have been two responses. Neither produces a verifier.

The first keeps the old objects, the lesson, the question, the essay, the rubric, and puts a model on top. Those objects were shaped by scarcity: humans had to author, humans had to score, classrooms had limited hands. The constraints are gone, but the proxies they produced are still the thing being optimized, so the loop closes against the exam.

The second sees that the standard hollows out the disciplines and answers by redefining what should be learned: critical thinking, reasoning games, a curriculum of the founder's own design. This is the more serious response and it has the deeper flaw. The target has moved from the discipline to the founder. Nobody outside the company can check it, so nobody can find out it is wrong, and a target that cannot lose cannot be iterated against. A founder's account of what reasoning is ends up competing with physics, history and mathematics, with no way to be corrected.

A verifier needs a target that sits outside the measurer, can be checked by someone else, and can lose. The disciplines already have one.

The inversion

Nobody worries about teaching to the test in chess, in code, or on a running track. The board, the compiler and the stopwatch cannot be talked into anything. In those fields the test is the activity itself, so getting better at the test and getting better at the thing are one process, and the loop can run as hard as anyone likes. Education's tests are not like that. They stand in for the thing, and the section above is the story of what happens to a stand-in under pressure. The question Norem asks is whether a test of reasoning can be built that behaves like the board: one that nothing can move except the reasoning.

History has a board too. You can sound like a historian without being one, and you can pass the history exams without being one. What you cannot do is write a historical argument that survives review by historians. Norem's test is that review, taken one move at a time.

The learner commits before the evidence is shown, and each commitment is a prediction about a document they have not yet read, resolved by that document afterwards. A prediction is the one judgment fluency cannot fake: a grader reads reasoning off the surface of prose after the fact, and the surface can be learned, while a forecast about an unread document cannot be. The learner's prose is kept and logged; it is not what is scored.

Reviewed against whom, is the other half. A model grading prose reviews against itself; a founder's curriculum, against the founder. In history the reviewers' judgment already exists outside both: every work of history is an expert's judgment on the documents, defended in public, sitting on a shelf. This is the move everything turns on. An expert's judgment has never scaled because it had to be given live, one student at a time. This one is already written. Norem shapes it so that a machine can score every learner's work against it. The one thing left for a human is to confirm that the shaping is faithful to the authors; a working historian signs that it is. The machine is not grading on its own opinion; it is applying a signed one. The key sits outside the company and can be shown wrong by any other historian, which is what a target has to be.

A test that can only be passed by doing the discipline's reasoning, scored against the discipline's own judgments, can be taught to without harm, because teaching to it is teaching the discipline. The failure that has defeated every measure education has had becomes the mechanism. That is the inversion, and everything Norem is rests on it.

What it unlocks

If the measure holds, education becomes the next thing AI gets very good at: not explanation, which it already has, but teaching that leaves a person able to do what the discipline does, and that gets better every time it is used because it can tell when it has worked. That has been imagined for fifty years and delivered by nobody. No curriculum, no lecture. A learner sits down and is met by the one encounter that is right for them at that moment: the question that will find what they have misunderstood, the exercise that forms around the misunderstanding, the challenge that is just slightly too much for them, which is the only kind that moves anyone. They do the discipline rather than read about it, and what they do decides what comes next. Every generation of educational technology has promised this. None could deliver it, because none could tell whether the last encounter had worked, and so none could choose the next. That is the whole of what a verifier is for.

It is a company rather than a paper because of what cannot be copied. A model can reproduce the method, the interface and the reading of a historian's book within weeks, and Norem assumes it will. What it cannot reproduce is the slow part, for the same reason it can design a drug trial and cannot run one: a historian's signature on each body of material, learners met under research conditions, and a public record of claims filed before their data. Those are the inputs. They have always been expensive; what changed is that everything around them became nearly free, so for the first time a company can be organized around them alone. That is the whole of why now. What compounds is what they produce. Every instrument built and every cohort run teaches Norem what to build next, so each instrument is cheaper and its evidence better than the last. Money can buy the inputs. It cannot buy the turns of the loop.

History is the first instrument, not the company. The prototype was built there, on the founder's own historiographical work, and it is a good first test because doing the act and writing about it come apart visibly in history, which is where a grader of prose is weakest and a measure of commitments has the most to show. A measure that holds there could hold anywhere a discipline's judgment is written down: medicine, law, audit. Nothing outside history has been tested. It scores a model as readily as a learner. The ceiling is every field where someone has to reason, and someone else has to be able to tell. The first buyers sought are examination-preparation providers and school programmes with essay-based history assessment, whose question is whether a student did the source work or wrote the template. What Norem sells beyond that, tutors, evidence or experiments, is decided by what buyers pay for, under a rule written before the first commitment comes in.

What it does not claim

Every measure is a proxy, this one included. This one measures the moves, not the mind: it can tell whether someone can do what historians do every day, not whether they would make a good historian. Where the discipline has no settled answer, the test does not invent one; more than half of what was tried on the first material was turned away for that reason. And a test can be impossible to fake and still not matter. Only what the learner can do afterwards, on something they have never seen, can show that it does.

Fields become sciences when their experiments become cheap enough to run many of them. Education has had the right target before: history-education researchers have mapped the components of historical reasoning in detail, and the intelligent-tutoring lineage in mathematics measured those components per step and improved teaching against them. That lineage worked where it was tried and stalled on authoring cost: hundreds of expert hours for each hour of instruction. What has not existed is a measure of that resolution that is cheap enough to run many experiments against and that survives being optimized against. That is why Norem is built as an apparatus for running experiments rather than a product with an opinion. The first three are below.

The tests, and the date

This document has made three claims: that a measure of reasoning can be built which nothing moves except the reasoning; that it holds when a tutor is steered by it; and that what it unlocks is worth a company. The third cannot be tested yet, and February will not touch it. The second is tested when a cohort meets for more than one session. The first is tested now. Each is filed on a public record before its data exists, so the result cannot be written afterwards, and we are seeking an outside co-signer for each.

The first experiment: does the measure beat a frontier model grading the same learners' written arguments? Blind readers decide every disagreement. It holds if they side with the measure two times in three. This tests the grader, not the teaching.

The second: can it be fooled? Answers written to score well without doing the reasoning, by models and by people paid to try, go to both graders. It holds if the measure is fooled at most half as often as the model, and at most one time in five, without rejecting more honest work.

The third: does a tutor steered by this measure teach better than one steered by a model's grading, on something neither grader sees? It needs learners who come back, so it is filed later. It is the only one that can say whether the measure matters. If it fails, the environment above is not built on this measure, whatever the first two showed.

If the first two both fail, Norem says so and reconsiders within two weeks: another domain, or stopping. If one fails, it is named in every claim Norem makes. The pass marks are fixed when the entries are filed on 20 November 2026; the filed versions count. About fifteen learners take a ninety-minute session in January 2027 on material they have never seen. On 19 February 2027 both results go on the record, whichever way they go. That is the date.

The record

Public from 20 November 2026. Every entry is filed before its data exists, on OSF Registries, and mirrored here with a change log.

Seven rungs, each a harder question than the one below it. A claim is only reported as supported or challenged if it was filed before its data.

E1
Instrument integrity
Does the system expose, withhold, record and replay what it claims?
Leak audit of every state of the session, and replay verification of every logged session. pre-registered
Files 20 Nov 2026
E2
Grounded target
Are the material, the target and the intended learner operation defensible?
Historian fidelity review of the Bailey (2021) and Hatcher (1994) reading, with the failure condition set by the reviewer. pre-registered
Buildability check: four of nine acts had an answer, the materials and a fair shape. exploratory
Files 20 Nov 2026
E3
Warranted observation
Does the session draw out the intended work, and does the trace warrant the reading claimed?
F-1 Structural verdicts against a frozen model judge, disagreements adjudicated by blind outside readers. pre-registered
F-2 Responses written to pass without doing the reasoning, scored by both. pre-registered
F-4 The decision rule if F-1 and F-2 are both challenged. pre-registered
Files 20 Nov 2026Reports 19 Feb 2027
E4
Predictive relevance
Does the distinction predict independent or later performance?

No claim yet. F-1's secondary outcome check touches it.

E5
Decision relevance
Does knowing the distinction change what a teacher or tutor should do next?

No claim yet.

E6
Causal instructional value
Does acting on it teach better than a frontier model judging prose and steering a tutor?
F-3 Two tutors, same sessions, one steered by structural verdicts and one by the model judge, compared on an outcome neither sees. declared, not signed
Signed before the first Phase II cohort
E7
Durable capability
Does the advantage survive transfer, less help and time?

No claim yet.

How to read it

Pre-registered
Filed with its prediction and pass mark before any data existed. Only these can be reported as supported or challenged.
Exploratory
A finding from work already done. Recorded so it is visible, never counted as a test.
Supported, challenged, unresolved
The outcome against the filed pass mark. Unresolved means too little data to decide.
Context-bound
A result from one population that holds there until a second population replicates it.

The frozen session material and the model judge's version, prompt and rubric are published as hashes at filing, not in full, so that January learners still meet the material for the first time. Commercial evidence is kept separately and is not on this page.

Change log: no changes yet.