AI in Scientific Research: How to Tell Where It Is Actually Working
4 min read · updated August 3, 2026
“AI discovered a new material.” “AI found a drug candidate.” “AI solved protein folding.” Each of those sentences can be true, badly misleading, or flatly wrong depending on one thing the sentence does not tell you: how far the result got from the model before somebody wrote it down.
The sentence that hides four different claims
Take a single headline: a model proposed a molecule that binds a protein implicated in a disease. That sentence is compatible with at least four very different states of the world. The molecule might exist only as a string in a file. It might have been synthesised. It might have bound the protein in a test tube. Or it might have improved an outcome in a person. Those four are separated by years, by orders of magnitude in cost, and by a probability of success that drops at every step — and press coverage routinely reports the first as though it were the fourth.
This is not a complaint about journalism. It is the single most useful thing to internalise about the whole field, because once you have the ladder in your head you can grade a claim in about ten seconds, and you can do it for a subject you know nothing about.
The ladder
The rungs are the same in every discipline. Only the names of the instruments change.
| Rung | Description |
|---|---|
| 1 · Output | The model emitted something: a structure, a score, a candidate, a forecast. Nothing has been checked. Everything downstream is conditional on this being worth checking. |
| 2 · Retrospective | The output was compared against data that already existed — held-out structures, historical weather, known compounds. This is where nearly all published numbers live, and it is entirely dependent on the held-out set resembling the future. |
| 3 · Prospective | The prediction was made first and the answer arrived afterwards. A forecast verified against what the weather then did. A candidate synthesised after being proposed. This rung is qualitatively stronger than rung 2 and much rarer. |
| 4 · Confirmed | An independent method established the result: a crystal structure solved, a compound characterised, a proof mechanically checked, an effect replicated in another lab. |
| 5 · Adopted | Practitioners changed what they do. The predicted structure is now the starting point for the experiment; the ML forecast is in the operational suite. This is the only rung that means the field actually moved. |
Where most claims actually sit
Rungs 1 and 2. Overwhelmingly. And rung 2 is a great deal weaker than it looks, because retrospective evaluation on scientific data has a specific failure that ordinary machine learning does not: the held-out set is usually not independent of the training set in the way the split implies. Protein structures share evolutionary ancestry, so a random split leaves near-homologues on both sides. Materials databases are full of compositional substitutions of the same structure type. Patient cohorts share a scanner, a hospital and a labelling convention.
The consequence is that a retrospective score is best read as an upper bound on what will happen prospectively, and often a generous one. That is not a reason to dismiss rung 2 — it is how methods get developed — but a claim that stops there has not yet said anything about the world. The specific mechanisms are the subject of the failure modes AI introduces into a method section.
Why some fields move and others do not
Compare two verification steps. Checking a proposed proof step in a formal system takes a computer a fraction of a second and the answer is binary. Checking whether a drug candidate helps a person takes years, costs an enormous amount, and returns a noisy answer. Both fields have had excellent models pointed at them. Only one of them has been visibly transformed, and the reason is not the quality of the models.
So the useful predictor of where machine learning changes a science is the cost and latency of that field’s verification step, relative to the cost of generating a candidate. Where verification is cheap — formal proof, code that either runs or does not, a simulation you can re-run, a forecast that is checked by tomorrow — a model that produces many mediocre candidates is enormously valuable, because you can afford to discard almost all of them. Where verification is expensive, the bottleneck was never candidate generation, and speeding it up moves very little. That argument is worked through with numbers in the case for and against a compressed research cycle.
It also explains the pattern that otherwise looks arbitrary. Structural biology moved fast partly because a predicted structure is immediately usable as a hypothesis by people who already had experiments planned. Weather moved fast because every forecast is verified within days by the atmosphere itself. Clinical medicine has moved slowly because the verification step is a trial, and no model shortens a trial.
Five questions that grade any claim
- Which rung? If the answer is 1 or 2, the correct word is “predicted” and any sentence using “discovered”, “found” or “solved” has been upgraded somewhere between the paper and you.
- Who checked it, and were they the same people? Independent confirmation is a different claim from the authors validating their own candidates, particularly when the validation method is also automated.
- What exactly did the model contribute? Proposing the candidate, ranking a list somebody else generated, and choosing which experiment to run next are three different contributions, and the third is usually the valuable one.
- Was the split honest? Ask what would have had to be true for the test set to be genuinely unseen. In most scientific data it requires a deliberate split by structure, by time or by site, not a random one.
- What is the base rate? A hit rate is only interpretable against what the existing method achieves on the same problem. A candidate list with no comparator is not evidence about the model.
None of this is scepticism for its own sake. Several fields in this cluster have genuinely reached rung 5, and the pages say so plainly. The point of the ladder is that it lets you tell those apart from the rest without waiting for the correction.