Treatment reasoning as iterative tool use: what ATHENA-R1 gets right

Recalling that metformin treats type 2 diabetes is not the same task as deciding whether to prescribe it to a patient with declining kidney function who is already on three interacting medications. The first is retrieval. The second is what a new paper out of Marinka Zitnik's lab at Harvard calls treatment reasoning: integrating disease context, comorbidities, current medications, contraindications, and a moving body of evidence into a single defensible decision. Most clinical AI benchmarks measure the first task. The paper argues the second one — the actually hard one — can be trained the same way we've learned to train models on math and code: as an iterative, verifiable process rather than a single forward pass of pattern matching.

The resulting system, ATHENA-R1, is worth examining closely, and not because it tops a leaderboard. It's the training design and the validation discipline that make this one different from the usual medical-LLM paper.

An agent with a tool universe, not a bigger model

ATHENA-R1 doesn't try to hold all of pharmacology in its weights. It's an agent with access to 212 curated biomedical tools spanning every FDA-approved drug since 1939, covering indications, contraindications, drug-drug interactions, pharmacology, adverse reactions, disease phenotypes, therapeutic targets, and patient-population restrictions. At each step it identifies what information is missing, picks and executes a tool, interprets what comes back, and decides whether it has enough evidence to answer or needs another step — continuing until it can produce a final answer with a documented reasoning trace attached. That trace is not an afterthought; it's the thing clinicians actually evaluated, and it turns out to matter more than the final answer itself.

Two levels of self-learning

What makes this trainable is the data problem being solved first. A multi-agent system autonomously constructs reasoning trajectories over the tool universe, producing ATHENA-R1-Instruct: 378,027 instruction-tuning samples derived from 85,340 reasoning traces, comprising 177,626 individual reasoning steps and 281,695 tool calls, all grounded in the FDA drug corpus. That's the supervised fine-tuning stage — it teaches the base model what a well-formed evidence-gathering trace looks like.

The second level is where this stops looking like ordinary instruction tuning. After SFT, the model goes through reinforcement learning driven by rule-based scientific feedback across six dimensions of reasoning quality: things like answer correctness, evidence-gathering thoroughness, multi-step reasoning coherence, and tool-use validity. This is closer to the RL-with-verifiable-rewards recipe that has worked for math and code than it is to RLHF's preference modeling. The reward isn't "a human liked this answer better" — it's rule-based checks against a domain with enough structure (curated drug data, unit-testable tool calls) to make automated scoring possible in the first place.

What the benchmarks show

On DrugPC — 3,168 drug-reasoning questions across 11 tasks — ATHENA-R1 hits 94.7% accuracy against GPT-5's 76.9%, DeepSeek-R1's 68.8%, and Qwen3's 48.7%. On TreatmentPC, 456 patient-specific treatment cases that require integrating a full clinical picture rather than answering an isolated drug-fact question, ATHENA-R1 scores 82.9% against GPT-5's 72.2% and DeepSeek-R1's 67.5%.

The more informative number, to me, is where tool-calling-specialized models land: ToolACE-8B manages 13.4%, WattTool-8B just 5.9%. Being fluent at invoking tools and being able to reason about which evidence actually resolves a clinical question are not the same skill, and the gap between them is enormous. Tool-use fine-tuning without a reward signal tied to the correctness of the resulting decision produces models that call tools competently and conclude nothing useful.

Checking against reality, not just benchmarks

The part of this work I'd point to first is what happens after the benchmarks. A panel of 23 evaluators from 28 rare disease organizations reviewed 110 responses blind and preferred ATHENA-R1 across all eight evaluation criteria, most strongly on cognitive traceability (95.5% preference) and helpfulness of rationale (94.5%). On absolute quality, ATHENA-R1 scored 4.16±0.90 out of 5 against 2.44±1.26 for reference models. Separately, physicians reviewing three complex hospitalized-patient cases rated it 4.63±0.52 across the same eight criteria over nine case-reviewer pairs.

Then there's the step most papers in this space skip entirely: testing whether the agent's reasoning produces hypotheses that hold up against real outcomes data. The authors ran ATHENA-R1-generated adverse-event hypotheses against longitudinal health records from 5.4 million patients and found three statistically significant associations — an adjusted odds ratio of 1.84 for acute kidney failure with beta-blocker use in hypertensive patients with gout, 1.78 for hyperkalemia in the same population, and 1.48 for hepatocellular carcinoma with DPP-4 inhibitor use in diabetic patients with ischemic heart disease. Negative controls showed no spurious associations. That's a meaningfully higher bar than "does this answer sound plausible to a reviewer" — it's "does this reasoning generate a signal that survives contact with epidemiological data."

My take

The generalizable idea here isn't the specific tool count or benchmark score — it's the reframing. Treatment reasoning looked like an unbounded, subjective domain that only large-scale human preference data could shape. This paper's bet is that it's actually a bounded, tool-grounded evidence-gathering process, and bounded, verifiable processes are exactly what RL is good at optimizing. The six-dimension rule-based reward is doing the same job that unit tests do for code-generation RL: giving the optimizer a signal that doesn't require a human in the loop for every sample.

That boundedness is also the caveat. This works because the underlying domain — FDA-approved drugs, curated interaction databases, structured contraindication data — is unusually clean for reward-scoring at scale. I'd expect this recipe to transfer well to other bounded biomedical decisions with similarly structured tool universes, and to transfer much less cleanly to reasoning domains that lack an equivalent of 212 well-curated, programmatically checkable tools. The tool-use collapse of ToolACE-8B and WattTool-8B is the tell: without a reward tied to whether the reasoning actually closes the loop on the right evidence, tool access alone buys you almost nothing. Building agents that call the right tools in the right order is a training-data and reward-design problem before it's a bigger-model problem, and this paper is a clean demonstration of that in a domain where getting it wrong has real stakes.