Reproduce from public artifacts

Protocol

The GitHub tree and the Zenodo archive carry the same layout: experiment code, edit vectors, per-cell operating curves, and the R figure pipeline. Model checkpoints and the CounterFact / zsRE fact files are third-party and are not redistributed. Llama-2-13B is an addendum and is excluded from the n=22 freeze.

Where the artifacts live

Archive layout:

code/        experiment + analysis source (MIT)
results/     merge arrays and operating tables (CC BY 4.0)
figures/     R rebuild of the public plots

Frozen protocol documents ship in the same archive under CC BY 4.0. The concept DOI is unchanged (v1.0.0, 2026-07-17).

Environment used for the shipped numbers

Python 3.13.7, numpy 2.2.6, scipy 1.16.2, torch 2.12.1 (CUDA 13.0), transformers 5.12.1. Plots additionally need R with jsonlite, ggplot2, and tikzDevice.

Two-phase measurement

Each ROME cell is produced by the two-phase merge measurement in the public source:

An editor-general analogue covers MEMIT and AlphaEdit; ROME is the fp64 equivalence anchor. Drivers expect a local model directory and local fact files. All analysis scripts below are CPU-only and read the shipped result arrays with no GPU.

Rebuild tables from the shipped arrays

From the archive root, make the result arrays visible to the analysis tree, then rebuild the operating map, signed reanalysis, cross-term alignment, matched-dose span, gain screen, gain holdout, and admission-benefit tables. Re-score one shipped merge bundle by pointing the two-phase measurement at that cell’s array directory. Public plots rebuild from the R figure pipeline.

ln -s ../results code/results
cd code
python3 experiments/rg_map_evidence_consolidate.py
python3 experiments/rg_signed_reanalysis.py
python3 experiments/rg_crossterm_alignment.py
python3 experiments/rg_matched_dose_spread.py
python3 experiments/rg_gain_law.py
python3 experiments/rg_gain_holdout.py
python3 experiments/rg_admission_benefit.py
cd ../figures
Rscript make_figures.R
make

Canonical numerical tables

Phi-3.5 rows use a corrected tokenizer mapping (2026-07-30). Superseded rows are kept for audit alongside the freeze.

Scope of the claims

Stated once here, so the tables above can be read at face value. Gain works as a rank-level screen: it orders the two regimes, and geometry carries the within-regime size of the cross-term. The geometry-valid group size is a per-cell window — g ≤ 5 at the reference cell, wider at six further qualifying cells — and the per-cell windows ship in the archive. The +0.647 admission benefit is retrospective under fixed composition; the prospective group-formation run supports the primary geometry comparisons in all three seeds, and its utility-matched gate reads Mixed.