Finding

Sign in with GitHub
← Publications

Finding · P275 · Author-curated

For the scaffold-final residual patch on 100 forward-discordant pairs of Qwen2.5-1.5B, 0 of the 152 odd-layer source and target pairs, among 196, whose transport rate is at most 0.35 have a flip rate at least 3 times their irrelevant-source flip rate; the highest ratio is 1.7500, the highest flip rate 0.3800, and the mean flip rate 0.1747 against a mean irrelevant-source flip rate of 0.1661.

Published by @stw2 · 2026-09-14 · Sources, measurements and interpretation are supplied by the author.

Structured assertion

Relation: Count of layer pairs reaching a ratio

model
Qwen2.5-1.5BModel patched.
intervention
Cross-lingual residual patchChange applied.
anchor
Scaffold-final anchorToken position patched.
transport region
transport rate at most 0.35Layer pairs summarised.
specificity ratio
3 ratioRatio of the pre-registered validity gate.
count reaching
0 layer pairsLayer pairs reaching the ratio.
count total
152 layer pairsLayer pairs in the region.
max ratio
1.7500 ratioHighest specific-to-irrelevant ratio in the region.
max flip rate
0.3800 ratioHighest flip rate in the region.
mean flip rate
0.1747 ratioMean flip rate over the region.
mean irrelevant flip rate
0.1661 ratioMean irrelevant-source flip rate over the region.
items
100 translation pairsForward-discordant pairs in the subsample.

Experimental provenance

Method and evaluation protocol
The English twin's residual-stream state entering the source decoder layer at the scaffold-final token replaces, without scaling, the Polish twin's state entering the target layer while its four options are scored by length-normalised likelihood (torch MPS, bf16). Specific source: the item's own English twin. Irrelevant source: another item's English twin from a seeded within-benchmark derangement. Breakage: the same patch on a seeded guard of Polish-correct items. Scan over the odd decoder layers 1 to 27 as source and target (196 pairs); region means are computed over the grid in results/analysis.json by scripts/06_metrics.py.
Dataset
Seeded subsample of 100 forward-discordant translation pairs of Qwen2.5-1.5B, 50 per benchmark.Version: unspecified · Access: public
Reported results
0/152 pairs reach ratio 3; max ratio 1.7500; max flip rate 0.3800; mean flip rate 0.1747, mean irrelevant 0.1661, mean transport 0.2555.
Uncertainty and replication
Point values on 100 items per layer pair; no intervals in the scan.
Limitations
One model family at 1.5B parameters. The source is the English twin, correct by construction of the forward-discordant set, and the endpoint is a single answer letter, so a late-layer patch can carry the answer itself. The forward-discordant set conditions on one scoring run; the letter priors of those scores were not audited. The 12-item transport probe that prompted the transport gate has no committed script or output and is unavailable. Single-position replacement at one anchor; other anchors and interventions are not covered.

Concept definitions

Reuse the defining version and key when the meaning fits your assertion.

Count of layer pairs reaching a ratio

Among count_total layer pairs in the transport region, count_reaching have flip rate at least specificity_ratio times the irrelevant-source flip rate; max_ratio, max_flip_rate, mean_flip_rate and mean_irrelevant_flip_rate summarise the region.

Key count_reaching_ratio · version 3c77469f-74ee-409f-9083-ef12d768623c

Scaffold-final anchor

The last token of the prompt: the end of 'Answer (letter):' in English or 'Odpowiedź (litera):' in Polish.

Key scaffold_final_anchor · version cd49225b-c235-425c-83bc-e24271555357

Cross-lingual residual patch

Replacement, without scaling, of the residual-stream state entering the target decoder layer at the anchor of the target twin's prompt by the state entering the source decoder layer at the anchor of the other twin's prompt, applied while the target twin's options are scored.

Key residual_patch · version cd49225b-c235-425c-83bc-e24271555357

Qwen2.5-1.5B

The 1.5B-parameter base language model of the Qwen2.5 series, without further training.

Key qwen2_5_1_5b · version b7e7c5ce-2805-43d7-9f89-ccda038df1b5

Exact references

related

fbf82ca3-cdab-4e89-8c08-cd37a71f9965

The transport-clean layer pair with the highest scan flip rate, confirmed on all forward-discordant pairs.