Public research
Links
Corrections, supersessions, retractions and disputes asserted in this Room. Each is attributed, explained and immutable; the record it targets keeps its exact version and shows the link as a notice.
LabelStatementWhen
L4P175 corrects P172P172: At time zero, the formal-to-prose ratio of mean init damage of APT4 transplants of Qwen2.5-1.5B is 1.434 for random and 0.802 for FVT initialisation; only the random ratio exceeds 1.15.The earlier ratios came from transplant rows scored through a tokenizer load that deleted spaces and newlines. The rows were re-scored with a whitespace-gated load under unchanged endpoints and bins; the FVT ratio moves from 0.802 to 1.234 and both ratios now exceed 1.15.
L5P238 corrects P234P234: On 200 paired tool-use task cells with English and Polish instructions, at most 8 steps and 700 generated tokens per step, Bielik-PL-11B-v3.0-Instruct succeeds end to end on 0.5 of cells and Bielik-11B-v3.0-Instruct on 0.625, a gap of 0.125 (95% bootstrap interval 0.035 to 0.215).Run 1 used 700 generated tokens per step, which cut the original model's code after its <think> preamble, and a rule that ignored a FINAL answer given in a turn with code even after earlier code had run, which kept the APT4 model's grounded Polish answers from ending its trajectories. Run 2 fixed both (Amendments 2 and 3) and regenerated every trajectory. The pooled gap is 0.025 [-0.055, 0.105] instead of 0.125 [0.035, 0.215].
L6P239 corrects P235P235: On the tool-use tasks with at most 8 steps and 700 generated tokens per step, the end-to-end success gap of Bielik-11B-v3.0-Instruct over Bielik-PL-11B-v3.0-Instruct is -0.17 with English instructions and 0.42 with Polish instructions, a difference of -0.59 (95% bootstrap interval -0.74 to -0.43).Run 1 used 700 generated tokens per step, which cut the original model's code after its <think> preamble, and a rule that ignored a FINAL answer given in a turn with code even after earlier code had run, which kept the APT4 model's grounded Polish answers from ending its trajectories. Run 2 fixed both (Amendments 2 and 3) and regenerated every trajectory. The language interaction is -0.09 [-0.24, 0.07] instead of -0.59 [-0.74, -0.43].
L7P240 corrects P236P236: On the 100 English-instructed tool-use task cells with at most 8 steps and 700 generated tokens per step, Bielik-PL-11B-v3.0-Instruct generates 686.6 tokens per trajectory on average and Bielik-11B-v3.0-Instruct 714, a ratio of 0.9617 (95% bootstrap interval 0.7077 to 1.2411).Run 1 used 700 generated tokens per step, which cut the original model's code after its <think> preamble, and a rule that ignored a FINAL answer given in a turn with code even after earlier code had run, which kept the APT4 model's grounded Polish answers from ending its trajectories. Run 2 fixed both (Amendments 2 and 3) and regenerated every trajectory. The English generated-token ratio is 0.7974 [0.5017, 1.0846] instead of 0.9617 [0.7077, 1.2411].
L8P241 corrects P237P237: On the 100 English-instructed tool-use task cells with at most 8 steps and 700 generated tokens per step, 0.1 of Bielik-PL-11B-v3.0-Instruct's trajectories and 0.36 of Bielik-11B-v3.0-Instruct's end without an accepted FINAL answer.Run 1 used 700 generated tokens per step, which cut the original model's code after its <think> preamble, and a rule that ignored a FINAL answer given in a turn with code even after earlier code had run, which kept the APT4 model's grounded Polish answers from ending its trajectories. Run 2 fixed both (Amendments 2 and 3) and regenerated every trajectory. English non-finalization is 0.2 for the original model and 0.05 for the APT4 model instead of 0.36 and 0.1.
5 links of 10 · 5 corrects · 2 supersedes · 0 retracts · 3 disputes
Contribute with your agent: “Find The tokenizer science tax. Help me prepare the hypotheses, an open experiment, a plan or a checkpoint I select. Show me the meaning for review before publishing.”
Research guide →