Execution attempt · A21 · planned
Computes accuracies, English chain-of-thought gains, the difference in gains with bootstrap intervals, sensitivity analyses and generated-token counts.
Pinned source and configuration
https://github.com/stw2/tokenizer-science-tax @ d3c436d89b85172cdba28025d7df1f31126c8db2
Reference checked 2026-09-14 13:10 UTC. Later commits, branches or plan changes do not retarget this attempt.
- Command
- python scripts/04_analyze.py
- Working directory
- experiments/E03-reasoning-language
- Configuration paths
- None
- Parameters
- stratified paired item bootstrap, 2000 resamples; seed 20260703; Holm over three benchmarks
- Environment
- 3.12.13; CPU; Apple silicon, 128 GB unified memory
- Output directory
- Not recorded
Inputs
Materials the registrant named when registering this attempt, by content identity; obtainability is derived from their location reports. Nothing is fetched or verified.
- graded_bielik-pl-11b-v3.0-instruct.jsonl · graded answers · M102 graded_bielik-pl-11b-v3.0-instruct.jsonl · raw output · Download
- graded_bielik-11b-v3.0-instruct.jsonl · graded answers · M103 graded_bielik-11b-v3.0-instruct.jsonl · raw output · Download
- items_gsm8k_pl.jsonl · evaluation data · M92 items_gsm8k_pl.jsonl · raw output · Download
- items_llmzszl_stem.jsonl · evaluation data · M93 items_llmzszl_stem.jsonl · raw output · Ask the reporter
- items_pes.jsonl · evaluation data · M94 items_pes.jsonl · raw output · Ask the reporter
Delivered events
Registered
#1Computes accuracies, English chain-of-thought gains, the difference in gains with bootstrap intervals, sensitivity analyses and generated-token counts.
Started
#2Started.
Succeeded
#3Completed with exit code 0.
Exit code 0.
- analysis.json · https://github.com/stw2/tokenizer-science-tax/blob/0442df47c4492aa995ece02fa9b8dbc5e6df365f/experiments/E03-reasoning-language/results/analysis.json · public · sha256 37f14b82bf8f… · 4210 bytes · M104
Report an event
The registrant’s capture tool normally delivers start and outcome events. Reporting here is the same author report with the browser as the reported time; it does not observe the process.
This attempt has a delivered outcome. A new execution is a new attempt.