Execution attempt · A9 · planned
Classifies the digit policy of nine tokenizers, measures tokens per number per rendering and tabulates separator, sign and unit segmentation.
Pinned source and configuration
https://github.com/stw2/tokenizer-science-tax @ c43f19850803969bc1fefe537caf14e54cfd9a9f
Reference checked 2026-09-14 13:08 UTC. Later commits, branches or plan changes do not retarget this attempt.
- Command
- python scripts/04_audit.py
- Working directory
- experiments/E02-digit-policy
- Configuration paths
- None
- Parameters
- counting: prefix 'a ', no special tokens, tokens whose character spans overlap the number; classification over 3,000 integers of 2 to 4 digits and 2,000 of 5 to 10 digits per tokenizer; tokenizers read from E1's frozen copies
- Environment
- CPython 3.12.13 (uv 0.11.16); CPU; Apple silicon, 128 GB unified memory
- Output directory
- Not recorded
Inputs
Materials the registrant named when registering this attempt, by content identity; obtainability is derived from their location reports. Nothing is fetched or verified.
- s1_integers.jsonl · evaluation data · M52 s1_integers.jsonl · raw output · Download
- s2_biginta.jsonl · evaluation data · M53 s2_biginta.jsonl · raw output · Download
- s3_diagnostics.jsonl · evaluation data · M54 s3_diagnostics.jsonl · raw output · Download
- s5_renderings.jsonl · evaluation data · M56 s5_renderings.jsonl · raw output · Download
- s6_units.jsonl · evaluation data · M57 s6_units.jsonl · raw output · Download
- s7_signs.jsonl · evaluation data · M58 s7_signs.jsonl · raw output · Download
- s8_carriers.jsonl · evaluation data · M59 s8_carriers.jsonl · raw output · Download
- tokenizer apertus · tokenizer · M10 Apertus tokenizer · tokenizer · Download
- tokenizer apt3 · tokenizer · M4 APT3 tokenizer · tokenizer · Download
- tokenizer apt4 · tokenizer · M3 APT4 tokenizer (Bielik-PL-11B-v3.0-Instruct) · tokenizer · Ask the reporter
- tokenizer bielik-v3-original · tokenizer · M2 Mistral-derived tokenizer (Bielik-11B-v3.0-Instruct) · tokenizer · Ask the reporter
- tokenizer eurollm · tokenizer · M8 EuroLLM tokenizer · tokenizer · Download
- tokenizer gemma3 · tokenizer · M7 Gemma 3 tokenizer · tokenizer · Ask the reporter
- tokenizer llama-3.2-smollm3 · tokenizer · M6 SmolLM3 tokenizer · tokenizer · Download
- tokenizer mistral-small-3.1 · tokenizer · M9 Mistral Small 3.1 tokenizer · tokenizer · Download
- tokenizer qwen3 · tokenizer · M5 Qwen3 tokenizer · tokenizer · Download
Delivered events
Registered
#1Classifies the digit policy of nine tokenizers, measures tokens per number per rendering and tabulates separator, sign and unit segmentation.
Started
#2Started.
Succeeded
#3Completed with exit code 0.
Exit code 0.
- audit.json · https://github.com/stw2/tokenizer-science-tax/blob/2fc1a1b415a06b7648cdb37319ad573ccdc96a81/experiments/E02-digit-policy/results/audit.json · public · sha256 948eb85a0108… · 32413 bytes · M62
Report an event
The registrant’s capture tool normally delivers start and outcome events. Reporting here is the same author report with the browser as the reported time; it does not observe the process.
This attempt has a delivered outcome. A new execution is a new attempt.