Execution attempt

Sign in with GitHub
← Experiment E9 · At a fixed 32k vocabulary, does reserving a small science slice of the tokenizer's training text remove most of the English-science fertility tax at under 5% cost to Polish fertility?

Execution attempt · A90 · planned

Clears trainer_spec.input and trainer_spec.model_prefix, which held absolute paths, in the five arm copies of spm.model and updates their digests in the tokenizers manifest. Encoding is unchanged: the scrubbed models give the same pieces as the originals and as tokenizer.json on the gate's 10,000 lines.

Succeeded · Registered by @stw2 via agent. Reported and received times are kept apart; no computation or result is verified.

Pinned source and configuration

https://github.com/stw2/tokenizer-science-tax @ 7a2cffbe78cf5f6b8ee85b8ea6dd34fcb366b296

Reference checked 2026-09-14 13:15 UTC. Later commits, branches or plan changes do not retarget this attempt.

Command
python scripts/02_train_tokenizers.py --scrub-existing
Working directory
experiments/E09-vocabulary-allocation
Configuration paths
None
Parameters
fields cleared: trainer_spec.input, trainer_spec.model_prefix; no training
Environment
3.12.13; SentencePiece model protobuf on CPU; Apple silicon, 128 GB unified memory
Output directory
Not recorded

Inputs

Materials the registrant named when registering this attempt, by content identity; obtainability is derived from their location reports. Nothing is fetched or verified.

  • e9-pl/spm.model original · checkpoint · M427 e9-pl/spm.model · raw output · Rebuild via attempt
  • e9-pl-fix/spm.model original · checkpoint · M431 e9-pl-fix/spm.model · raw output · Rebuild via attempt
  • e9-sci/spm.model original · checkpoint · M435 e9-sci/spm.model · raw output · Rebuild via attempt
  • e9-sci-ws/spm.model original · checkpoint · M439 e9-sci-ws/spm.model · raw output · Rebuild via attempt
  • e9-bal/spm.model original · checkpoint · M443 e9-bal/spm.model · raw output · Rebuild via attempt
  • tokenizers_e9_manifest.json original · manifest · M445 tokenizers_e9_manifest.json · raw output · Rebuild via attempt

Delivered events

  1. Registered

    #1

    Clears trainer_spec.input and trainer_spec.model_prefix, which held absolute paths, in the five arm copies of spm.model and updates their digests in the tokenizers manifest. Encoding is unchanged: the scrubbed models give the same pieces as the originals and as tokenizer.json on the gate's 10,000 lines.

    reported · received · @stw2 via agent · posted to the Thread

  2. Started

    #2

    Started.

    reported · received · @stw2 via agent · attempt only

  3. Succeeded

    #3

    Completed with exit code 0.

    Exit code 0.

    • e9-pl/spm.model · https://github.com/stw2/tokenizer-science-tax/blob/c5299916db7f792a209ff2944e66c673c3ebb817/experiments/E09-vocabulary-allocation/data/tokenizers/e9-pl/spm.model · public · sha256 eac085b68090… · 562121 bytes · M450
    • e9-pl-fix/spm.model · https://github.com/stw2/tokenizer-science-tax/blob/c5299916db7f792a209ff2944e66c673c3ebb817/experiments/E09-vocabulary-allocation/data/tokenizers/e9-pl-fix/spm.model · public · sha256 49a2a0d87153… · 562121 bytes · M451
    • e9-sci/spm.model · https://github.com/stw2/tokenizer-science-tax/blob/c5299916db7f792a209ff2944e66c673c3ebb817/experiments/E09-vocabulary-allocation/data/tokenizers/e9-sci/spm.model · public · sha256 2852497cba71… · 543580 bytes · M452
    • e9-sci-ws/spm.model · https://github.com/stw2/tokenizer-science-tax/blob/c5299916db7f792a209ff2944e66c673c3ebb817/experiments/E09-vocabulary-allocation/data/tokenizers/e9-sci-ws/spm.model · public · sha256 d8b7c9581fcb… · 543754 bytes · M453
    • e9-bal/spm.model · https://github.com/stw2/tokenizer-science-tax/blob/c5299916db7f792a209ff2944e66c673c3ebb817/experiments/E09-vocabulary-allocation/data/tokenizers/e9-bal/spm.model · public · sha256 7eacfe79aae0… · 536721 bytes · M454
    • tokenizers_e9_manifest.json · https://github.com/stw2/tokenizer-science-tax/blob/c5299916db7f792a209ff2944e66c673c3ebb817/experiments/E09-vocabulary-allocation/results/tokenizers_e9_manifest.json · public · sha256 94201e3ab81a… · 15486 bytes · M455

    reported · received · @stw2 via agent · posted to the Thread

Report an event

The registrant’s capture tool normally delivers start and outcome events. Reporting here is the same author report with the browser as the reported time; it does not observe the process.

This attempt has a delivered outcome. A new execution is a new attempt.