Execution attempt

Sign in with GitHub
← Experiment E1 · Is APT4's fertility tax against the Mistral-derived tokenizer higher on English scientific text than on the English preamble?

Execution attempt · A3 · planned

Builds the seven corpora and freezes the arXiv API responses.

Succeeded · Registered by @stw2 via agent. Reported and received times are kept apart; no computation or result is verified.

Pinned source and configuration

https://github.com/stw2/tokenizer-science-tax @ 1855bbfabc832bcb964a9b74b90c4c52a7ce50ca

Reference checked 2026-09-14 13:08 UTC. Later commits, branches or plan changes do not retarget this attempt.

Command
python scripts/03_build_corpora.py
Working directory
experiments/E01-fertility-atlas
Configuration paths
None
Parameters
none
Environment
Python 3.12; Apple silicon CPU, no accelerator
Output directory
Not recorded

Inputs

Materials the registrant named when registering this attempt, by content identity; obtainability is derived from their location reports. Nothing is fetched or verified.

Delivered events

  1. Registered

    #1

    Builds the seven corpora and freezes the arXiv API responses.

    reported · received · @stw2 via agent · posted to the Thread

  2. Started

    #2

    Started.

    reported · received · @stw2 via agent · attempt only

  3. Succeeded

    #3

    Completed with exit code 0.

    Exit code 0.

    • en-arxiv-abstracts.jsonl · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/corpora/en-arxiv-abstracts.jsonl · public · sha256 0727333b13f8… · 922357 bytes · M27
    • en-latex-methods.jsonl · Not redistributed: ask the Room owner, or rebuild with scripts/03_build_corpora.py at the pinned revisions · restricted · sha256 c297c2f0e743… · 1027715 bytes · M28
    • en-python-code.jsonl · Not redistributed: ask the Room owner, or rebuild with scripts/03_build_corpora.py at the pinned revisions · restricted · sha256 46fa394fc57b… · 1461039 bytes · M29
    • en-gsm8k.jsonl · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/corpora/en-gsm8k.jsonl · public · sha256 cd35932f6f06… · 2039209 bytes · M30
    • pl-science-pes.jsonl · Not redistributed: ask the Room owner, or rebuild with scripts/03_build_corpora.py at the pinned revisions · restricted · sha256 874761c42bc4… · 937138 bytes · M31
    • pl-wiki-science.jsonl · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/corpora/pl-wiki-science.jsonl · public · sha256 6489e0f15906… · 970979 bytes · M32
    • pl-informal.jsonl · Not redistributed: ask the Room owner, or rebuild with scripts/03_build_corpora.py at the pinned revisions · restricted · sha256 e3cb0d60de14… · 890294 bytes · M33
    • arxiv batch_00001.xml · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/raw/arxiv/batch_00001.xml · public · sha256 7c8e7b5527d4… · 225233 bytes · M34
    • arxiv batch_00101.xml · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/raw/arxiv/batch_00101.xml · public · sha256 abc45c3e73e0… · 210454 bytes · M35
    • arxiv batch_00201.xml · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/raw/arxiv/batch_00201.xml · public · sha256 8515a7f0612a… · 214821 bytes · M36
    • arxiv batch_00301.xml · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/raw/arxiv/batch_00301.xml · public · sha256 bf11d6a4ab64… · 219504 bytes · M37
    • arxiv batch_00401.xml · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/raw/arxiv/batch_00401.xml · public · sha256 3beffd186e85… · 228947 bytes · M38
    • arxiv batch_00501.xml · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/raw/arxiv/batch_00501.xml · public · sha256 34cafb5c8308… · 205939 bytes · M39
    • arxiv batch_00601.xml · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/raw/arxiv/batch_00601.xml · public · sha256 11392f5e4bed… · 207593 bytes · M40
    • arxiv batch_00701.xml · https://github.com/stw2/tokenizer-science-tax/blob/1855bbfabc832bcb964a9b74b90c4c52a7ce50ca/experiments/E01-fertility-atlas/data/raw/arxiv/batch_00701.xml · public · sha256 57ddd92e6a1d… · 216620 bytes · M41
    • corpora_manifest.json · https://github.com/stw2/tokenizer-science-tax/blob/719d51eb4ac7e6e0f36d69cf339c8e976266ee98/experiments/E01-fertility-atlas/results/corpora_manifest.json · public · sha256 4546d0de2479… · 17709 bytes · M42

    reported · received · @stw2 via agent · posted to the Thread

Report an event

The registrant’s capture tool normally delivers start and outcome events. Reporting here is the same author report with the browser as the reported time; it does not observe the process.

This attempt has a delivered outcome. A new execution is a new attempt.