Execution attempt · A18 · planned
Generates answers to all 800 items under Polish and English chain-of-thought with both models, Bielik-PL-11B-v3.0-Instruct first.
Pinned source and configuration
https://github.com/stw2/tokenizer-science-tax @ 02380f96e12e849fae306c5e9bc44f12c7e7a866
Reference checked 2026-09-14 13:10 UTC. Later commits, branches or plan changes do not retarget this attempt.
- Command
- python scripts/02_run.py
- Working directory
- experiments/E03-reasoning-language
- Configuration paths
- None
- Parameters
- max_tokens 1280 for GSM8K-PL and 768 for multiple-choice; greedy; both models
- Environment
- 3.12.13; MLX (Metal) bf16, greedy decoding; Apple silicon, 128 GB unified memory
- Output directory
- Not recorded
Inputs
Materials the registrant named when registering this attempt, by content identity; obtainability is derived from their location reports. Nothing is fetched or verified.
- items_gsm8k_pl.jsonl · evaluation data · M92 items_gsm8k_pl.jsonl · raw output · Download
- items_llmzszl_stem.jsonl · evaluation data · M93 items_llmzszl_stem.jsonl · raw output · Ask the reporter
- items_pes.jsonl · evaluation data · M94 items_pes.jsonl · raw output · Ask the reporter
- exemplars.json · few shot exemplars · M95 exemplars.json · raw output · Ask the reporter
- Bielik-PL-11B-v3.0-Instruct MLX bf16 conversion · model · M65 bielik-pl-11b-v3.0-instruct mlx-bf16 · raw output · Ask the reporter
- Bielik-11B-v3.0-Instruct MLX bf16 conversion · model · M66 bielik-11b-v3.0-instruct mlx-bf16 · raw output · Ask the reporter
- Bielik-PL-11B-v3.0-Instruct, MLX bf16 conversion made by E2 · model · M46 Bielik-PL-11B-v3.0-Instruct · model · Ask the reporter
- Bielik-11B-v3.0-Instruct, MLX bf16 conversion made by E2 · model · M47 Bielik-11B-v3.0-Instruct · model · Ask the reporter
Delivered events
Registered
#1Generates answers to all 800 items under Polish and English chain-of-thought with both models, Bielik-PL-11B-v3.0-Instruct first.
Started
#2Started.
Succeeded
#3Completed with exit code 0.
Exit code 0. Duration 43696 s.
- raw/run_bielik-pl-11b-v3.0-instruct.jsonl before extension · Overwritten in place by scripts/02b_extend_truncated.py; digest never recorded · unavailable
- raw/run_bielik-11b-v3.0-instruct.jsonl before extension · Overwritten in place by scripts/02b_extend_truncated.py; digest never recorded · unavailable
- prompt_dump_bielik-pl-11b-v3.0-instruct.json · https://github.com/stw2/tokenizer-science-tax/blob/0442df47c4492aa995ece02fa9b8dbc5e6df365f/experiments/E03-reasoning-language/results/prompt_dump_bielik-pl-11b-v3.0-instruct.json · public · sha256 0924e965786b… · 1235 bytes · M97
- prompt_dump_bielik-11b-v3.0-instruct.json · https://github.com/stw2/tokenizer-science-tax/blob/0442df47c4492aa995ece02fa9b8dbc5e6df365f/experiments/E03-reasoning-language/results/prompt_dump_bielik-11b-v3.0-instruct.json · public · sha256 bddd806fb853… · 1231 bytes · M98
Report an event
The registrant’s capture tool normally delivers start and outcome events. Reporting here is the same author report with the browser as the reported time; it does not observe the process.
This attempt has a delivered outcome. A new execution is a new attempt.