Execution attempt

Sign in with GitHub
← Experiment E8 · Does Bielik-PL-11B-v3.0-Instruct still pass through an English-like latent space when it reasons in Polish on Polish mathematics and STEM problems, and does the strength of that pivot predict whether its answer is correct?

Execution attempt · A81 · planned

Computes per-item pivot metrics, anchors, tests A1, A2 and B, sensitivity arms and per-benchmark splits from the lens files and graded outcomes.

Succeeded · Registered by @stw2 via agent. Reported and received times are kept apart; no computation or result is verified.

Pinned source and configuration

https://github.com/stw2/tokenizer-science-tax @ 532f491ba531d07f992b45a1465f48e74a8b058a

Reference checked 2026-09-14 13:12 UTC. Later commits, branches or plan changes do not retarget this attempt.

Command
python scripts/03_analyze.py
Working directory
experiments/E08-latent-pivot
Configuration paths
None
Parameters
band layers 26 to 43; record exclusion below 0.95 teacher-forcing agreement; strict arm at 0.98; stratified paired item bootstrap with 2000 resamples, strata benchmark, seed 20260704; Holm over A1, A2 and B; logistic regression by IRLS
Environment
3.12.13; numpy on CPU; Apple silicon, 128 GB unified memory
Output directory
Not recorded

Inputs

Materials the registrant named when registering this attempt, by content identity; obtainability is derived from their location reports. Nothing is fetched or verified.

Delivered events

  1. Registered

    #1

    Computes per-item pivot metrics, anchors, tests A1, A2 and B, sensitivity arms and per-benchmark splits from the lens files and graded outcomes.

    reported · received · @stw2 via agent · posted to the Thread

  2. Started

    #2

    Started.

    reported · received · @stw2 via agent · attempt only

  3. Succeeded

    #3

    Completed with exit code 0.

    Exit code 0.

    • analysis.json · https://github.com/stw2/tokenizer-science-tax/blob/a9246a60690bf1627e4cc56095f64e3307508bb2/experiments/E08-latent-pivot/results/analysis.json · public · sha256 38d496066b4d… · 47627 bytes · M409
    • per_item_metrics.jsonl · https://github.com/stw2/tokenizer-science-tax/blob/a9246a60690bf1627e4cc56095f64e3307508bb2/experiments/E08-latent-pivot/results/per_item_metrics.jsonl · public · sha256 cca0d74bde92… · 522390 bytes · M410

    reported · received · @stw2 via agent · posted to the Thread

Report an event

The registrant’s capture tool normally delivers start and outcome events. Reporting here is the same author report with the browser as the reported time; it does not observe the process.

This attempt has a delivered outcome. A new execution is a new attempt.