Execution attempt

Sign in with GitHub
← Experiment E4 · Where do Claude Haiku, Sonnet, Opus and Fable stand on ZendoBench 1.0.0 dev at high reasoning effort through a tool-free Claude Code harness matched as closely as possible to E3, and how do they experiment and decide to submit?

Execution attempt · A17 · planned

claude-haiku-5-5-claude-high: six-game smoke preflight, then all 460 dev games at high effort; same attempt across unfinished-game continuation parts.

Preflight failed · Registered by @stw2 via agent. Reported and received times are kept apart; no computation or result is verified.

Pinned source and configuration

https://github.com/stw2/zendo-lab @ 55723010f403c534da6ef17ff6cf7150234780b4

Reference checked 2026-10-08 09:39 UTC. Later commits, branches or plan changes do not retarget this attempt.

Command
bash experiments/E04-claude-baselines/scripts/01_run.sh claude-haiku-5-5-claude-high
Working directory
.
Configuration paths
experiments/E04-claude-baselines/DESIGN.md
Parameters
{"reasoning_effort": "high", "thinking": "adaptive", "max_tokens": 128000, "sampling": "provider defaults", "manifest": "dev", "games": 460, "batch": 12, "player": "model", "backend": "function", "seed": "manifest episode seeds; model unseeded", "model": "claude-haiku-5-5"}
Environment
Claude Code 2.1.293; macOS; Apple M4 Max 128 GB local orchestrator; hosted Anthropic inference, provider hardware unknown; isolated Claude subscription login.
Output directory
Not recorded

Inputs

Materials the registrant named when registering this attempt, by content identity; obtainability is derived from their location reports. Nothing is fetched or verified.

Delivered events

  1. Registered

    #1

    claude-haiku-5-5-claude-high: six-game smoke preflight, then all 460 dev games at high effort; same attempt across unfinished-game continuation parts.

    reported · received · @stw2 via agent · posted to the Thread

  2. Preflight failed before launch

    #2

    Connection preflight returned HTTP 429, a temporary provider rate limit explicitly not subscription quota. Harness misclassified the notice; fixed before retry. No model answer or benchmark game. Registration metadata correction: actual Python is 3.13.13, not the mistyped 3.13.7.

    Exit code 1. Duration 1 s. Error: rate_limit_classifier

    • live-haiku-auth.jsonl.gz · experiments/E04-claude-baselines/results/runs/preflight/live-haiku-auth.jsonl.gz (private trace held by owner; not public; ask reporter) · restricted · sha256 7cafe388092c… · 3853 bytes · M74

    reported · received · @stw2 via agent · posted to the Thread

Report an event

The registrant’s capture tool normally delivers start and outcome events. Reporting here is the same author report with the browser as the reported time; it does not observe the process.

This attempt has a delivered outcome. A new execution is a new attempt.