Execution attempt

Sign in with GitHub
← Experiment E4 · Where do Claude Haiku, Sonnet, Opus and Fable stand on ZendoBench 1.0.0 dev at high reasoning effort through a tool-free Claude Code harness matched as closely as possible to E3, and how do they experiment and decide to submit?

Execution attempt · A32 · rerun

claude-sonnet-5-5-claude-high-v2: awaiting isolated reauthentication; then fresh six-game smoke and all 460 dev games under one corrected configuration. Prior partial games remain separate and are excluded. Strict Haiku, Sonnet, Opus, Fable order.

Preflight failed · Registered by @stw2 via agent. Reported and received times are kept apart; no computation or result is verified.

Pinned source and configuration

https://github.com/stw2/zendo-lab @ 189f8aa71482c09ccc7ae8eba765a44952bbeb0c

Reference checked 2026-10-08 18:23 UTC. Later commits, branches or plan changes do not retarget this attempt.

Command
bash experiments/E04-claude-baselines/scripts/01_run.sh claude-sonnet-5-5-claude-high-v2
Working directory
.
Configuration paths
experiments/E04-claude-baselines/DESIGN.md
Parameters
{"reasoning_effort": "high", "thinking": "adaptive", "max_tokens": 128000, "sampling": "provider defaults", "manifest": "dev", "games": 460, "batch": 12, "player": "model", "backend": "function", "seed": "manifest episode seeds; model unseeded", "model": "claude-sonnet-5-5", "sdk_identity": "You are a Claude agent, built on Anthropic's Claude Agent SDK.", "response_policy": "first complete API response; no CLI repairs", "thinking_display": "summarized"}
Environment
Claude Code 2.1.293; macOS; Apple M4 Max 128 GB local orchestrator; hosted Anthropic inference, provider hardware unknown; isolated Claude subscription login.
Output directory
Not recorded

Inputs

Materials the registrant named when registering this attempt, by content identity; obtainability is derived from their location reports. Nothing is fetched or verified.

Delivered events

  1. Registered

    #1

    claude-sonnet-5-5-claude-high-v2: awaiting isolated reauthentication; then fresh six-game smoke and all 460 dev games under one corrected configuration. Prior partial games remain separate and are excluded. Strict Haiku, Sonnet, Opus, Fable order.

    reported · received · @stw2 via agent · posted to the Thread

  2. Preflight failed before launch

    #2

    A32 was never launched and made no model calls. Replaced solely to pin the owner-requested parallel scheduling amendment; this is not a model/access failure. The inference and scoring source remain unchanged.

    Error: superseded_schedule_before_launch

    reported · received · @stw2 via agent · posted to the Thread

Report an event

The registrant’s capture tool normally delivers start and outcome events. Reporting here is the same author report with the browser as the reported time; it does not observe the process.

This attempt has a delivered outcome. A new execution is a new attempt.