Execution attempt

Sign in with GitHub
← Experiment E4 · Where do Claude Haiku, Sonnet, Opus and Fable stand on ZendoBench 1.0.0 dev at high reasoning effort through a tool-free Claude Code harness matched as closely as possible to E3, and how do they experiment and decide to submit?

Execution attempt · A31 · rerun

claude-haiku-5-5-claude-high-v2: awaiting isolated reauthentication; then fresh six-game smoke and all 460 dev games under one corrected configuration. Prior partial games remain separate and are excluded. Strict Haiku, Sonnet, Opus, Fable order.

Succeeded · Registered by @stw2 via agent. Reported and received times are kept apart; no computation or result is verified.

Pinned source and configuration

https://github.com/stw2/zendo-lab @ 189f8aa71482c09ccc7ae8eba765a44952bbeb0c

Reference checked 2026-10-08 18:23 UTC. Later commits, branches or plan changes do not retarget this attempt.

Command
bash experiments/E04-claude-baselines/scripts/01_run.sh claude-haiku-5-5-claude-high-v2
Working directory
.
Configuration paths
experiments/E04-claude-baselines/DESIGN.md
Parameters
{"reasoning_effort": "high", "thinking": "adaptive", "max_tokens": 128000, "sampling": "provider defaults", "manifest": "dev", "games": 460, "batch": 12, "player": "model", "backend": "function", "seed": "manifest episode seeds; model unseeded", "model": "claude-haiku-5-5", "sdk_identity": "You are a Claude agent, built on Anthropic's Claude Agent SDK.", "response_policy": "first complete API response; no CLI repairs", "thinking_display": "summarized"}
Environment
Claude Code 2.1.293; macOS; Apple M4 Max 128 GB local orchestrator; hosted Anthropic inference, provider hardware unknown; isolated Claude subscription login.
Output directory
Not recorded

Inputs

Materials the registrant named when registering this attempt, by content identity; obtainability is derived from their location reports. Nothing is fetched or verified.

Latest reported metrics

Values the registrant’s tool attached to its latest progress or outcome event. Substrate stores them; it verifies no measurement.

claude-haiku-5-5-claude-high-v2.eig
0.3959779247566998
claude-haiku-5-5-claude-high-v2.zero
0.5126060320452404
claude-haiku-5-5-claude-high-v2.calls
12926
claude-haiku-5-5-claude-high-v2.T1.wins
26
claude-haiku-5-5-claude-high-v2.T2.wins
43
claude-haiku-5-5-claude-high-v2.T3.wins
94
claude-haiku-5-5-claude-high-v2.T4.wins
3
claude-haiku-5-5-claude-high-v2.T5.wins
36
claude-haiku-5-5-claude-high-v2.T6.wins
12
claude-haiku-5-5-claude-high-v2.p_first
0.7383030053645583
claude-haiku-5-5-claude-high-v2.repeats
8
claude-haiku-5-5-claude-high-v2.headline
0.39066666666666666
claude-haiku-5-5-claude-high-v2.T1.scored
30
claude-haiku-5-5-claude-high-v2.T2.scored
60
claude-haiku-5-5-claude-high-v2.T3.scored
150
claude-haiku-5-5-claude-high-v2.T4.scored
60
claude-haiku-5-5-claude-high-v2.T5.scored
100
claude-haiku-5-5-claude-high-v2.T6.scored
60
claude-haiku-5-5-claude-high-v2.alive_first
1
claude-haiku-5-5-claude-high-v2.nodes_ratio
1.214739098704616
claude-haiku-5-5-claude-high-v2.bits_per_exp
0.37896400822952137
claude-haiku-5-5-claude-high-v2.exp_per_game
18.452173913043477
claude-haiku-5-5-claude-high-v2.certain_wrong
77
claude-haiku-5-5-claude-high-v2.subs_per_game
0.9456521739130435

and 10 more in the attempt JSON.

Delivered events

  1. Registered

    #1

    claude-haiku-5-5-claude-high-v2: awaiting isolated reauthentication; then fresh six-game smoke and all 460 dev games under one corrected configuration. Prior partial games remain separate and are excluded. Strict Haiku, Sonnet, Opus, Fable order.

    reported · received · @stw2 via agent · posted to the Thread

  2. Started

    #2

    Starting separate six-game smoke, then full measurement after verification. Arm claude-haiku-5-5-claude-high-v2, model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; dev manifest, 460 full-run games, 12 concurrent calls; manifest episode seeds, model unseeded; Apple M4 Max 128 GB local orchestration, hosted inference hardware unknown. Fixed SDK identity exception documented; tools disabled; full private transcripts retained.

    reported · received · @stw2 via agent · attempt only

  3. Progress report

    #3

    Outer scheduling controller transferred without stopping or restarting the live Haiku worker. Its original attempt and configuration continue; no games rerun. Arm claude-haiku-5-5-claude-high-v2, model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; dev manifest, 460 full-run games, 12 concurrent calls per arm; manifest episode seeds, model unseeded; Apple M4 Max 128 GB local orchestration, hosted inference hardware unknown. Owner-authorized Haiku/Sonnet/Opus overlap, followed by Fable; fixed SDK identity, disabled tools and full private transcript capture unchanged.

    reported · received · @stw2 via agent · attempt only

  4. Progress report

    #4

    This arm stopped and requires diagnosis. Other already-running arms may finish; no new arm or part starts until reviewed. No model loss inferred. Arm claude-haiku-5-5-claude-high-v2, model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; dev manifest, 460 full-run games, 12 concurrent calls per arm; manifest episode seeds, model unseeded; Apple M4 Max 128 GB local orchestration, hosted inference hardware unknown. Owner-authorized Haiku/Sonnet/Opus overlap, followed by Fable; fixed SDK identity, disabled tools and full private transcript capture unchanged.

    Exit code 5.

    reported · received · @stw2 via agent · attempt only

  5. Progress report

    #5

    Reviewed incomplete provider streams followed by guard-blocked native CLI retries: exactly one original request was forwarded per rejected call, no completion marker was received, and no second inference request reached the provider. Sandbox denial audits flag no unexpected access. Additional Sonnet shutdown-finalization flags concern aborted in-flight streams; all retained call traces have end records, completed-game transcript joins pass, and unfinished games are excluded from scoring. No guard, retry classifier, prompt, model or measurement source is changed for continuation. Continuing only unfinished games in a fresh immutable part under the same attempt and byte-identical measurement configuration. Completed games and verified smoke evidence are retained, not resampled. Arm claude-haiku-5-5-claude-high-v2, model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; dev manifest, 460 full-run games, 12 concurrent calls per arm; manifest episode seeds, model unseeded; Apple M4 Max 128 GB local orchestration, hosted inference hardware unknown. Owner-authorized Haiku/Sonnet/Opus overlap, followed by Fable; fixed SDK identity, disabled tools and full private transcript capture unchanged.

    reported · received · @stw2 via agent · attempt only

  6. Progress report

    #6

    This arm stopped and requires diagnosis. Other already-running arms may finish; no new arm or part starts until reviewed. No model loss inferred. Arm claude-haiku-5-5-claude-high-v2, model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; dev manifest, 460 full-run games, 12 concurrent calls per arm; manifest episode seeds, model unseeded; Apple M4 Max 128 GB local orchestration, hosted inference hardware unknown. Owner-authorized Haiku/Sonnet/Opus overlap, followed by Fable; fixed SDK identity, disabled tools and full private transcript capture unchanged.

    Exit code 4.

    reported · received · @stw2 via agent · attempt only

  7. Progress report

    #7

    A31 is stopped pending owner reauthentication after repeated provider HTTP 401 responses reporting a revoked OAuth access token. The pinned CLI native refresh failed without forwarding inference. The accumulated 255 completed dev games passed score --verify and transcript audit; 205 remain. No completed game will be rerun. Arm claude-haiku-5-5-claude-high-v2; model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; 460-game dev manifest, manifest episode seeds, model unseeded; Apple M4 Max 128 GB orchestration, hosted inference hardware unknown. A35 Sonnet and A36 Opus have completed all games and verified; A37 Fable remains queued.

    Exit code 4. Error: isolated_oauth_reauthentication_required

    remaining_games=205 · finished_verified_games=255 · transcript_missing_joins=0 · transcript_interrupted_records=0

    reported · received · @stw2 via agent · attempt only

  8. Progress report

    #8

    Owner renewed the isolated subscription login after its token expired. The 255 completed games passed score --verify and transcript audit across five preserved parts; 205 remain. Resuming the same A31 configuration, with no new smoke test and no replay of finished games. Continuing only unfinished games in a fresh immutable part under the same attempt and byte-identical measurement configuration. Completed games and verified smoke evidence are retained, not resampled. Arm claude-haiku-5-5-claude-high-v2, model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; dev manifest, 460 full-run games, 12 concurrent calls per arm; manifest episode seeds, model unseeded; Apple M4 Max 128 GB local orchestration, hosted inference hardware unknown. Owner-authorized Haiku/Fable overlap; Sonnet and Opus already verified. Fixed SDK identity, disabled tools and full private transcript capture unchanged.

    reported · received · @stw2 via agent · attempt only

  9. Progress report

    #9

    This arm stopped and requires diagnosis. Other already-running arms may finish; no new arm or part starts until reviewed. No model loss inferred. Arm claude-haiku-5-5-claude-high-v2, model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; dev manifest, 460 full-run games, 12 concurrent calls per arm; manifest episode seeds, model unseeded; Apple M4 Max 128 GB local orchestration, hosted inference hardware unknown. Single-arm execution with 12 concurrent calls. Fixed SDK identity, disabled tools and full private transcript capture unchanged.

    Exit code 5.

    reported · received · @stw2 via agent · attempt only

  10. Progress report

    #10

    This arm stopped and requires diagnosis. Other already-running arms may finish; no new arm or part starts until reviewed. No model loss inferred. Arm claude-haiku-5-5-claude-high-v2, model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; dev manifest, 460 full-run games, 12 concurrent calls per arm; manifest episode seeds, model unseeded; Apple M4 Max 128 GB local orchestration, hosted inference hardware unknown. Single-arm execution with 12 concurrent calls. Fixed SDK identity, disabled tools and full private transcript capture unchanged.

    Exit code 1.

    reported · received · @stw2 via agent · attempt only

  11. Succeeded

    #11

    A31: Full baseline completed, score --verify and transcript audit passed; paired E3 comparisons completed. Arm claude-haiku-5-5-claude-high-v2, model claude-haiku-5-5, high effort, adaptive summarized thinking, provider-default sampling, max_tokens 128000, Claude Code 2.1.293 function backend; dev manifest, 460 full-run games, 12 concurrent calls per arm; manifest episode seeds, model unseeded; Apple M4 Max 128 GB local orchestration, hosted inference hardware unknown. Single-arm execution with 12 concurrent calls. Fixed SDK identity, disabled tools and full private transcript capture unchanged. Complete artifact index retains all 78 file references and digests; individual evidence files are also referenced below.

    Exit code 0.

    claude-haiku-5-5-claude-high-v2.eig=0.3959779247566998 · claude-haiku-5-5-claude-high-v2.zero=0.5126060320452404 · claude-haiku-5-5-claude-high-v2.calls=12926 · claude-haiku-5-5-claude-high-v2.T1.wins=26 · claude-haiku-5-5-claude-high-v2.T2.wins=43 · claude-haiku-5-5-claude-high-v2.T3.wins=94 · claude-haiku-5-5-claude-high-v2.T4.wins=3 · claude-haiku-5-5-claude-high-v2.T5.wins=36 · …

    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-5.6-terra-codex-high.json · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-5.6-terra-codex-high.json; not public; ask reporter. · restricted · sha256 cbd9d258e16b… · 52377 bytes · M179
    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-5.6-terra-codex-high.md · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-5.6-terra-codex-high.md; not public; ask reporter. · restricted · sha256 1aab16a40e24… · 5717 bytes · M180
    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-astra-codex-high.json · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-astra-codex-high.json; not public; ask reporter. · restricted · sha256 06f72687ca55… · 52460 bytes · M181
    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-astra-codex-high.md · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-astra-codex-high.md; not public; ask reporter. · restricted · sha256 c734d2aef85a… · 5733 bytes · M182
    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-luna-codex-high.json · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-luna-codex-high.json; not public; ask reporter. · restricted · sha256 36f864c98f7c… · 56366 bytes · M183
    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-luna-codex-high.md · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-luna-codex-high.md; not public; ask reporter. · restricted · sha256 29b93cc13e4a… · 5702 bytes · M184
    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-sol-codex-high.json · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-sol-codex-high.json; not public; ask reporter. · restricted · sha256 16ef66625bd3… · 52454 bytes · M185
    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-sol-codex-high.md · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6-sol-codex-high.md; not public; ask reporter. · restricted · sha256 97f5b6840e73… · 5722 bytes · M186
    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6.1-sol-codex-high.json · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6.1-sol-codex-high.json; not public; ask reporter. · restricted · sha256 c7ae757fc415… · 52475 bytes · M187
    • comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6.1-sol-codex-high.md · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/comparisons/claude-haiku-5-5-claude-high-v2__vs__gpt-6.1-sol-codex-high.md; not public; ask reporter. · restricted · sha256 8f5b0ab0ab66… · 5733 bytes · M188
    • runs/claude-haiku-5-5-claude-high-v2.jsonl · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.jsonl; not public; ask reporter. · restricted · sha256 fdf0b3322357… · 19660076 bytes · M189
    • runs/claude-haiku-5-5-claude-high-v2.part2.jsonl · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.part2.jsonl; not public; ask reporter. · restricted · sha256 f10433180545… · 113433136 bytes · M190
    • runs/claude-haiku-5-5-claude-high-v2.part3.jsonl · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.part3.jsonl; not public; ask reporter. · restricted · sha256 2c43afea9197… · 98684 bytes · M191
    • runs/claude-haiku-5-5-claude-high-v2.part4.jsonl · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.part4.jsonl; not public; ask reporter. · restricted · sha256 d21c755858f2… · 100835 bytes · M192
    • runs/claude-haiku-5-5-claude-high-v2.part5.jsonl · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.part5.jsonl; not public; ask reporter. · restricted · sha256 f8c5ce598bd5… · 102981 bytes · M193
    • runs/claude-haiku-5-5-claude-high-v2.part6.jsonl · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.part6.jsonl; not public; ask reporter. · restricted · sha256 32c4fbb3521d… · 34460929 bytes · M194
    • runs/claude-haiku-5-5-claude-high-v2.part7.jsonl · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.part7.jsonl; not public; ask reporter. · restricted · sha256 b995bcf5fa28… · 27361653 bytes · M195
    • runs/claude-haiku-5-5-claude-high-v2.part8.jsonl · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.part8.jsonl; not public; ask reporter. · restricted · sha256 c1294b58044e… · 21802156 bytes · M196
    • runs/claude-haiku-5-5-claude-high-v2.part9.jsonl · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.part9.jsonl; not public; ask reporter. · restricted · sha256 aec6ff87d8cd… · 37421261 bytes · M197
    • runs/traces/claude-haiku-5-5-claude-high-v2.part2.traces.jsonl.gz · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/traces/claude-haiku-5-5-claude-high-v2.part2.traces.jsonl.gz; not public; ask reporter. · restricted · sha256 8a595f7ea393… · 719501927 bytes · M198
    • runs/traces/claude-haiku-5-5-claude-high-v2.part3.traces.jsonl.gz · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/traces/claude-haiku-5-5-claude-high-v2.part3.traces.jsonl.gz; not public; ask reporter. · restricted · sha256 8ddad516e78e… · 148726 bytes · M199
    • runs/traces/claude-haiku-5-5-claude-high-v2.part4.traces.jsonl.gz · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/traces/claude-haiku-5-5-claude-high-v2.part4.traces.jsonl.gz; not public; ask reporter. · restricted · sha256 d6de8dfeb8a2… · 150267 bytes · M200
    • runs/traces/claude-haiku-5-5-claude-high-v2.part5.traces.jsonl.gz · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/traces/claude-haiku-5-5-claude-high-v2.part5.traces.jsonl.gz; not public; ask reporter. · restricted · sha256 1b5d09362122… · 157484 bytes · M201
    • runs/traces/claude-haiku-5-5-claude-high-v2.part6.traces.jsonl.gz · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/traces/claude-haiku-5-5-claude-high-v2.part6.traces.jsonl.gz; not public; ask reporter. · restricted · sha256 33c14a5a5e70… · 271727116 bytes · M202
    • runs/traces/claude-haiku-5-5-claude-high-v2.part7.traces.jsonl.gz · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/traces/claude-haiku-5-5-claude-high-v2.part7.traces.jsonl.gz; not public; ask reporter. · restricted · sha256 8dd8c78380e1… · 174899964 bytes · M203
    • runs/traces/claude-haiku-5-5-claude-high-v2.part8.traces.jsonl.gz · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/traces/claude-haiku-5-5-claude-high-v2.part8.traces.jsonl.gz; not public; ask reporter. · restricted · sha256 b637a623a77b… · 162080837 bytes · M204
    • runs/traces/claude-haiku-5-5-claude-high-v2.part9.traces.jsonl.gz · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/traces/claude-haiku-5-5-claude-high-v2.part9.traces.jsonl.gz; not public; ask reporter. · restricted · sha256 042dacfdd310… · 263671388 bytes · M205
    • runs/traces/claude-haiku-5-5-claude-high-v2.traces.jsonl.gz · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/traces/claude-haiku-5-5-claude-high-v2.traces.jsonl.gz; not public; ask reporter. · restricted · sha256 a415fe076fc9… · 124655550 bytes · M206
    • scores/claude-haiku-5-5-claude-high-v2.diagnose.md · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/scores/claude-haiku-5-5-claude-high-v2.diagnose.md; not public; ask reporter. · restricted · sha256 5eafdb19c769… · 1607 bytes · M207
    • scores/claude-haiku-5-5-claude-high-v2.files.json · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/scores/claude-haiku-5-5-claude-high-v2.files.json; not public; ask reporter. · restricted · sha256 98d9e2d8ee26… · 1467 bytes · M208
    • scores/claude-haiku-5-5-claude-high-v2.score.json · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/scores/claude-haiku-5-5-claude-high-v2.score.json; not public; ask reporter. · restricted · sha256 49d653aa76cb… · 50167 bytes · M209
    • scores/claude-haiku-5-5-claude-high-v2.score.md · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/scores/claude-haiku-5-5-claude-high-v2.score.md; not public; ask reporter. · restricted · sha256 ad8427f730fa… · 3720 bytes · M210
    • scores/claude-haiku-5-5-claude-high-v2.traces.json · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/scores/claude-haiku-5-5-claude-high-v2.traces.json; not public; ask reporter. · restricted · sha256 3dc8459ca29d… · 1890 bytes · M211
    • runs/claude-haiku-5-5-claude-high-v2.outputs.json · Private artifact held by owner; repository-relative path: experiments/E04-claude-baselines/results/runs/claude-haiku-5-5-claude-high-v2.outputs.json; not public; ask reporter. · restricted · sha256 349d67a3d704… · 33081 bytes · M212

    reported · received · @stw2 via agent · posted to the Thread

Report an event

The registrant’s capture tool normally delivers start and outcome events. Reporting here is the same author report with the browser as the reported time; it does not observe the process.

This attempt has a delivered outcome. A new execution is a new attempt.