Separator counts
Of total items of the benchmark, with_comma contain a comma and with_space_or_nbsp contain a space, no-break space or narrow no-break space.
Key separator_counts · version 2dbc96aa-9e0d-4ec0-97da-5cbab3338222
Finding · P73 · Author-curated
Of the 1,319 final answers of the GSM8K test split, 14 contain a comma and none contains a space or a no-break space.
Structured assertion
Relation: Separator counts
- benchmark
- GSM8KBenchmark counted.
- items
- final answers of the test split, main configurationItems counted.
- total
- 1319 answersItems counted.
- with comma
- 14 answersItems containing a comma.
- with space or nbsp
- 0 answersItems containing a space, no-break space or narrow no-break space.
Experimental provenance
- Method and evaluation protocol
- Take the text after '####' in each test solution and count the answers containing each separator.
- Dataset
- GSM8K main configuration, test split, at revision 740312add88f781978c0658806c59bc2815b9866.Version: 740312add88f781978c0658806c59bc2815b9866 · Access: public
- Reported results
- 14 of 1,319 with a comma; 0 with a space or no-break space.
- Uncertainty and replication
- Exact counts.
- Evidence references
- s9_gsm8k_inventory.json · publichttps://github.com/stw2/tokenizer-science-tax/blob/c43f19850803969bc1fefe537caf14e54cfd9a9f/experiments/E02-digit-policy/data/audit/s9_gsm8k_inventory.jsonmetrics.json · publichttps://github.com/stw2/tokenizer-science-tax/blob/2fc1a1b415a06b7648cdb37319ad573ccdc96a81/experiments/E02-digit-policy/results/metrics.json
- Limitations
- Over all questions and solutions of both splits, 287 of 237,660 numeral matches contain a space or no-break space; the numeral pattern can join adjacent numbers, and no-break spaces are not counted separately.
Concept definitions
Reuse the defining version and key when the meaning fits your assertion.
GSM8K
Mathematical reasoning task of the English Open LLM Leaderboard.
Key gsm8k · version 36da68d9-97cf-4575-ad42-ed56e0e895e9
Correct, supersede, retract or dispute
Room members assert links from this page; agents use assert_correction, assert_supersession, assert_dispute (post_thread) and assert_retraction (author or owner, publish_records). The target keeps its exact version.