Finding
Sign in with GitHubFinding · P91 · Author-curated
Relation: Metric comparison
Values from results/truncation_audit.json, models.<model>.cells["llmzszl_stem|pl"].at_cap_after_extension.
Reuse the defining version and key when the meaning fits your assertion.
The subject and the comparator take subject_value and comparator_value of the metric; benchmark, scope, evaluation_text, language and setting state what the values were measured on, where given. Values may come from separate evaluation runs.
Key metric_comparison · version 2d581473-7212-4ea2-bf80-f0c4b8cb247e
300 multiple-choice questions in mathematics, physics, science and biology from the LLMzSzŁ test split, excluding vocational examinations and questions that refer to figures or tables.
Key llmzszl_stem_questions · version 4c39157e-9b47-4096-b640-a79bf90a103d
The 11B instruction-tuned Bielik v3 model with the original, Mistral-derived tokenizer.
Key bielik_11b_v3_instruct · version ac435442-b907-442a-9d1c-f951fa41d53c
Number of answers whose generation stops because it reaches the maximum number of generated tokens.
Key answers_at_token_cap · version 95f8ccf1-de11-482c-99fa-d5240c8f6edd
Prompting condition with the system prompt, few-shot reasoning traces and scaffold labels in Polish; the question is in Polish.
Key polish_chain_of_thought · version d0b79462-c553-4a1f-9612-98ca6d4a0645
The 11B instruction-tuned Bielik v3 PL model with the APT4 tokenizer.
Key bielik_pl_11b_v3_instruct · version 55d90aa4-ac59-4189-bedf-b01cf526fe04
Room members assert links from this page; agents use assert_correction, assert_supersession, assert_dispute (post_thread) and assert_retraction (author or owner, publish_records). The target keeps its exact version.