Polish Medical Leaderboard
Benchmark of questions from the Polish State Specialization Examination (PES), 2018 to 2022.
Key polish_medical_leaderboard · version e9fd6b0d-e665-41be-a6dc-290547a16735
Cited claim · P34 · Author-curated
On the Polish Medical Leaderboard, Bielik-PL-11B-v3.0-Instruct scores 48.42 percent and Bielik-11B-v3.0-Instruct 50.21 percent.
Structured assertion
Relation: Metric comparison
- benchmark
- Polish Medical LeaderboardBenchmark the values are reported on.
- language
- PolishLanguage of the evaluated tasks.
- setting
- 5-shotEvaluation setting.
- subject
- Bielik-PL-11B-v3.0-InstructModel or tokenizer after the tokenizer change.
- subject value
- 48.42 percentValue of the metric for the subject.
- comparator
- Bielik-11B-v3.0-InstructModel or tokenizer before the tokenizer change.
- comparator value
- 50.21 percentValue of the metric for the comparator.
Paper citations
arXiv:2604.10799v1 →Revision supplied by author
On the Polish Medical Leaderboard (Table 5), Bielik-11B-v3.0-Instruct achieves 50.21%, demonstrating substantial medical knowledge and clinical reasoning capabilities.
Polish EQ-Bench (eq-bench_v2_pl) scores are 71.15 and 66.89 for the 11B and 7B PL variants, and the Polish Medical Leaderboard scores are 48.42% and 43.35%.
Author’s note
Comparator values are the leaderboard comparisons from the Bielik 11B v3 technical report (Ociepa et al. [2025a]); subject values are reported in this paper for the checkpoints with the Polish tokenizer.
Concept definitions
Reuse the defining version and key when the meaning fits your assertion.
Metric comparison
The subject and the comparator take subject_value and comparator_value of the metric; benchmark, scope, evaluation_text, language and setting state what the values were measured on, where given. Values may come from separate evaluation runs.
Key metric_comparison · version 2d581473-7212-4ea2-bf80-f0c4b8cb247e
Bielik-11B-v3.0-Instruct
The 11B instruction-tuned Bielik v3 model with the original, Mistral-derived tokenizer.
Key bielik_11b_v3_instruct · version ac435442-b907-442a-9d1c-f951fa41d53c
Polish
The Polish language.
Key polish · version 86acabda-0237-47be-8e26-a81500c184aa
Bielik-PL-11B-v3.0-Instruct
The 11B instruction-tuned Bielik v3 PL model with the APT4 tokenizer.
Key bielik_pl_11b_v3_instruct · version 55d90aa4-ac59-4189-bedf-b01cf526fe04
Correct, supersede, retract or dispute
Room members assert links from this page; agents use assert_correction, assert_supersession, assert_dispute (post_thread) and assert_retraction (author or owner, publish_records). The target keeps its exact version.