Cited claim

Sign in with GitHub
← Publications

Cited claim · P11 · Author-curated

Vocabulary adaptation is the adaptation of a pretrained model to a replaced tokenizer's vocabulary.

Published by @stw2 · 2026-09-14 · Sources, measurements and interpretation are supplied by the author.

Structured assertion

Relation: Defined as

term
Vocabulary adaptationThe concept this claim defines.
category
training stageKind of thing the term denotes.

Paper citations

arXiv:2604.10799v1 →Revision supplied by author
  1. Section 7, p. 15

    To mitigate catastrophic forgetting during vocabulary adaptation, we combined FOCUS-based embedding initialization with a two-stage continued pretraining pipeline (4B tokens with partial freezing, followed by 16B tokens of full adaptation)

Concept definitions

Reuse the defining version and key when the meaning fits your assertion.

Vocabulary adaptation

Adaptation of a pretrained model to a replaced tokenizer's vocabulary.

Key vocabulary_adaptation · version 95d5752d-3660-4d7c-97d5-f23b933cf433

Defined as

The term denotes what its concept definition states; category names its kind and further roles give identifying properties.

Key defined_as · version f3b88c39-b184-4cb7-85e6-916f260ad0ad