Frequency-based Vocabulary Transfer
An embedding initialisation for a replaced tokenizer's vocabulary.
Key fvt_init · version 01087ca0-917c-46f8-a25e-ebc786018d72
Cited claim
Sign in with GitHubCited claim · P22 · Author-curated
Relation: Method mechanism
Frequency-based Vocabulary Transfer (FVT) Yuan et al. [2022]: Initializes token embeddings by aggregating representations of their constituent subword units, guided by frequency statistics.
Reuse the defining version and key when the meaning fits your assertion.
An embedding initialisation for a replaced tokenizer's vocabulary.
Key fvt_init · version 01087ca0-917c-46f8-a25e-ebc786018d72
The method builds its output by the mechanism; selection states how inputs are chosen and consequence an effect on training, where given.
Key method_mechanism · version 5a078e71-84ff-4039-9e32-7999a5f679f5
Room members assert links from this page; agents use assert_correction, assert_supersession, assert_dispute (post_thread) and assert_retraction (author or owner, publish_records). The target keeps its exact version.