Article
Andrey PRO
Bochkov
AI & ML interests
None yet
Recent Activity
published an article 2 days ago
FEM-ASM: Modular Language Computation updated a model 2 days ago
Bochkov/modular-reasoning-0p5b-g6p5-demo updated a model 2 days ago
Bochkov/fem-multi-mesh-1p7bOrganizations
Articles 3
Article
Token Identity Is Not Meaning: What Fixed-Input Language Models Can Teach Us
Do Language Models Need a Trainable Input Embedding Table?
This collection is provided for reproducibility of the paper's main claim
-
Bochkov/ab_ext_learned
Text Generation • 2B • Updated • 599 -
Bochkov/ab_ext_binary16
Text Generation • 2B • Updated • 568 -
Bochkov/ab_ext_gf2
Text Generation • 2B • Updated • 533 -
Do Language Models Need a Trainable Input Embedding Table? Fixed Minimal Token Codes at 1.7B-Class Scale
Paper • 2610.04002 • Published • 4
Beyond the Parameter Monolith: Modular Language Modeling
This collection is provided for reproducibility of the paper's main claim
Do Language Models Need a Trainable Input Embedding Table?
This collection is provided for reproducibility of the paper's main claim
-
Bochkov/ab_ext_learned
Text Generation • 2B • Updated • 599 -
Bochkov/ab_ext_binary16
Text Generation • 2B • Updated • 568 -
Bochkov/ab_ext_gf2
Text Generation • 2B • Updated • 533 -
Do Language Models Need a Trainable Input Embedding Table? Fixed Minimal Token Codes at 1.7B-Class Scale
Paper • 2610.04002 • Published • 4
models 24
Bochkov/modular-reasoning-0p5b-g6p5-demo
Text Generation • 0.5B • Updated • 694
Bochkov/fem-multi-mesh-1p7b
Text Generation • 2B • Updated • 738
Bochkov/ab_ext_gf2
Text Generation • 2B • Updated • 533
Bochkov/ab_ext_binary16
Text Generation • 2B • Updated • 568
Bochkov/ab_ext_learned
Text Generation • 2B • Updated • 599
Bochkov/llm-fix-min-affine-recoded-minimal-code-table-free
Text Generation • 0.5B • Updated • 317
Bochkov/llm-fix-min-fixed-minimal-binary-code
Text Generation • 0.5B • Updated • 332
Bochkov/llm-fix-min-baseline-learned-input-table-model-classic
Text Generation • 0.5B • Updated • 325
Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m
Text Generation • 0.2B • Updated • 25
Bochkov/growing-transformers-model-unfrozen-baseline-monolyth-247m
Text Generation • 0.2B • Updated • 25