Transformers grown layer-by-layer on frozen embeddings. Explores emergent capabilities with depth.
Andrey
Bochkov
AI & ML interests
None yet
Recent Activity
authored
a paper
1 day ago
Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen
Visual Unicode Representations
updated
a collection
1 day ago
Tokenizers
updated
a collection
1 day ago
Pro models [pretrain]
Organizations
None yet