liuheng's picture

9 78

liuheng

heng

·

liuheng2cqupt

AI & ML interests

None yet

Recent Activity

upvoted an article 10 days ago

KV Cache from scratch in nanoVLM

upvoted an article 10 days ago

🕳️ Attention Sinks in LLMs for endless fluency

upvoted an article 10 days ago

Topic 33: Slim Attention, KArAt, XAttention and Multi-Token Attention Explained – What’s Really Changing in Transformers?

View all activity

Organizations

None yet

heng 's models 2

heng/Qwen2.5-1.5B-Open-R1-GRPO

heng/distilgpt2-finetuned-wikitext2

0.1B • Updated Aug 17, 2024 • 2