Hugging Face's logo
L's picture
4 2

L

hc1903
·

AI & ML interests

None yet

Recent Activity

updated a collection 12 days ago
test-collection-23332345234523452345
replied to codelion's post 13 days ago
Introducing AutoThink: Adaptive reasoning for LLMs that improves performance by 43% on reasoning benchmarks! Instead of using fixed thinking budgets, AutoThink: - Classifies query complexity (HIGH/LOW) using adaptive classification - Dynamically allocates thinking tokens based on complexity - Uses steering vectors derived from Pivotal Token Search to guide reasoning patterns Results on DeepSeek-R1-Distill-Qwen-1.5B: - GPQA-Diamond: 31.06% vs 21.72% baseline (+9.34 points) - MMLU-Pro: 26.38% vs 25.58% baseline (+0.8 points) - Uses fewer tokens than baseline approaches Works with any local reasoning model - DeepSeek, Qwen, Llama, custom models. The technique combines our research on Pivotal Token Search (PTS) implementation and adaptive classification frameworks. Paper: AutoThink: efficient inference for reasoning LLMs https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5253327 Code and examples: https://github.com/codelion/optillm/tree/main/optillm/autothink PTS implementation and technical details: https://github.com/codelion/pts https://huggingface.co/blog/codelion/pts Adaptive classifier framework: https://github.com/codelion/adaptive-classifier Would love to hear your thoughts on adaptive resource allocation for LLM reasoning! Have you experimented with similar approaches?
replied to codelion's post 13 days ago
Introducing AutoThink: Adaptive reasoning for LLMs that improves performance by 43% on reasoning benchmarks! Instead of using fixed thinking budgets, AutoThink: - Classifies query complexity (HIGH/LOW) using adaptive classification - Dynamically allocates thinking tokens based on complexity - Uses steering vectors derived from Pivotal Token Search to guide reasoning patterns Results on DeepSeek-R1-Distill-Qwen-1.5B: - GPQA-Diamond: 31.06% vs 21.72% baseline (+9.34 points) - MMLU-Pro: 26.38% vs 25.58% baseline (+0.8 points) - Uses fewer tokens than baseline approaches Works with any local reasoning model - DeepSeek, Qwen, Llama, custom models. The technique combines our research on Pivotal Token Search (PTS) implementation and adaptive classification frameworks. Paper: AutoThink: efficient inference for reasoning LLMs https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5253327 Code and examples: https://github.com/codelion/optillm/tree/main/optillm/autothink PTS implementation and technical details: https://github.com/codelion/pts https://huggingface.co/blog/codelion/pts Adaptive classifier framework: https://github.com/codelion/adaptive-classifier Would love to hear your thoughts on adaptive resource allocation for LLM reasoning! Have you experimented with similar approaches?
View all activity

Organizations

test-org123123's profile picture

hc1903's activity

upvoted a collection 17 days ago
upvoted a collection 24 days ago