PowerInfer

community

AI & ML interests

We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.

Recent Activity

yixinsong published a model about 2 months ago

PowerInfer/OPT-7B-predictor

yixinsong updated a model 3 months ago

PowerInfer/SmallThinker-3B-Preview

yixinsong new activity 3 months ago

PowerInfer/SmallThinker-3B-Preview:Eval script

View all activity

models 24

PowerInfer/SmallThinker-3B-Preview

Text Generation • Updated Jan 16 • 64.3k • 394

PowerInfer/SparseQwen2-7B

Updated Dec 25, 2024 • 12 • 3

PowerInfer/TurboSparse-Mistral-Instruct

Feature Extraction • Updated Jun 14, 2024 • 9 • 20

PowerInfer/TurboSparse-Mixtral

Feature Extraction • Updated Jun 14, 2024 • 6 • 35

PowerInfer/TurboSparse-Mixtral-Instruct

Feature Extraction • Updated Jun 14, 2024 • 4 • 28

PowerInfer/Bamboo-base-v0_1

Feature Extraction • Updated Jun 7, 2024 • 17 • 22

PowerInfer/Bamboo-DPO-v0_1

Feature Extraction • Updated Jun 7, 2024 • 3 • 7

PowerInfer/OPT-7B-predictor

Updated Apr 10, 2024 • 3

PowerInfer/Bamboo-DPO-v0.1-predictor

Updated Mar 28, 2024

PowerInfer/Bamboo-DPO-v0.1-gguf

Updated Mar 28, 2024 • 105 • 7

datasets 2

PowerInfer/LONGCOT-Refine-500K

Viewer • Updated Jan 2 • 522k • 174 • 46

PowerInfer/QWQ-LONGCOT-500K

Viewer • Updated Dec 26, 2024 • 286k • 370 • 123