PowerInfer

community

AI & ML interests

We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.

Recent Activity

yixinsong new activity about 24 hours ago

PowerInfer/SmallThinker-21BA3B-Instruct:Are there any other frameworks tested besides transformers that can be deployed?

yixinsong new activity 2 days ago

PowerInfer/SmallThinker-21BA3B-Instruct:Improve model card: Add paper title and abstract

yixinsong new activity 2 days ago

PowerInfer/SmallThinker-4BA0.6B-Instruct:Enhance model card: Add abstract and project page

View all activity

PowerInfer 's models 29

PowerInfer/SmallThinker-21BA3B-Instruct

Text Generation • 22B • Updated 2 days ago • 496 • 81

PowerInfer/SmallThinker-4BA0.6B-Instruct

Text Generation • 4B • Updated 2 days ago • 529 • 32

PowerInfer/SmallThinker-21BA3B-Instruct-GGUF

Text Generation • 22B • Updated 3 days ago • 30.6k • 24

PowerInfer/SmallThinker-4BA0.6B-Instruct-INT4-QAT

4B • Updated 4 days ago • 137

PowerInfer/SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation • 4B • Updated 4 days ago • 2.72k • 16

PowerInfer/SmallThinker-3B-Preview

Text Generation • 3B • Updated Jan 16 • 35.8k • 409

PowerInfer/SparseQwen2-7B

8B • Updated Dec 25, 2024 • 6 • 5

PowerInfer/TurboSparse-Mistral-Instruct

Feature Extraction • 8B • Updated Jun 14, 2024 • 3 • 20

PowerInfer/TurboSparse-Mixtral

Feature Extraction • 52B • Updated Jun 14, 2024 • 4 • 35

PowerInfer/TurboSparse-Mixtral-Instruct

Feature Extraction • 52B • Updated Jun 14, 2024 • 2 • 28

PowerInfer/Bamboo-base-v0_1

Feature Extraction • 7B • Updated Jun 7, 2024 • 2 • 21

PowerInfer/Bamboo-DPO-v0_1

Feature Extraction • 7B • Updated Jun 7, 2024 • 2 • 7

PowerInfer/OPT-7B-predictor

Updated Apr 10, 2024 • 3

PowerInfer/Bamboo-DPO-v0.1-predictor

Updated Mar 28, 2024

PowerInfer/Bamboo-DPO-v0.1-gguf

7B • Updated Mar 28, 2024 • 38 • 7

PowerInfer/Bamboo-base-v0.1-gguf

7B • Updated Mar 28, 2024 • 31 • 4

PowerInfer/Bamboo-base-v0.1-predictor

Updated Mar 26, 2024 • 3

PowerInfer/prosparse-llama-2-7b-gguf

Feature Extraction • Updated Mar 13, 2024 • 29 • 2

PowerInfer/prosparse-llama-2-13b-gguf

Feature Extraction • Updated Mar 13, 2024 • 25 • 2

PowerInfer/prosparse-llama-2-13b-predictor

Feature Extraction • Updated Mar 11, 2024 • 3

PowerInfer/prosparse-llama-2-7b-predictor

Feature Extraction • Updated Mar 11, 2024 • 3

PowerInfer/ReluLLaMA-70B-PowerInfer-GGUF

Updated Feb 2, 2024 • 29 • 9

PowerInfer/ReluLLaMA-13B-PowerInfer-GGUF

Updated Dec 26, 2023 • 23 • 2

PowerInfer/ReluFalcon-40B-PowerInfer-GGUF

Updated Dec 26, 2023 • 6 • 5

PowerInfer/ReluLLaMA-7B-PowerInfer-GGUF

Updated Dec 26, 2023 • 69 • 14

PowerInfer/ReluLLaMA-70B-Predictor

Updated Dec 20, 2023 • 2

PowerInfer/ReluLLaMA-13B-Predictor

Updated Dec 18, 2023

PowerInfer/ReluFalcon-40B-Predictor

Updated Dec 18, 2023

PowerInfer/ReluLLaMA-7B-Predictor

Updated Dec 18, 2023 • 5