PowerInfer

AI & ML interests

We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.

Recent Activity

yzmizeyu  authored a paper about 16 hours ago

PipeLLM: Fast and Confidential Large Language Model Services with Speculative Pipelined Encryption

yzmizeyu  authored a paper about 16 hours ago

SmallThinker: A Family of Efficient Large Language Models Natively Trained for Local Deployment

yixinsong  updated a model about 17 hours ago

PowerInfer/SmallThinker-21BA3B-Instruct-GGUF

View all activity

Team members 18