NPU LLM - a EmbeddedLLM Collection

EmbeddedLLM 's Collections

Onnxruntime DirectML GenAI

Onnxruntime CPU GenAI

NPU LLM

OpenVINO Model Server (OVMS)

NPU LLM

updated Sep 3, 2024

microsoft/Phi-3-mini-4k-instruct

Text Generation • Updated Sep 20, 2024 • 775k • • 1.17k
microsoft/Phi-3-mini-128k-instruct

Text Generation • Updated Mar 2 • 424k • 1.64k
microsoft/Phi-3-medium-4k-instruct

Text Generation • Updated Mar 11 • 44.5k • 219
microsoft/Phi-3-medium-128k-instruct

Text Generation • Updated Aug 20, 2024 • 18.5k • • 380