OpenVINO quant of MrDragonFox/mOrpheus_3B-1Base_early_preview-v1-25000
Use the openai text-completions endpoint (not chat-completions) for this model.
- Works on (Intel Arc A750 / A770 / B580).
- Tested on Intel Arc A770
Performance on an A770 with OpenArc
=== Streaming Performance ===
Total generation time: TODO
Prompt evaluation: TODO
Response generation: TODO
- Downloads last month
- 18
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support