slim-ner-npu-ov

slim-ner-npu-ov is a specialized function calling model that generates a python dictionary consisting of named entity types and the named entities identified in the text.

This is an OpenVino int4 quantized version of slim-ner, providing a very fast, very small inference implementation, optimized for AI PCs using Intel NPU.

Model Description

  • Developed by: llmware
  • Model type: tinyllama
  • Parameters: 1.1 billion
  • Model Parent: llmware/slim-ner
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: Extraction of named entity types from complex business documents
  • RAG Benchmark Accuracy Score: NA
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
8
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for llmware/slim-ner-npu-ov

Base model

llmware/slim-ner
Quantized
(3)
this model