Xinference is no support?
#10
by
jiatianxia
- opened
python:
import json
from xinference.client import Client
with open('c:\Users\jinaai\Downloads\model.json') as fd:
model = fd.read()
replace with real xinference endpoint
endpoint = 'http://ip:9997'
client = Client(endpoint)
client.register_model(model_type="rerank", model=model, persist=False)
model.json
{
"model_name": "jina-reranker-m0",
"type": "normal",
"language": ["en", "zh"],
"model_id": "jinaai/jina-reranker-m0"
}
python import Client.py
report:
Server error: 400 - [address=0.0.0.0:36765, pid=590] Unrecognized configuration class <class 'transformers.models.qwen2_vl.configuration_qwen2_vl.Qwen2VLConfig'> for this kind of AutoModel: AutoModelForSequenceClassification.
so:Xinference is no support?