安装时,如何指定“Files and versions”列出的某个特定版本

#5
by pekingmine - opened

已知,这个
ollama run hf.co/ValueFX9507/Tifa-DeepsexV2-7b-MGRPO-GGUF-Q8
会安装hf.co/ValueFX9507/Tifa-DeepsexV2-7b-MGRPO-GGUF-Q8:latest

但是,“Files and version”有好几个版本(比如此刻有
Tifa-DeepsexV2-7b-0218-Q8.gguf、Tifa-DeepsexV2-7b-Cot-0222-Q8.gguf、Tifa-DeepsexV2-7b-NoCot-0222-Q8.gguf、
Tifa-DeepsexV2-7b-Q8.gguf),都是Q8,但如何指定其中某一个呢?
另外,通过latest安装的是哪个版本呢?

pekingmine changed discussion title from 安装时,如何指定“Files and version”列出的某个特定版本 to 安装时,如何指定“Files and versions”列出的某个特定版本

比如,安装Tifa-DeepsexV2-7b-Cot-0222-Q8.gguf,尝试下面几个tag都不对:

Mac-mini ~ % ollama run hf.co/ValueFX9507/Tifa-DeepsexV2-7b-MGRPO-GGUF-Q8:Cot-0222-Q8 --verbose
pulling manifest
Error: pull model manifest: 400: The specified tag is not a valid quantization scheme. Please use another tag or "latest"

Mac-mini ~ % ollama run hf.co/ValueFX9507/Tifa-DeepsexV2-7b-MGRPO-GGUF-Q8:Cot-0222 --verbose
pulling manifest
Error: pull model manifest: 400: The specified tag is not a valid quantization scheme. Please use another tag or "latest"

Mac-mini ~ % ollama run hf.co/ValueFX9507/Tifa-DeepsexV2-7b-MGRPO-GGUF-Q8:Cot --verbose
pulling manifest
Error: pull model manifest: 400: The specified tag is not a valid quantization scheme. Please use another tag or "latest"

莫非只能手工下载,然后create modelfile再ollama?

同问,怎么处理这个问题啊?

手工下载,然后create model file:我就是这样做的。

@pekingmine

ollama pull hf.co/ValueFX9507/Tifa-DeepsexV2-7b-MGRPO-GGUF-Q4:Cot-0301-Q4_KM

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment