Get Onnx
#6
by
RemagM
- opened
Is there a way to get this model as Onnx?
I tried using this code, but it did not work.
from optimum.onnxruntime import ORTModelForCausalLM
model = ORTModelForCausalLM.from_pretrained(model_id,
use_io_binding=False,
export=True,
trust_remote_code=True,
cache_dir=".",
use_cache=True
)
Maybe try to open an issue on optium lib...
optimum-cli export onnx -m Zhengyi/LLaMA-Mesh LLaMA-Mesh-onnx
currently raised an error: Asked to export a llama model for the task text-to-3d (auto-detected), but the Optimum ONNX exporter only supports the tasks feature-extraction, feature-extraction-with-past, text-generation, text-generation-with-past, text-classification for llama. Please use a supported task. Please open an issue at https://github.com/huggingface/optimum/issues if you would like the task text-to-3d to be supported in the ONNX export for llama.