Compiled Llama-2-7b-chat-hf using optimum-neuron
optimum-cli export neuron --model NousResearch/Llama-2-7b-chat-hf --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/NousResearch/Llama-2-7b-chat-hf
- Downloads last month
- 1
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.