Compiled CodeLlama-7b-hf using optimum-neuron
optimum-cli export neuron --model codellama/CodeLlama-7b-hf --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/codellama/CodeLlama-7b-hf
- Downloads last month
- 5
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support