aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions Community

optimum-neuron-cache / inference-cache-config

8 contributors

History: 61 commits

dacorvo's picture

dacorvo HF staff

Add DeepSeek distilled versions of LLama 8B

509e6bf verified about 9 hours ago

gpt2.json

398 Bytes

Add more gpt2 configurations 10 months ago
granite.json

1.3 kB

Add configuration for granite models about 1 month ago
llama-variants.json

1.45 kB

Add DeepSeek distilled versions of LLama 8B about 9 hours ago
llama.json

1.67 kB

Update inference-cache-config/llama.json 4 months ago
llama2-70b.json

287 Bytes

Create llama2-70b.json 7 months ago
llama3-70b.json

584 Bytes

Add DeepSeek distilled model about 15 hours ago
llama3.1-70b.json

289 Bytes

Rename inference-cache-config/Llama3.1-70b.json to inference-cache-config/llama3.1-70b.json 4 months ago
mistral-variants.json

1.04 kB

Remove obsolete mistral variants 4 months ago
mistral.json

1.87 kB

Update inference-cache-config/mistral.json 20 days ago
mixtral.json

583 Bytes

Update inference-cache-config/mixtral.json 4 months ago
qwen2.5-large.json

849 Bytes

Update inference-cache-config/qwen2.5-large.json 1 day ago
qwen2.5.json

2.69 kB

Add DeepSeek distilled models 1 day ago
stable-diffusion.json

1.91 kB

Update inference-cache-config/stable-diffusion.json 4 months ago