Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
yahavb
/
inf2-bs32-tp16-mml16k-llama-31-8b-vllm
like
0
Model card
Files
Files and versions
Community
main
inf2-bs32-tp16-mml16k-llama-31-8b-vllm
/
weights
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
yahavb
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
afe0afe
verified
about 13 hours ago
tp0_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp10_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp11_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp12_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp13_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp14_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp15_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp1_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp2_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp3_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp4_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp5_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp6_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp7_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp8_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
tp9_sharded_checkpoint.safetensors
1.04 GB
LFS
Add NxD compiled model yahavb/inf2-bs32-tp16-mml16k-llama-31-8b-vllm for vLLM; after converting checkpoints
about 13 hours ago
