Llama_3.x_70b_Hexagon_Purple_V3-EXL2
Released by Nexesenex
Quant(s) by FrenzyBiscuit
5.35 BPW H6 - Fits in 72GB VRAM with 64k FP16 context
6.70 BPW H6 - Fits in 72GB VRAM with 32k FP16 context
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for ReadyArt/Nexesenex_Llama_3.x_70b_Hexagon_Purple_V3-EXL2
Base model
Nexesenex/Llama_3.x_70b_Hexagon_Purple_V3