1 billion parameter models, quantized with AWQ.
SolidRusT Networks
company
Verified
AI & ML interests
Self-hosting, Open Source and AI Unalignment
Organization Card
Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.
Currently focused on models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ using https://github.com/SolidRusT/srt-model-quantizing/tree/main/awq
Collections
8
These models are selected for their compatibility with small 12GB memory GPUs.
-
solidrust/Starling-LM-7B-beta-AWQ
Text Generation β’ Updated β’ 115 β’ 3 -
solidrust/dolphin-2.8-mistral-7b-v02-AWQ
Text Generation β’ Updated β’ 31 β’ 2 -
solidrust/Hermes-2-Pro-Mistral-7B-AWQ
Text Generation β’ Updated β’ 15 β’ 2 -
solidrust/dolphin-2.8-experiment26-7b-AWQ
Text Generation β’ Updated β’ 16 β’ 1
models
509
solidrust/Llama-3-8B-Stroganoff-4.0-AWQ
Text Generation
β’
Updated
β’
8
solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ
Text Generation
β’
Updated
β’
10
solidrust/Llama-3.1-8B-TitanFusion-v3-AWQ
Text Generation
β’
Updated
β’
10
solidrust/Fatgirl_v2_8B-AWQ
Text Generation
β’
Updated
β’
10
solidrust/L3-Super-Nova-RP-8B-AWQ
Text Generation
β’
Updated
β’
653
solidrust/L3-Umbral-Mind-RP-v0.3-8B-AWQ
Text Generation
β’
Updated
β’
11
solidrust/Chili_Dog_8B-AWQ
Text Generation
β’
Updated
β’
13
solidrust/L3-Luna-8B-AWQ
Text Generation
β’
Updated
β’
9
solidrust/Magic_v2_8B-AWQ
Text Generation
β’
Updated
β’
9
solidrust/Llama-3SOME-8B-v2-AWQ
Text Generation
β’
Updated
β’
9
datasets
0
None public yet