Kotokin/EVA-UNIT-01_EVA-LLaMA-3.33-70B-v0.1-exl2-5bpw
Text Generation
•
Updated
•
18
NIkita Balakin
Kotokin
AI & ML interests
None yet
Recent Activity
upvoted
a
collection
about 1 month ago
TheDrummer_Valkyrie-49B-v1 - EXL3
liked
a model
3 months ago
Tarek07/Legion-V2.1-LLaMa-70B
reacted
to
csabakecskemeti's
post
with 👍
4 months ago
-UPDATED-
4bit inference is working! The blogpost is updated with code snippet and requirements.txt
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
-UPDATED-
I've played around with an MI100 and ROCm and collected my experience in a blogpost:
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
Organizations
None yet
models
7
Kotokin/sophosympatheia_New-Dawn-Llama-3.1-70B-v1.1-exl2-4.5bpw
Text Generation
•
Updated
•
18
•
1
Kotokin/internlm_internlm2_5-20b-chat-exl2-8bpw
Text Generation
•
Updated
•
22
Kotokin/Midnight-Miqu-70B-v1.5_GPTQ32G
Text Generation
•
Updated
•
310
•
4
Kotokin/sophosympatheia_Midnight-Miqu-70B-v1.0_GPTQ32G
Text Generation
•
Updated
•
15
•
2
Kotokin/Mistral-7B-NSFWSTORY-lora
Updated
•
42
Kotokin/MLewd-L2-13B-v2-1-GPTQ
Text Generation
•
Updated
•
15
•
5