GreenBitAI/Qwen-3-14B-layer-mix-bpw-4.0-mlx
Updated
•
36
Haojin Yang
yanghaojin
AI & ML interests
None yet
Recent Activity
published
a model
about 1 month ago
GreenBitAI/Qwen-3-14B-layer-mix-bpw-4.0-mlx
published
a model
3 months ago
GreenBitAI/DeepSeek-R1-Distill-Llama-70B-layer-mix-bpw-4.0-mlx
published
a model
4 months ago
GreenBitAI/DeepSeek-R1-Distill-Qwen-32B-layer-mix-bpw-4.0-mlx
Organizations
yanghaojin's activity
published
a
model
about 1 month ago
published
a
model
3 months ago
published
a
model
4 months ago
upvoted
an
article
about 1 year ago
Article
GPU Poor Savior: Revolutionizing Low-Bit Open Source LLMs and Cost-Effective Edge Computing
By
•
•
10
upvoted
7
collections
about 1 year ago
GreenBitAI Llama-2
Collection
GreenBitAI's Llama 2 family in low-bit format
•
18 items
•
Updated
•
1
GreenBitAI Qwen1.5
Collection
GreenBitAI's Qwen1.5 family in low-bit format
•
74 items
•
Updated
•
2
reacted to
their
post with 🔥❤️🧠🚀
about 1 year ago
Post
905
Dear community,
Please check our recent blog post, "GPU Poor Savior: Revolutionizing Low-Bit Open Source LLMs and Cost-Effective Edge Computing". A cheaper and more efficient SFT scheme for quantized LLMs is provided.
https://huggingface.co/blog/NicoNico/green-bit-llm
Please check our recent blog post, "GPU Poor Savior: Revolutionizing Low-Bit Open Source LLMs and Cost-Effective Edge Computing". A cheaper and more efficient SFT scheme for quantized LLMs is provided.
https://huggingface.co/blog/NicoNico/green-bit-llm
posted
an
update
about 1 year ago
Post
905
Dear community,
Please check our recent blog post, "GPU Poor Savior: Revolutionizing Low-Bit Open Source LLMs and Cost-Effective Edge Computing". A cheaper and more efficient SFT scheme for quantized LLMs is provided.
https://huggingface.co/blog/NicoNico/green-bit-llm
Please check our recent blog post, "GPU Poor Savior: Revolutionizing Low-Bit Open Source LLMs and Cost-Effective Edge Computing". A cheaper and more efficient SFT scheme for quantized LLMs is provided.
https://huggingface.co/blog/NicoNico/green-bit-llm
reacted to
their
post with 🚀🔥
about 1 year ago
Post
2275
Full parameter fine-tuning of the LLaMA-3 8B model using a single GTX 3090 GPU with 24GB of graphics memory?
Please check out our tool for fine-tuning, inferencing, and evaluating GreenBitAI's low-bit LLMs:
https://github.com/GreenBitAI/green-bit-llm
Model Zoo:
GreenBitAI
Please check out our tool for fine-tuning, inferencing, and evaluating GreenBitAI's low-bit LLMs:
https://github.com/GreenBitAI/green-bit-llm
Model Zoo:
GreenBitAI
-
- 3 replies
replied to
their
post
about 1 year ago
Command for reproducing this run 😉 :
CUDA_VISIBLE_DEVICES=0 WANDB_DISABLED=true python -m sft.finetune --model GreenBitAI/Llama-3-8B-layer-mix-bpw-2.2 --tune-qweight-only --galore --galore-rank 64 --optimizer adamw8bit --batch-size 1 --seqlen 96
posted
an
update
about 1 year ago
Post
2275
Full parameter fine-tuning of the LLaMA-3 8B model using a single GTX 3090 GPU with 24GB of graphics memory?
Please check out our tool for fine-tuning, inferencing, and evaluating GreenBitAI's low-bit LLMs:
https://github.com/GreenBitAI/green-bit-llm
Model Zoo:
GreenBitAI
Please check out our tool for fine-tuning, inferencing, and evaluating GreenBitAI's low-bit LLMs:
https://github.com/GreenBitAI/green-bit-llm
Model Zoo:
GreenBitAI
-
-
- 3 replies