MLX
lora
customer-support
placeholder-safe
llama-3.2
batuhne commited on
Commit
846c771
·
0 Parent(s):

Initial commit: LoRA adapter + model card

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +61 -0
  3. adapters.safetensors +3 -0
.gitattributes ADDED
@@ -0,0 +1 @@
 
 
1
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ tags:
4
+ - lora
5
+ - mlx
6
+ - customer-support
7
+ - placeholder-safe
8
+ - llama-3.2
9
+ base_model: meta-llama/Llama-3.2-3B-Instruct
10
+ library_name: mlx
11
+ datasets:
12
+ - bitext/Bitext-customer-support-llm-chatbot-training-dataset
13
+ ---
14
+
15
+ # Customer Support LoRA Adapter (Llama-3.2-3B-Instruct · MLX)
16
+
17
+ This repository provides **LoRA adapters** fine-tuned on the
18
+ [Bitext Customer Support dataset](https://huggingface.co/datasets/bitext/Bitext-customer-support-llm-chatbot-training-dataset).
19
+ The goal is **placeholder-safe** answers (e.g., `{{Order Number}}`, `{{Website URL}}` **must remain unchanged**).
20
+
21
+ - **Base model**: [`meta-llama/Llama-3.2-3B-Instruct`](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct)
22
+ - **Runtime**: Apple Silicon **MLX**
23
+ - **This repo contains**: `adapters.safetensors` (**LoRA only**; no base weights)
24
+
25
+ > You must accept/download the base model under its own license (Meta Llama 3.2 Community License).
26
+ > This repo **does not** include base weights.
27
+
28
+ ---
29
+
30
+ ## Quickstart (MLX CLI)
31
+
32
+ Install once:
33
+ ```bash
34
+ pip install -U mlx-lm
35
+
36
+ Generate with adapter:
37
+ python -m mlx_lm.generate \
38
+ --model meta-llama/Llama-3.2-3B-Instruct \
39
+ --adapter-path batuhne/customer-support-llm \
40
+ --prompt "Hello, please cancel order {{Order Number}}" \
41
+ --max-tokens 128 --temp 0.2
42
+
43
+ Interactive chat (optional):
44
+ python -m mlx_lm.chat \
45
+ --model meta-llama/Llama-3.2-3B-Instruct \
46
+ --adapter-path batuhne/customer-support-llm
47
+
48
+ Recommended system prompt
49
+ Keep placeholders exactly:
50
+ You are a concise, helpful customer support agent. Preserve placeholders exactly as given (e.g., {{Order Number}}, {{Website URL}}).
51
+
52
+ Notes
53
+ Trained for placeholder integrity; do not modify {{…}} tokens in outputs.
54
+ Use MLX quantized base weights if you need lower RAM/VRAM usage on Apple Silicon.
55
+
56
+ Limitations
57
+ Adapter quality is tied to the base model and dataset scope (customer support).
58
+ This is not a general safety or policy layer; review outputs before production use.
59
+
60
+ License
61
+ Base model license: Meta Llama 3.2 Community License (must be accepted separately).
adapters.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15321469c49362e86b18f5481139f7d0843a4e547b55cb5660f458cacf564dd6
3
+ size 5249791