Update README.md
Browse files
README.md
CHANGED
@@ -1,15 +1,55 @@
|
|
1 |
---
|
2 |
base_model: unsloth/qwen3-8b-unsloth-bnb-4bit
|
3 |
tags:
|
4 |
-
- text-generation
|
5 |
-
-
|
6 |
-
-
|
|
|
|
|
|
|
|
|
7 |
- qwen3
|
8 |
-
-
|
9 |
-
|
10 |
language:
|
11 |
- en
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
---
|
|
|
13 |
# RAG Context Evaluator - Qwen3-8B Fine-tuned π
|
14 |
|
15 |
## Model Details π
|
@@ -124,4 +164,4 @@ For questions or issues regarding this model, please contact the developer throu
|
|
124 |
|
125 |
This qwen3 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
126 |
|
127 |
-
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
1 |
---
|
2 |
base_model: unsloth/qwen3-8b-unsloth-bnb-4bit
|
3 |
tags:
|
4 |
+
- text-generation
|
5 |
+
- rag
|
6 |
+
- evaluation
|
7 |
+
- information-retrieval
|
8 |
+
- question-answering
|
9 |
+
- retrieval-augmented-generation
|
10 |
+
- context-evaluation
|
11 |
- qwen3
|
12 |
+
- unsloth
|
13 |
+
- fine-tuned
|
14 |
language:
|
15 |
- en
|
16 |
+
- multilingual
|
17 |
+
license: apache-2.0
|
18 |
+
library_name: transformers
|
19 |
+
pipeline_tag: text-generation
|
20 |
+
model_type: qwen3
|
21 |
+
quantized: q8_0
|
22 |
+
datasets:
|
23 |
+
- evaluation
|
24 |
+
- rag-evaluation
|
25 |
+
metrics:
|
26 |
+
- completeness
|
27 |
+
- clarity
|
28 |
+
- conciseness
|
29 |
+
- precision
|
30 |
+
- recall
|
31 |
+
- mrr
|
32 |
+
- ndcg
|
33 |
+
- relevance
|
34 |
+
widget:
|
35 |
+
- example_title: "RAG Context Evaluation"
|
36 |
+
text: |
|
37 |
+
Evaluate the agent's response according to the metrics: completeness, clarity, conciseness, precision, recall, mrr, ndcg, relevance
|
38 |
+
|
39 |
+
Question: What are the main benefits of renewable energy?
|
40 |
+
Retrieved contexts: [1] Renewable energy sources like solar and wind power provide clean alternatives to fossil fuels, reducing greenhouse gas emissions and air pollution. [2] These energy sources are sustainable and abundant, helping to ensure long-term energy security.
|
41 |
+
model-index:
|
42 |
+
- name: RAG Context Evaluator
|
43 |
+
results:
|
44 |
+
- task:
|
45 |
+
type: text-generation
|
46 |
+
name: RAG Evaluation
|
47 |
+
metrics:
|
48 |
+
- type: evaluation_score
|
49 |
+
name: Multi-metric Assessment
|
50 |
+
value: 0-5
|
51 |
---
|
52 |
+
|
53 |
# RAG Context Evaluator - Qwen3-8B Fine-tuned π
|
54 |
|
55 |
## Model Details π
|
|
|
164 |
|
165 |
This qwen3 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
166 |
|
167 |
+
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|