Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- ko
|
| 4 |
+
---
|
| 5 |
+
|
| 6 |
+
|
| 7 |
+
## Evaluation results
|
| 8 |
+
|
| 9 |
+
```plain
|
| 10 |
+
Intent report:
|
| 11 |
+
label precision recall f1 support
|
| 12 |
+
의도없음 (label_id: 0) 83.33 100.00 90.91 5
|
| 13 |
+
조명전원켜짐 (label_id: 1) 100.00 100.00 100.00 10
|
| 14 |
+
조명전원꺼짐 (label_id: 2) 100.00 100.00 100.00 10
|
| 15 |
+
조명밝게설정 (label_id: 3) 76.92 100.00 86.96 10
|
| 16 |
+
조명어둡게설정 (label_id: 4) 100.00 100.00 100.00 10
|
| 17 |
+
조명색상설정 (label_id: 5) 83.33 100.00 90.91 10
|
| 18 |
+
조명밝기조절 (label_id: 6) 100.00 100.00 100.00 10
|
| 19 |
+
조명색상모드설정 (label_id: 7) 100.00 100.00 100.00 10
|
| 20 |
+
조명차갑게설정 (label_id: 8) 90.00 100.00 94.74 9
|
| 21 |
+
조명따뜻하게설정 (label_id: 9) 100.00 90.91 95.24 11
|
| 22 |
+
모드실행 (label_id: 10) 100.00 100.00 100.00 10
|
| 23 |
+
상태조회 (label_id: 11) 100.00 80.00 88.89 10
|
| 24 |
+
조명전체켜짐 (label_id: 12) 100.00 100.00 100.00 10
|
| 25 |
+
조명전체꺼짐 (label_id: 13) 100.00 100.00 100.00 10
|
| 26 |
+
조명켜짐예약등록 (label_id: 14) 100.00 100.00 100.00 10
|
| 27 |
+
조명꺼짐예약등록 (label_id: 15) 90.91 100.00 95.24 10
|
| 28 |
+
조명예약취소 (label_id: 16) 100.00 90.00 94.74 10
|
| 29 |
+
별칭등록 (label_id: 17) 100.00 60.00 75.00 10
|
| 30 |
+
-------------------
|
| 31 |
+
micro avg 95.43 95.43 95.43 175
|
| 32 |
+
macro avg 95.81 95.61 95.15 175
|
| 33 |
+
weighted avg 96.22 95.43 95.27 175
|
| 34 |
+
Slot report:
|
| 35 |
+
label precision recall f1 support
|
| 36 |
+
O (label_id: 0) 95.16 89.29 92.13 308
|
| 37 |
+
mode (label_id: 1) 90.91 100.00 95.24 10
|
| 38 |
+
time (label_id: 2) 95.74 100.00 97.83 45
|
| 39 |
+
home (label_id: 3) 91.85 96.12 93.94 129
|
| 40 |
+
device (label_id: 4) 84.62 92.26 88.27 155
|
| 41 |
+
nickname (label_id: 5) 100.00 42.86 60.00 7
|
| 42 |
+
percent (label_id: 6) 100.00 100.00 100.00 10
|
| 43 |
+
color_red (label_id: 7) 80.00 100.00 88.89 4
|
| 44 |
+
color_yellow (label_id: 8) 100.00 100.00 100.00 3
|
| 45 |
+
color_blue (label_id: 9) 100.00 100.00 100.00 2
|
| 46 |
+
color_mode (label_id: 10) 100.00 90.00 94.74 10
|
| 47 |
+
-------------------
|
| 48 |
+
micro avg 91.95 91.95 91.95 683
|
| 49 |
+
macro avg 94.39 91.87 91.91 683
|
| 50 |
+
weighted avg 92.25 91.95 91.88 683
|
| 51 |
+
```
|