mrcuddle
/

Tiny-DarkLlama-Chat

Text Generation

Trained with AutoTrain

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

mrcuddle commited on Dec 18, 2024

Commit

f21c524

·

verified ·

1 Parent(s): 1760f79

Update README.md

Files changed (1) hide show

README.md +7 -4

README.md CHANGED Viewed

@@ -58,7 +58,10 @@ Datasets used in training:
   - NobodyExistsOnTheInternet/ToxicQAFinal
 # Eval
-|  Task  |Version| Metric |Value |   |Stderr|
-|--------|------:|--------|-----:|---|-----:|
-|arc_easy|      0|acc     |0.5892|±  |0.0101|
-|        |       |acc_norm|0.4672|±  |0.0102|

   - NobodyExistsOnTheInternet/ToxicQAFinal
 # Eval
+huggingface (pretrained=mrcuddle/tiny-darkllama-chat), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 16
+|    Tasks     |Version|Filter|n-shot|  Metric  |   |Value |   |Stderr|
+|--------------|------:|------|-----:|----------|---|-----:|---|-----:|
+|hellaswag     |      1|none  |     0|acc       |↑  |0.4659|±  |0.0050|
+|              |       |none  |     0|acc_norm  |↑  |0.6044|±  |0.0049|
+|lambada_openai|      1|none  |     0|acc       |↑  |0.6101|±  |0.0068|
+|              |       |none  |     0|perplexity|↓  |5.9720|±  |0.1591|