File size: 3,137 Bytes
85723f7
 
 
7988d58
85723f7
 
7988d58
85723f7
5621cf3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
df7a540
5621cf3
 
 
 
df7a540
85723f7
 
88e1b35
85723f7
a2f772f
88e1b35
c10c789
e055031
c10c789
85723f7
cf83a12
 
 
 
 
 
85723f7
 
 
88e1b35
 
 
 
bb90af0
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
---
license: apache-2.0
tags:
  - text-generation
base_model: Locutusque/TinyMistral-248M
datasets:
  - OpenAssistant/oasst_top1_2023-08-25
widget:
  - messages:
    - role: user
      content: "Invited some friends to come home today. Give me some ideas for games to play with them!"
  - messages:
    - role: user
      content: "How do meteorologists predict how much air pollution will be produced in the next year?"
  - messages:
    - role: user
      content: "Who is Mona Lisa?"
  - messages:
    - role: user
      content: "Heya!"
    - role: assistant
      content: "Hi! How may I help you today?"
    - role: user
      content: "I need to build a simple website. Where should I start learning about web development?"
  - messages:
    - role: user
      content: "What are some potential applications for quantum computing?"
  - messages:
    - role: user
      content: "Got a question for you!"
    - role: assistant
      content: "Sure! What's it?"
    - role: user
      content: "Why do you love cats so much!? 🐈"
  - messages:
    - role: user
      content: "Tell me about the pros and cons of social media."
  - messages:
    - role: user
      content: "Question: What is a dog?"
    - role: assistant
      content: "A dog is a four-legged, domesticated animal that is a member of the class Mammalia, which includes all mammals. Dogs are known for their loyalty, playfulness, and ability to be trained for various tasks. They are also used for hunting, herding, and as service animals."
    - role: user
      content: "Question: What is the capital of France?"
    - role: assistant
      content: "The capital of France is Paris. Paris is located in the north-central region of France and is known for its famous landmarks, such as the Eiffel Tower, the Louvre Museum, and Notre-Dame Cathedral."
    - role: user
      content: "Question: What is the color of an apple?"
inference:
  parameters:
    max_new_tokens: 250
    penalty_alpha: 0.5
    top_k: 5
    repetition_penalty: 1.001
---

# Locutusque's TinyMistral-248M trained on OpenAssistant TOP-1 Conversation Threads

- Base model: [Locutusque/TinyMistral-248M](https://huggingface.co/Locutusque/TinyMistral-248M)
- Dataset: [OpenAssistant/oasst_top1_2023-08-25](https://huggingface.co/datasets/OpenAssistant/oasst_top1_2023-08-25)
- Availability in other ML formats:
  - GGUF: [Felladrin/gguf-TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/gguf-TinyMistral-248M-SFT-v4)
  - ONNX: [Felladrin/onnx-TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/onnx-TinyMistral-248M-SFT-v4)

## Where to try out this model

The [inference widget from HuggingFace was not working properly for this model](https://discuss.huggingface.co/t/api-endpoint-not-working-as-expected/69457), so it was temporarily disabled.

To try out this model online, please visit this HuggingFace Space: [Felladrin/ModelsPlayground](https://huggingface.co/spaces/Felladrin/ModelsPlayground)

## Recommended Prompt Format

```
<|im_start|>user
{message}<|im_end|>
<|im_start|>assistant
```

## Recommended Inference Parameters

```yml
penalty_alpha: 0.5
top_k: 5
```