legolasyiu commited on
Commit
eee67dd
·
verified ·
1 Parent(s): f82eeaf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -221,4 +221,30 @@ We also set up the [Llama Impact Grants](https://llama.meta.com/llama-impact-gra
221
  Finally, we put in place a set of resources including an [output reporting mechanism](https://developers.facebook.com/llama_output_feedback) and [bug bounty program](https://www.facebook.com/whitehat) to continuously improve the Llama technology with the help of the community.
222
  ## Ethical Considerations and Limitations
223
  The core values of Llama 3.1 are openness, inclusivity and helpfulness. It is meant to serve everyone, and to work for a wide range of use cases. It is thus designed to be accessible to people across many different backgrounds, experiences and perspectives. Llama 3.1 addresses users and their needs as they are, without insertion unnecessary judgment or normativity, while reflecting the understanding that even content that may appear problematic in some cases can serve valuable purposes in others. It respects the dignity and autonomy of all users, especially in terms of the values of free thought and expression that power innovation and progress.
224
- But Llama 3.1 is a new technology, and like any new technology, there are risks associated with its use. Testing conducted to date has not covered, nor could it cover, all scenarios. For these reasons, as with all LLMs, Llama 3.1’s potential outputs cannot be predicted in advance, and the model may in some instances produce inaccurate, biased or other objectionable responses to user prompts. Therefore, before deploying any applications of Llama 3.1 models, developers should perform safety testing and tuning tailored to their specific applications of the model. Please refer to available resources including our [Responsible Use Guide](https://llama.meta.com/responsible-use-guide), [Trust and Safety](https://llama.meta.com/trust-and-safety/) solutions, and other [resources](https://llama.meta.com/docs/get-started/) to learn more about responsible development.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
221
  Finally, we put in place a set of resources including an [output reporting mechanism](https://developers.facebook.com/llama_output_feedback) and [bug bounty program](https://www.facebook.com/whitehat) to continuously improve the Llama technology with the help of the community.
222
  ## Ethical Considerations and Limitations
223
  The core values of Llama 3.1 are openness, inclusivity and helpfulness. It is meant to serve everyone, and to work for a wide range of use cases. It is thus designed to be accessible to people across many different backgrounds, experiences and perspectives. Llama 3.1 addresses users and their needs as they are, without insertion unnecessary judgment or normativity, while reflecting the understanding that even content that may appear problematic in some cases can serve valuable purposes in others. It respects the dignity and autonomy of all users, especially in terms of the values of free thought and expression that power innovation and progress.
224
+ But Llama 3.1 is a new technology, and like any new technology, there are risks associated with its use. Testing conducted to date has not covered, nor could it cover, all scenarios. For these reasons, as with all LLMs, Llama 3.1’s potential outputs cannot be predicted in advance, and the model may in some instances produce inaccurate, biased or other objectionable responses to user prompts. Therefore, before deploying any applications of Llama 3.1 models, developers should perform safety testing and tuning tailored to their specific applications of the model. Please refer to available resources including our [Responsible Use Guide](https://llama.meta.com/responsible-use-guide), [Trust and Safety](https://llama.meta.com/trust-and-safety/) solutions, and other [resources](https://llama.meta.com/docs/get-started/) to learn more about responsible development.
225
+ ## space
226
+ [Space](https://huggingface.co/spaces/John6666/text2tag-llm)
227
+
228
+ ## gguf
229
+ Check out this page
230
+ Thanks /mradermacher
231
+
232
+ ## Provided Quants
233
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
234
+ | Link | Type | Size/GB | Notes |
235
+ |:-----|:-----|--------:|:------|
236
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q2_K.gguf) | Q2_K | 3.3 | |
237
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.IQ3_XS.gguf) | IQ3_XS | 3.6 | |
238
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q3_K_S.gguf) | Q3_K_S | 3.8 | |
239
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.IQ3_S.gguf) | IQ3_S | 3.8 | beats Q3_K* |
240
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.IQ3_M.gguf) | IQ3_M | 3.9 | |
241
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q3_K_M.gguf) | Q3_K_M | 4.1 | lower quality |
242
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q3_K_L.gguf) | Q3_K_L | 4.4 | |
243
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.IQ4_XS.gguf) | IQ4_XS | 4.6 | |
244
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q4_K_S.gguf) | Q4_K_S | 4.8 | fast, recommended |
245
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q4_K_M.gguf) | Q4_K_M | 5.0 | fast, recommended |
246
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q5_K_S.gguf) | Q5_K_S | 5.7 | |
247
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q5_K_M.gguf) | Q5_K_M | 5.8 | |
248
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q6_K.gguf) | Q6_K | 6.7 | very good quality |
249
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.Q8_0.gguf) | Q8_0 | 8.6 | fast, best quality |
250
+ | [GGUF](https://huggingface.co/mradermacher/Alpaca-Llama3.1-8B-GGUF/resolve/main/Alpaca-Llama3.1-8B.f16.gguf) | f16 | 16.2 | 16 bpw, overkill |