metadata
tags:
- summarization
- mT5
- llama-cpp
- gguf-my-repo
datasets:
- csebuetnlp/xlsum
language:
- am
- ar
- az
- bn
- my
- zh
- en
- fr
- gu
- ha
- hi
- ig
- id
- ja
- rn
- ko
- ky
- mr
- ne
- om
- ps
- fa
- pcm
- pt
- pa
- ru
- gd
- sr
- si
- so
- es
- sw
- ta
- te
- th
- ti
- tr
- uk
- ur
- uz
- vi
- cy
- yo
licenses:
- cc-by-nc-sa-4.0
widget:
- text: >-
Videos that say approved vaccines are dangerous and cause autism, cancer
or infertility are among those that will be taken down, the company said.
The policy includes the termination of accounts of anti-vaccine
influencers. Tech giants have been criticised for not doing more to
counter false health information on their sites. In July, US President
Joe Biden said social media platforms were largely responsible for
people's scepticism in getting vaccinated by spreading misinformation, and
appealed for them to address the issue. YouTube, which is owned by
Google, said 130,000 videos were removed from its platform since last
year, when it implemented a ban on content spreading misinformation about
Covid vaccines. In a blog post, the company said it had seen false claims
about Covid jabs "spill over into misinformation about vaccines in
general". The new policy covers long-approved vaccines, such as those
against measles or hepatitis B. "We're expanding our medical
misinformation policies on YouTube with new guidelines on currently
administered vaccines that are approved and confirmed to be safe and
effective by local health authorities and the WHO," the post said,
referring to the World Health Organization.
base_model: csebuetnlp/mT5_multilingual_XLSum
model-index:
- name: csebuetnlp/mT5_multilingual_XLSum
results:
- task:
type: summarization
name: Summarization
dataset:
name: xsum
type: xsum
config: default
split: test
metrics:
- type: rouge
value: 36.5002
name: ROUGE-1
verified: true
- type: rouge
value: 13.934
name: ROUGE-2
verified: true
- type: rouge
value: 28.9876
name: ROUGE-L
verified: true
- type: rouge
value: 28.9958
name: ROUGE-LSUM
verified: true
- type: loss
value: 2.0674800872802734
name: loss
verified: true
- type: gen_len
value: 26.9733
name: gen_len
verified: true
birdsbirdsbirds/mT5_multilingual_XLSum-Q4_K_M-GGUF
This model was converted to GGUF format from csebuetnlp/mT5_multilingual_XLSum
using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
Invoke the llama.cpp server or the CLI.
CLI:
llama-cli --hf-repo birdsbirdsbirds/mT5_multilingual_XLSum-Q4_K_M-GGUF --hf-file mt5_multilingual_xlsum-q4_k_m.gguf -p "The meaning to life and the universe is"
Server:
llama-server --hf-repo birdsbirdsbirds/mT5_multilingual_XLSum-Q4_K_M-GGUF --hf-file mt5_multilingual_xlsum-q4_k_m.gguf -c 2048
Note: You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo as well.
Step 1: Clone llama.cpp from GitHub.
git clone https://github.com/ggerganov/llama.cpp
Step 2: Move into the llama.cpp folder and build it with LLAMA_CURL=1
flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
cd llama.cpp && LLAMA_CURL=1 make
Step 3: Run inference through the main binary.
./llama-cli --hf-repo birdsbirdsbirds/mT5_multilingual_XLSum-Q4_K_M-GGUF --hf-file mt5_multilingual_xlsum-q4_k_m.gguf -p "The meaning to life and the universe is"
or
./llama-server --hf-repo birdsbirdsbirds/mT5_multilingual_XLSum-Q4_K_M-GGUF --hf-file mt5_multilingual_xlsum-q4_k_m.gguf -c 2048