README.md

---
language:
- en
- ru
- zh
tags:
- summarization
- text2text-generation
- t5
- llama-cpp
- gguf-my-repo
base_model: utrobinmv/t5_summary_en_ru_zh_large_2048
license: apache-2.0
widget:
- example_title: en summ
  text: 'summary: Videos that say approved vaccines are dangerous and cause autism,
    cancer or infertility are among those that will be taken down, the company said.  The
    policy includes the termination of accounts of anti-vaccine influencers.  Tech
    giants have been criticised for not doing more to counter false health information
    on their sites.  In July, US President Joe Biden said social media platforms were
    largely responsible for people''s scepticism in getting vaccinated by spreading
    misinformation, and appealed for them to address the issue.  YouTube, which is
    owned by Google, said 130,000 videos were removed from its platform since last
    year, when it implemented a ban on content spreading misinformation about Covid
    vaccines.  In a blog post, the company said it had seen false claims about Covid
    jabs "spill over into misinformation about vaccines in general". The new policy
    covers long-approved vaccines, such as those against measles or hepatitis B.  "We''re
    expanding our medical misinformation policies on YouTube with new guidelines on
    currently administered vaccines that are approved and confirmed to be safe and
    effective by local health authorities and the WHO," the post said, referring to
    the World Health Organization.

    '
- example_title: en summ brief
  text: 'summary brief: Videos that say approved vaccines are dangerous and cause
    autism, cancer or infertility are among those that will be taken down, the company
    said.  The policy includes the termination of accounts of anti-vaccine influencers.  Tech
    giants have been criticised for not doing more to counter false health information
    on their sites.  In July, US President Joe Biden said social media platforms were
    largely responsible for people''s scepticism in getting vaccinated by spreading
    misinformation, and appealed for them to address the issue.  YouTube, which is
    owned by Google, said 130,000 videos were removed from its platform since last
    year, when it implemented a ban on content spreading misinformation about Covid
    vaccines.  In a blog post, the company said it had seen false claims about Covid
    jabs "spill over into misinformation about vaccines in general". The new policy
    covers long-approved vaccines, such as those against measles or hepatitis B.  "We''re
    expanding our medical misinformation policies on YouTube with new guidelines on
    currently administered vaccines that are approved and confirmed to be safe and
    effective by local health authorities and the WHO," the post said, referring to
    the World Health Organization.

    '
- example_title: en summ big
  text: 'summary big: Videos that say approved vaccines are dangerous and cause autism,
    cancer or infertility are among those that will be taken down, the company said.  The
    policy includes the termination of accounts of anti-vaccine influencers.  Tech
    giants have been criticised for not doing more to counter false health information
    on their sites.  In July, US President Joe Biden said social media platforms were
    largely responsible for people''s scepticism in getting vaccinated by spreading
    misinformation, and appealed for them to address the issue.  YouTube, which is
    owned by Google, said 130,000 videos were removed from its platform since last
    year, when it implemented a ban on content spreading misinformation about Covid
    vaccines.  In a blog post, the company said it had seen false claims about Covid
    jabs "spill over into misinformation about vaccines in general". The new policy
    covers long-approved vaccines, such as those against measles or hepatitis B.  "We''re
    expanding our medical misinformation policies on YouTube with new guidelines on
    currently administered vaccines that are approved and confirmed to be safe and
    effective by local health authorities and the WHO," the post said, referring to
    the World Health Organization.

    '
- example_title: en summ to zh
  text: 'summary to zh: Videos that say approved vaccines are dangerous and cause
    autism, cancer or infertility are among those that will be taken down, the company
    said.  The policy includes the termination of accounts of anti-vaccine influencers.  Tech
    giants have been criticised for not doing more to counter false health information
    on their sites.  In July, US President Joe Biden said social media platforms were
    largely responsible for people''s scepticism in getting vaccinated by spreading
    misinformation, and appealed for them to address the issue.  YouTube, which is
    owned by Google, said 130,000 videos were removed from its platform since last
    year, when it implemented a ban on content spreading misinformation about Covid
    vaccines.  In a blog post, the company said it had seen false claims about Covid
    jabs "spill over into misinformation about vaccines in general". The new policy
    covers long-approved vaccines, such as those against measles or hepatitis B.  "We''re
    expanding our medical misinformation policies on YouTube with new guidelines on
    currently administered vaccines that are approved and confirmed to be safe and
    effective by local health authorities and the WHO," the post said, referring to
    the World Health Organization.

    '
- example_title: en summ big to zh
  text: 'summary big to zh: Videos that say approved vaccines are dangerous and cause
    autism, cancer or infertility are among those that will be taken down, the company
    said.  The policy includes the termination of accounts of anti-vaccine influencers.  Tech
    giants have been criticised for not doing more to counter false health information
    on their sites.  In July, US President Joe Biden said social media platforms were
    largely responsible for people''s scepticism in getting vaccinated by spreading
    misinformation, and appealed for them to address the issue.  YouTube, which is
    owned by Google, said 130,000 videos were removed from its platform since last
    year, when it implemented a ban on content spreading misinformation about Covid
    vaccines.  In a blog post, the company said it had seen false claims about Covid
    jabs "spill over into misinformation about vaccines in general". The new policy
    covers long-approved vaccines, such as those against measles or hepatitis B.  "We''re
    expanding our medical misinformation policies on YouTube with new guidelines on
    currently administered vaccines that are approved and confirmed to be safe and
    effective by local health authorities and the WHO," the post said, referring to
    the World Health Organization.

    '
- example_title: en summ brief to ru
  text: 'summary to ru: Videos that say approved vaccines are dangerous and cause
    autism, cancer or infertility are among those that will be taken down, the company
    said.  The policy includes the termination of accounts of anti-vaccine influencers.  Tech
    giants have been criticised for not doing more to counter false health information
    on their sites.  In July, US President Joe Biden said social media platforms were
    largely responsible for people''s scepticism in getting vaccinated by spreading
    misinformation, and appealed for them to address the issue.  YouTube, which is
    owned by Google, said 130,000 videos were removed from its platform since last
    year, when it implemented a ban on content spreading misinformation about Covid
    vaccines.  In a blog post, the company said it had seen false claims about Covid
    jabs "spill over into misinformation about vaccines in general". The new policy
    covers long-approved vaccines, such as those against measles or hepatitis B.  "We''re
    expanding our medical misinformation policies on YouTube with new guidelines on
    currently administered vaccines that are approved and confirmed to be safe and
    effective by local health authorities and the WHO," the post said, referring to
    the World Health Organization.

    '
- example_title: ru summ
  text: 'summary: Высота башни составляет 324 метра (1063 фута), примерно такая же
    высота, как у 81-этажного здания, и самое высокое сооружение в Париже. Его основание
    квадратно, размером 125 метров (410 футов) с любой стороны. Во время строительства
    Эйфелева башня превзошла монумент Вашингтона, став самым высоким искусственным
    сооружением в мире, и этот титул она удерживала в течение 41 года до завершения
    строительство здания Крайслер в Нью-Йорке в 1930 году. Это первое сооружение которое
    достигло высоты 300 метров. Из-за добавления вещательной антенны на вершине башни
    в 1957 году она сейчас выше здания Крайслер на 5,2 метра (17 футов). За исключением
    передатчиков, Эйфелева башня является второй самой высокой отдельно стоящей структурой
    во Франции после виадука Мийо.

    '
- example_title: ru summ to en
  text: 'summary to en: Высота башни составляет 324 метра (1063 фута), примерно такая
    же высота, как у 81-этажного здания, и самое высокое сооружение в Париже. Его
    основание квадратно, размером 125 метров (410 футов) с любой стороны. Во время
    строительства Эйфелева башня превзошла монумент Вашингтона, став самым высоким
    искусственным сооружением в мире, и этот титул она удерживала в течение 41 года
    до завершения строительство здания Крайслер в Нью-Йорке в 1930 году. Это первое
    сооружение которое достигло высоты 300 метров. Из-за добавления вещательной антенны
    на вершине башни в 1957 году она сейчас выше здания Крайслер на 5,2 метра (17
    футов). За исключением передатчиков, Эйфелева башня является второй самой высокой
    отдельно стоящей структурой во Франции после виадука Мийо.

    '
- example_title: ru summ to zh
  text: 'summary to zh: Высота башни составляет 324 метра (1063 фута), примерно такая
    же высота, как у 81-этажного здания, и самое высокое сооружение в Париже. Его
    основание квадратно, размером 125 метров (410 футов) с любой стороны. Во время
    строительства Эйфелева башня превзошла монумент Вашингтона, став самым высоким
    искусственным сооружением в мире, и этот титул она удерживала в течение 41 года
    до завершения строительство здания Крайслер в Нью-Йорке в 1930 году. Это первое
    сооружение которое достигло высоты 300 метров. Из-за добавления вещательной антенны
    на вершине башни в 1957 году она сейчас выше здания Крайслер на 5,2 метра (17
    футов). За исключением передатчиков, Эйфелева башня является второй самой высокой
    отдельно стоящей структурой во Франции после виадука Мийо.

    '
- example_title: zh summ big
  text: 'summary big: 在北京冬奥会自由式滑雪女子坡面障碍技巧决赛中，中国选手谷爱凌夺得银牌。祝贺谷爱凌！今天上午，自由式滑雪女子坡面障碍技巧决赛举行。决赛分三轮进行，取选手最佳成绩排名决出奖牌。第一跳，中国选手谷爱凌获得69.90分。在12位选手中排名第三。完成动作后，谷爱凌又扮了个鬼脸，甚是可爱。第二轮中，谷爱凌在道具区第三个障碍处失误，落地时摔倒。获得16.98分。网友：摔倒了也没关系，继续加油！在第二跳失误摔倒的情况下，谷爱凌顶住压力，第三跳稳稳发挥，流畅落地！获得86.23分！此轮比赛，共12位选手参赛，谷爱凌第10位出场。网友：看比赛时我比谷爱凌紧张，加油！

    '
- example_title: zh summ to en
  text: 'summary to en: 在北京冬奥会自由式滑雪女子坡面障碍技巧决赛中，中国选手谷爱凌夺得银牌。祝贺谷爱凌！今天上午，自由式滑雪女子坡面障碍技巧决赛举行。决赛分三轮进行，取选手最佳成绩排名决出奖牌。第一跳，中国选手谷爱凌获得69.90分。在12位选手中排名第三。完成动作后，谷爱凌又扮了个鬼脸，甚是可爱。第二轮中，谷爱凌在道具区第三个障碍处失误，落地时摔倒。获得16.98分。网友：摔倒了也没关系，继续加油！在第二跳失误摔倒的情况下，谷爱凌顶住压力，第三跳稳稳发挥，流畅落地！获得86.23分！此轮比赛，共12位选手参赛，谷爱凌第10位出场。网友：看比赛时我比谷爱凌紧张，加油！

    '
- example_title: zh summ brief to ru
  text: 'summary brief to ru: 在北京冬奥会自由式滑雪女子坡面障碍技巧决赛中，中国选手谷爱凌夺得银牌。祝贺谷爱凌！今天上午，自由式滑雪女子坡面障碍技巧决赛举行。决赛分三轮进行，取选手最佳成绩排名决出奖牌。第一跳，中国选手谷爱凌获得69.90分。在12位选手中排名第三。完成动作后，谷爱凌又扮了个鬼脸，甚是可爱。第二轮中，谷爱凌在道具区第三个障碍处失误，落地时摔倒。获得16.98分。网友：摔倒了也没关系，继续加油！在第二跳失误摔倒的情况下，谷爱凌顶住压力，第三跳稳稳发挥，流畅落地！获得86.23分！此轮比赛，共12位选手参赛，谷爱凌第10位出场。网友：看比赛时我比谷爱凌紧张，加油！'
---

# abrosimov-a-a/t5_summary_en_ru_zh_large_2048-Q8_0-GGUF
This model was converted to GGUF format from [`utrobinmv/t5_summary_en_ru_zh_large_2048`](https://huggingface.co/utrobinmv/t5_summary_en_ru_zh_large_2048) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
Refer to the [original model card](https://huggingface.co/utrobinmv/t5_summary_en_ru_zh_large_2048) for more details on the model.

## Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)

```bash
brew install llama.cpp

```
Invoke the llama.cpp server or the CLI.

### CLI:
```bash
llama-cli --hf-repo abrosimov-a-a/t5_summary_en_ru_zh_large_2048-Q8_0-GGUF --hf-file t5_summary_en_ru_zh_large_2048-q8_0.gguf -p "The meaning to life and the universe is"
```

### Server:
```bash
llama-server --hf-repo abrosimov-a-a/t5_summary_en_ru_zh_large_2048-Q8_0-GGUF --hf-file t5_summary_en_ru_zh_large_2048-q8_0.gguf -c 2048
```

Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.

Step 1: Clone llama.cpp from GitHub.
```
git clone https://github.com/ggerganov/llama.cpp
```

Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
```
cd llama.cpp && LLAMA_CURL=1 make
```

Step 3: Run inference through the main binary.
```
./llama-cli --hf-repo abrosimov-a-a/t5_summary_en_ru_zh_large_2048-Q8_0-GGUF --hf-file t5_summary_en_ru_zh_large_2048-q8_0.gguf -p "The meaning to life and the universe is"
```
or 
```
./llama-server --hf-repo abrosimov-a-a/t5_summary_en_ru_zh_large_2048-Q8_0-GGUF --hf-file t5_summary_en_ru_zh_large_2048-q8_0.gguf -c 2048
```