AI PC: Text Generation - a Intel Collection

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

AurelPx/Pegasus-7b-slerp

Text Generation • Updated Mar 22, 2024 • 26 • 1

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

BAAI/Aquila-7B

Updated Sep 18, 2023 • 1.36k • 18

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

BAAI/Aquila2-7B

Text Generation • Updated Jun 7, 2024 • 359 • 6

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

BAAI/AquilaChat-7B

Updated Sep 21, 2023 • 6.73k • 48

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

BAAI/AquilaChat2-7B

Text Generation • Updated Aug 15, 2024 • 5.84k • 15

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

BigSalmon/GPT2Neo1.3BPoints

Text Generation • Updated Apr 4, 2022 • 140

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

EleutherAI/pythia-1.4b

Text Generation • Updated Jul 9, 2023 • 37.5k • • 23

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

EleutherAI/pythia-12b

Text Generation • Updated Jul 9, 2024 • 14.2k • 135

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

EleutherAI/pythia-14m

Text Generation • Updated Jul 26, 2023 • 169k • 20

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

EleutherAI/pythia-160m

Text Generation • Updated Jul 9, 2023 • 168k • • 29

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

EleutherAI/pythia-1b

Text Generation • Updated Jul 9, 2023 • 59.7k • 35

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

EleutherAI/pythia-2.8b

Text Generation • Updated Jun 9, 2023 • 27.9k • 29

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

EleutherAI/pythia-410m

Text Generation • Updated Jul 9, 2023 • 71.2k • • 22

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

EleutherAI/pythia-6.9b

Text Generation • Updated Jun 8, 2023 • 92k • 50

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

EleutherAI/pythia-70m

Updated Nov 21, 2023 • 70.1k • 63

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

HuggingFaceH4/zephyr-7b-beta

Text Generation • Updated Oct 16, 2024 • 365k • • 1.66k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Intel/neural-chat-7b-v1-1

Text Generation • Updated Jan 15, 2024 • 99 • 23

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Intel/neural-chat-7b-v3-3

Text Generation • Updated Nov 11, 2024 • 63.8k • 78

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/CodeQwen1.5-7B-Chat

Text Generation • Updated Apr 30, 2024 • 3.85k • 325

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen-1_8B

Text Generation • Updated Dec 13, 2023 • 5.77k • 63

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen-1_8B-Chat

Text Generation • Updated Dec 13, 2023 • 9.93k • 111

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen-7B

Text Generation • Updated Jan 4, 2024 • 23.8k • 377

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen-7B-Chat

Text Generation • Updated Mar 19, 2024 • 103k • 761

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen1.5-0.5B

Text Generation • Updated Apr 5, 2024 • 152k • • 152

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen1.5-0.5B-Chat

Text Generation • Updated Apr 30, 2024 • 416k • • 77

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen1.5-1.8B

Text Generation • Updated Apr 5, 2024 • 130k • • 47

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen1.5-1.8B-Chat

Text Generation • Updated Apr 30, 2024 • 12.2k • • 49

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen1.5-4B

Text Generation • Updated Apr 5, 2024 • 8.02k • 35

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen1.5-4B-Chat

Text Generation • Updated Apr 30, 2024 • 44.9k • • 38

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen1.5-7B

Text Generation • Updated Apr 5, 2024 • 121k • 49

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Qwen/Qwen1.5-7B-Chat

Text Generation • Updated Apr 30, 2024 • 26.9k • 165

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Salesforce/codegen-2B-multi

Text Generation • Updated 21 days ago • 2.77k • • 36

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Salesforce/codegen-350M-mono

Text Generation • Updated 21 days ago • 41.2k • • 89

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Salesforce/codegen-6B-multi

Text Generation • Updated 21 days ago • 2.42k • 20

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Salesforce/codegen2-1B_P

Text Generation • Updated 21 days ago • 1.15k • 38

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Salesforce/codegen2-3_7B_P

Text Generation • Updated 21 days ago • 96 • 15

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

Salesforce/codegen2-7B_P

Text Generation • Updated 21 days ago • 515 • 26

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

WizardLMTeam/WizardMath-7B-V1.1

Text Generation • Updated Jan 12, 2024 • 33.2k • 77

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

X-D-Lab/MindChat-Qwen2-4B

Text Generation • Updated Feb 4, 2024 • 41 • 5

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

adept/persimmon-8b-chat

Text Generation • Updated Oct 11, 2023 • 7k • 42

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

baichuan-inc/Baichuan2-13B-Chat

Text Generation • Updated Feb 26, 2024 • 5.28k • 425

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

baichuan-inc/Baichuan2-7B-Base

Text Generation • Updated Jan 31, 2024 • 5.79k • 79

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

baichuan-inc/Baichuan2-7B-Chat

Text Generation • Updated Feb 26, 2024 • 16.8k • 165

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

bigscience/bloom-560m

Text Generation • Updated Sep 26, 2023 • 167k • 351

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

bigscience/bloomz-1b1

Text Generation • Updated May 27, 2023 • 955k • • 33

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

bigscience/bloomz-3b

Text Generation • Updated May 27, 2023 • 11.4k • • 78

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

bigscience/bloomz-7b1-mt

Text Generation • Updated Jan 10, 2024 • 2.75k • 139

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

facebook/opt-1.3b

Text Generation • Updated Sep 15, 2023 • 152k • 164

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

facebook/opt-125m

Text Generation • Updated Sep 15, 2023 • 7.72M • 184

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

facebook/opt-13b

Text Generation • Updated Jan 24, 2023 • 12.8k • 65

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

facebook/opt-2.7b

Text Generation • Updated Sep 15, 2023 • 45k • 82

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

facebook/opt-350m

Text Generation • Updated Sep 15, 2023 • 1.01M • • 134

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

facebook/opt-6.7b

Text Generation • Updated Jan 24, 2023 • 47.2k • 111

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

facebook/opt-iml-1.3b

Text Generation • Updated Jan 26, 2023 • 676 • 29

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/codegemma-1.1-2b

Text Generation • Updated Aug 7, 2024 • 117 • 17

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/codegemma-1.1-7b-it

Text Generation • Updated Aug 7, 2024 • 151 • 49

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/codegemma-2b

Text Generation • Updated Aug 7, 2024 • 4.81k • • 78

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/codegemma-7b

Text Generation • Updated Aug 7, 2024 • 2.54k • 178

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/gemma-1.1-2b-it

Text Generation • Updated Jun 27, 2024 • 108k • • 154

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/gemma-1.1-7b-it

Text Generation • Updated Jun 27, 2024 • 19.7k • • 270

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/gemma-2b

Text Generation • Updated Sep 27, 2024 • 282k • • 969

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/gemma-2b-it

Text Generation • Updated Sep 27, 2024 • 121k • • 706

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/gemma-7b

Text Generation • Updated Jun 27, 2024 • 67.5k • • 3.12k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

google/gemma-7b-it

Text Generation • Updated Aug 14, 2024 • 167k • 1.15k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

ibm-granite/granite-3b-code-base-2k

Text Generation • Updated Sep 2, 2024 • 7.32k • 37

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

ibm-granite/granite-3b-code-instruct-2k

Text Generation • Updated Sep 2, 2024 • 3.73k • • 35

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

ibm-granite/granite-8b-code-base-4k

Text Generation • Updated Sep 2, 2024 • 1.29k • 29

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

ibm-granite/granite-8b-code-instruct-4k

Text Generation • Updated Sep 2, 2024 • 4.38k • 110

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

internlm/internlm2-1_8b

Text Generation • Updated Aug 20, 2024 • 7.96k • 30

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

internlm/internlm2-7b

Text Generation • Updated Aug 20, 2024 • 12k • 41

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

internlm/internlm2-chat-1_8b

Text Generation • Updated Aug 20, 2024 • 4.95k • 31

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

internlm/internlm2-chat-7b

Text Generation • Updated Aug 20, 2024 • 13.9k • 83

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

internlm/internlm2-chat-7b-sft

Text Generation • Updated Aug 20, 2024 • 4.09k • 6

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

internlm/internlm2-math-7b

Text Generation • Updated Aug 20, 2024 • 324 • 27

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

internlm/internlm2-math-base-7b

Text Generation • Updated Aug 20, 2024 • 166 • 2

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

ise-uiuc/Magicoder-CL-7B

Text Generation • Updated Dec 6, 2023 • 107 • 21

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

ise-uiuc/Magicoder-DS-6.7B

Text Generation • Updated Mar 6, 2024 • 248 • 38

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

ise-uiuc/Magicoder-S-CL-7B

Text Generation • Updated Dec 6, 2023 • 150 • 44

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

ise-uiuc/Magicoder-S-DS-6.7B

Text Generation • Updated Mar 6, 2024 • 715 • 202

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

meta-llama/Llama-2-13b-chat-hf

Text Generation • Updated Apr 17, 2024 • 293k • • 1.06k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

meta-llama/Llama-2-13b-hf

Text Generation • Updated Apr 17, 2024 • 89.6k • 588

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

meta-llama/Llama-2-7b-chat-hf

Text Generation • Updated Apr 17, 2024 • 1.28M • • 4.24k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

meta-llama/Llama-2-7b-hf

Text Generation • Updated Apr 17, 2024 • 1.16M • 1.95k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

meta-llama/Meta-Llama-3-8B

Text Generation • Updated Sep 27, 2024 • 535k • 6.04k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • Updated Sep 27, 2024 • 1.78M • • 3.83k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

meta-llama/Meta-Llama-Guard-2-8B

Text Generation • Updated May 13, 2024 • 44.6k • 291

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

microsoft/Phi-3-medium-4k-instruct

Text Generation • Updated Aug 20, 2024 • 38.8k • 216

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

microsoft/Phi-3-mini-128k-instruct

Text Generation • Updated Aug 20, 2024 • 174k • • 1.64k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

microsoft/phi-2

Text Generation • Updated Apr 29, 2024 • 478k • • 3.27k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

mistralai/Mistral-7B-Instruct-v0.2

Text Generation • Updated Sep 27, 2024 • 3.77M • • 2.66k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

mistralai/Mistral-7B-Instruct-v0.3

Text Generation • Updated Aug 21, 2024 • 566k • • 1.39k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

mistralai/Mistral-7B-v0.3

Text Generation • Updated Jul 24, 2024 • 179k • 438

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

mosaicml/mpt-7b

Text Generation • Updated Mar 5, 2024 • 31.6k • 1.17k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

mosaicml/mpt-7b-8k

Text Generation • Updated Mar 5, 2024 • 2.49k • 26

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

mosaicml/mpt-7b-8k-chat

Text Generation • Updated Mar 5, 2024 • 2.15k • 40

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

mosaicml/mpt-7b-chat

Text Generation • Updated Mar 5, 2024 • 95.2k • 512

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

mosaicml/mpt-7b-instruct

Text Generation • Updated Mar 5, 2024 • 15.4k • 469

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

mosaicml/mpt-7b-storywriter

Text Generation • Updated Mar 5, 2024 • 3.11k • 830

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

openai-community/gpt2

Text Generation • Updated Feb 19, 2024 • 17.5M • • 2.58k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

openbmb/MiniCPM-2B-sft-bf16

Text Generation • Updated Sep 7, 2024 • 6.5k • 118

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

openchat/openchat-3.6-8b-20240522

Text Generation • Updated May 28, 2024 • 7.38k • 151

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stabilityai/stablelm-2-12b

Text Generation • Updated Jul 10, 2024 • 615 • 118

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stabilityai/stablelm-2-12b-chat

Text Generation • Updated May 20, 2024 • 4.12k • 88

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stabilityai/stablelm-2-1_6b

Text Generation • Updated Jul 10, 2024 • 6.08k • • 188

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stabilityai/stablelm-2-1_6b-chat

Text Generation • Updated Jun 3, 2024 • 6.56k • 33

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stabilityai/stablelm-2-zephyr-1_6b

Text Generation • Updated Jun 3, 2024 • 16.7k • 182

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stabilityai/stablelm-3b-4e1t

Text Generation • Updated Mar 7, 2024 • 12.6k • • 310

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stabilityai/stablelm-base-alpha-3b

Text Generation • Updated Oct 19, 2023 • 2.77k • 82

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stabilityai/stablelm-tuned-alpha-7b

Text Generation • Updated Apr 19, 2023 • 5.82k • 360

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stabilityai/stablelm-zephyr-3b

Text Generation • Updated Jul 10, 2024 • 8.69k • • 250

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

stanford-crfm/BioMedLM

Text Generation • Updated Mar 28, 2024 • 5.1k • 415

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

tiiuae/falcon-11B

Text Generation • Updated Dec 17, 2024 • 31.6k • 212

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

tiiuae/falcon-7b

Text Generation • Updated Oct 12, 2024 • 84.5k • 1.08k

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

tiiuae/falcon-7b-instruct

Text Generation • Updated Oct 12, 2024 • 163k • • 944

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

togethercomputer/Pythia-Chat-Base-7B

Text Generation • Updated Mar 29, 2023 • 10k • 67

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

togethercomputer/RedPajama-INCITE-7B-Base

Text Generation • Updated Jun 6, 2023 • 2.1k • 93

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

togethercomputer/RedPajama-INCITE-7B-Chat

Text Generation • Updated Jun 5, 2023 • 2.03k • 92

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

togethercomputer/RedPajama-INCITE-7B-Instruct

Text Generation • Updated Aug 9, 2023 • 2.09k • 103

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

togethercomputer/RedPajama-INCITE-Chat-3B-v1

Text Generation • Updated May 9, 2023 • 2.57k • 152

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation

xverse/XVERSE-7B-Chat

Text Generation • Updated Nov 6, 2023 • 228 • 8

Note This model was tested with OpenVINO version 2024.1.0, using the OVModelForCausalLM library with INT4 weight compression for the lowest memory footprint. To convert the model to OpenVINO, follow instructions at: https://huggingface.co/docs/optimum/main/en/intel/installation