Inference generation extremely slow
π
1
6
#57 opened almost 2 years ago
by
aledane
Optimizing Mixtral-8x7B-Instruct-v0.1 for Hugging Face Chat
π
2
1
#54 opened almost 2 years ago
by
Husain
SageMaker Deployment Error
12
#53 opened almost 2 years ago
by
seabasshn
killed on Loading checkpoint shards
1
#52 opened almost 2 years ago
by
asmatveev
Playground?
β€οΈ
1
3
#51 opened almost 2 years ago
by
pbourmeau
vectorstore
3
#50 opened almost 2 years ago
by
philgrey

Enable inference API
2
#49 opened almost 2 years ago
by
mrfakename

How to use consolidated.xx.pt?
1
#47 opened almost 2 years ago
by
Wan62
Model not loading and not printing any error message
2
#45 opened almost 2 years ago
by
robotrage
open weights???
2
#43 opened almost 2 years ago
by
alanchan808
Prompt Template for RAG
π₯
1
1
#42 opened almost 2 years ago
by
mox
there is no sliding_window in params.json
1
#41 opened almost 2 years ago
by
Moses25
Question on further fine-tuning
1
#40 opened almost 2 years ago
by
vldvasi
KeyError: 'mixtral' when following the 'run the model' section
π
π
3
2
#39 opened almost 2 years ago
by
obiwan92
Update config.json
#38 opened almost 2 years ago
by
medmac01

sliding_window
π€
5
5
#37 opened almost 2 years ago
by
issa130
Update config.json
#36 opened almost 2 years ago
by
issa130
Fix regression
π
1
2
#34 opened almost 2 years ago
by
TimeRobber
SageMaker generation speed, timeouts
1
#33 opened almost 2 years ago
by
elanmarkowitz
System Prompt Template
π
22
#32 opened almost 2 years ago
by
efei
Update config.json
2
#31 opened almost 2 years ago
by
tourist800

Facing issue while loading model - KeyError: 'mixtral'
7
#30 opened almost 2 years ago
by
swapnil3597

Update README.md
#29 opened almost 2 years ago
by
LPFLEO
Text Generation Inference?
3
#28 opened almost 2 years ago
by
silvacarl

ValueError: Error raised by inference API: Model is overloaded
π
2
2
#25 opened almost 2 years ago
by
alemaooo
Increase `sliding_window` to 32k
1
#24 opened almost 2 years ago
by
alpindale

Intuition for quality decrease after quantization
4
#23 opened almost 2 years ago
by
krumeto
Test Mixtral Model loading ERROR!
3
#21 opened almost 2 years ago
by
ExceedZhang
Discuss benefits of this work
1
#20 opened almost 2 years ago
by
Starlento

Mixtral not generating anything for some prompts
4
#19 opened almost 2 years ago
by
csgxy2022
Inquiry about Generation Speed
5
#17 opened almost 2 years ago
by
Boyue27
Error when deploying sagemaker endpoint: Unsupported model type mixtral
8
#16 opened almost 2 years ago
by
harryneal
GPU requirements
5
#14 opened almost 2 years ago
by
YorelNation

π Torrent File for AI Model Download π
π
4
#12 opened almost 2 years ago
by
Nondzu

How did Mixtral make openchat_3.5 worse?
#10 opened almost 2 years ago
by
JJJJJPSYCHIC
KeyError: 'mixtral'
10
#9 opened almost 2 years ago
by
meetrais

What is the ETA for Mistral-embed? And what is the max token length of this emb model?
3
#8 opened almost 2 years ago
by
kk3dmax
Instruction Template during inference?
7
#6 opened almost 2 years ago
by
jf-11
Min hardware requirements
π
π€
27
16
#3 opened almost 2 years ago
by
narvind2003
