New discussion

SageMaker Deployment Error

12
#53 opened almost 2 years ago by
seabasshn

killed on Loading checkpoint shards

1
#52 opened almost 2 years ago by
asmatveev

Playground?

❀️ 1
3
#51 opened almost 2 years ago by
pbourmeau

vectorstore

3
#50 opened almost 2 years ago by
philgrey

Enable inference API

2
#49 opened almost 2 years ago by
mrfakename

How to use consolidated.xx.pt?

1
#47 opened almost 2 years ago by
Wan62

open weights???

2
#43 opened almost 2 years ago by
alanchan808

Prompt Template for RAG

πŸ”₯ 1
1
#42 opened almost 2 years ago by
mox

Question on further fine-tuning

1
#40 opened almost 2 years ago by
vldvasi

Update config.json

#38 opened almost 2 years ago by
medmac01

sliding_window

🀝 5
5
#37 opened almost 2 years ago by
issa130

Update config.json

#36 opened almost 2 years ago by
issa130

Fix regression

πŸ‘ 1
2
#34 opened almost 2 years ago by
TimeRobber

System Prompt Template

πŸ‘ 22
#32 opened almost 2 years ago by
efei

Update config.json

2
#31 opened almost 2 years ago by
tourist800

Update README.md

#29 opened almost 2 years ago by
LPFLEO

Text Generation Inference?

3
#28 opened almost 2 years ago by
silvacarl

Increase `sliding_window` to 32k

1
#24 opened almost 2 years ago by
alpindale

Test Mixtral Model loading ERROR!

3
#21 opened almost 2 years ago by
ExceedZhang

Discuss benefits of this work

1
#20 opened almost 2 years ago by
Starlento

Inquiry about Generation Speed

5
#17 opened almost 2 years ago by
Boyue27

GPU requirements

5
#14 opened almost 2 years ago by
YorelNation

KeyError: 'mixtral'

10
#9 opened almost 2 years ago by
meetrais

Instruction Template during inference?

7
#6 opened almost 2 years ago by
jf-11