LagPixelLOL

v2ray's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cognitivecomputations/DeepSeek-R1-AWQ 8 days ago

update vllm to 0.8.x and meet some trouble

3

#34 opened 9 days ago by

HuggingLianWang

New activity in wassname/qwen-14B-codefourchan 18 days ago

Big L.O.V.E. to YOU <3

2

1

#1 opened 18 days ago by

v2ray

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ 24 days ago

Stuck when run on 8xH100

1

#8 opened 24 days ago by

Thai

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ about 1 month ago

why tokenizer_config.json changed for AWQ model.

2

#7 opened about 1 month ago by

rockcat-miao

Does FlashMLA support kv cache fp8 dtype and how to enable FlashMLA ?

9

#6 opened about 1 month ago by

CharlesLincoln

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 1 month ago

AMD Instinct MI210 + vllm fail to run this model, any solutions please? Is there any other deepseek-r1-671b models that can run succesfully on AMD Instinct MI210 + vllm? Thanks!

5

#33 opened about 1 month ago by

luciagan

New activity in discord-community/WelcomeBot about 1 month ago

test

2

101

#2 opened 3 months ago by

lunarflu

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 1 month ago

How to Resolve "GLIBC_2.32 Not Found" Error When Deploying vLLM Environment?

8

#32 opened about 2 months ago by

lastsummerLi

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ about 2 months ago

Can the 4090 device run this model?

3

#3 opened about 2 months ago by

jinzhongwei

vllm crach with a slightly longer prompt

1

#4 opened about 2 months ago by

rockcat-miao

可以添加一下LICENSE文件吗？

2

#2 opened about 2 months ago by

adol-ch

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 2 months ago

Are there any updates to the recommended commands?

5

#27 opened about 2 months ago by

NaiveYan

Why hasn't the MTP layer of the 61st layer been quantized?

1

#30 opened about 2 months ago by

yang001002

Is there any testing on the support for running on other memory capacities

1

#29 opened about 2 months ago by

HRan2004

Any one can run this model with SGlang framework？

5

#13 opened 3 months ago by

muziyongshixin

DeepSeek-R1-AWQ quantized model missing one layer of experts

4

#28 opened about 2 months ago by

virilo

New activity in cognitivecomputations/DeepSeek-R1-AWQ 2 months ago

About the group size

1

#26 opened 2 months ago by

Skyeaee

The awq quantization model may encounter garbled characters when performing inference on long texts.

9

#24 opened 2 months ago by

wx111

How can I quantify my BF16 format model into AWQ?

1

#25 opened 2 months ago by

AlipaySimon

Support for inference with MTP module?

1

#23 opened 2 months ago by

yhh001