21 4 14

cicdatopea

cicdatopea

AI & ML interests

None yet

Recent Activity

new activity 4 days ago

kaitchup/QwQ-32B-AutoRoundGPTQ-4bit:Qwen-32B overflow issue

new activity 4 days ago

kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit:how to run this model

updated a model 5 days ago

OPEA/Llama-3.3-70B-Instruct-int2-sym-inc

View all activity

Organizations

cicdatopea's activity

New activity in kaitchup/QwQ-32B-AutoRoundGPTQ-4bit 4 days ago

Qwen-32B overflow issue

#1 opened 10 days ago by

cicdatopea

New activity in kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit 4 days ago

how to run this model

#1 opened 4 days ago by

cicdatopea

New activity in deepseek-ai/DeepSeek-V3-0324 6 days ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

#19 opened 6 days ago by

xueshuai

New activity in OPEA/DeepSeek-V3-int4-sym-awq-inc 7 days ago

without licence

#2 opened 7 days ago by

Futureli

New activity in OPEA/DeepSeek-R1-fp8-static-w8a8-inc 10 days ago

how to inference this model?

#1 opened 10 days ago by

xiximayou

New activity in OPEA/gemma-3-27b-it-int4-AutoRound-cpu 11 days ago

so consider build a model for GPU?

#1 opened 11 days ago by

New activity in kaitchup/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit 25 days ago

Your quants are not listed in the base model

#2 opened about 1 month ago by

dazipe

New activity in OPEA/DeepSeek-R1-int4-gptq-sym-inc about 1 month ago

VLLM 0.7.2 can start the model normally, but there is no output when simulating a request using Curl, it blocks!

#2 opened about 1 month ago by

JZMALi

sglang inference issue

#1 opened about 1 month ago by

su400

New activity in OPEA/DeepSeek-V3-int4-sym-awq-inc about 2 months ago

Start on cpu with vllm.

#1 opened about 2 months ago by

kuliev-vitaly

New activity in Intel/Qwen2-7B-int4-inc 2 months ago

“a larger accuracy drop in Chinese tasks"? how much exectaly?

#1 opened 2 months ago by

chuangzhidian

New activity in OPEA/DeepSeek-V3-int4-sym-gptq-inc 3 months ago

A bug when running the demo inference on GPU

#5 opened 3 months ago by

HuggingLianWang

vllm

#4 opened 3 months ago by

NikolaSigmoid

Base model please!

#2 opened 3 months ago by

deltanym

New activity in OPEA/deepseek-vl2-int4-sym-gptq-inc 3 months ago

ValueError: Invalid modules, at least two modules detected as dependent, {shortest_module} and {longest_module}

#3 opened 3 months ago by

Maverick17

New activity in OPEA/DeepSeek-V3-int4-sym-gptq-inc 3 months ago

engine

#3 opened 3 months ago by

ehartford

New activity in OPEA/DeepSeek-V2.5-1210-int4-sym-inc 3 months ago

alternative serving framework

#1 opened 3 months ago by

erichartford

New activity in OPEA/deepseek-vl2-int4-sym-gptq-inc 3 months ago

Update README.md

#1 opened 3 months ago by

n1ck-guo

New activity in kaitchup/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit 3 months ago

suggest fill the base model of metadata UI in model card

#1 opened 3 months ago by

cicdatopea

New activity in OPEA/Qwen2.5-3B-Instruct-int4-sym-inc 3 months ago

STOP

#1 opened 3 months ago by

sdyy