Raghav

raghavgg's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Qwen/Qwen3-30B-A3B-GPTQ-Int4 about 16 hours ago

VLLM Load Error

2

#2 opened about 20 hours ago by

raghavgg

New activity in nytopop/Qwen3-30B-A3B.w8a8 12 days ago

Issue in using it with VLLM

#1 opened 12 days ago by

raghavgg

New activity in Qwen/Qwen3-30B-A3B-FP8 15 days ago

Remove vLLM FP8 Limitation

2

#2 opened 15 days ago by

simon-mo

New activity in microsoft/Phi-4-mini-instruct 2 months ago

[Bug]:Phi-4-Mini giving garbage outputs with torch 2.5.1 and vllm==0.7.3 with multiple parallel requests on Long context prompts #14058

5

#11 opened 2 months ago by

raghavgg

[Bug]:Phi-4-Mini giving garbage outputs with torch 2.5.1 and vllm==0.7.3 with multiple parallel requests on Long context prompts #14058

5

#11 opened 2 months ago by

raghavgg

Bug: with continuous batching with vllm

3

#6 opened 2 months ago by

raghavgg

authored a paper 5 months ago

Alignment For Performance Improvement in Conversation Bots

Paper • 2406.18954 • Published Jun 27, 2024

updated a dataset 8 months ago

raghavgg/smoothquant-dataset

Updated Sep 9, 2024 • 4