Create FP4 version

by rombodawg - opened 23 days ago

23 days ago

Please create an FP4 version like you did for deepseek R1

9 days ago

Hi, @zhiyucheng , could you please kindly offer some help here? Thanks!

about 20 hours ago

awq quants will be awesome

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment