Mark Mealman's picture

24 13

Mark Mealman

Dracones

·

mmealman

AI & ML interests

None yet

Organizations

New activity in Dracones/EVA-LLaMA-3.33-70B-v0.0_exl2_4.0bpw 5 months ago

V0.1 at 4.0-4.25bpw?

#1 opened 5 months ago by

New activity in Dracones/L3.3-Nevoria-R1-70b_exl2_4.5bpw 5 months ago

Quant Request

#1 opened 5 months ago by

New activity in Dracones/Athene-V2-Chat_exl2_3.0bpw 7 months ago

Can you produce a 2.4bpw quantization of this model?

#1 opened 7 months ago by

New activity in Dracones/Llama-3.3-70B-Instruct_exl2_2.75bpw 7 months ago

Perplexity

#1 opened 7 months ago by

New activity in Wi-zz/joy-caption-pre-alpha 11 months ago

Fix for multiple graphics cards

#2 opened 11 months ago by

weights_only=True error

#4 opened 11 months ago by

New activity in NeverSleep/Llama-3-Lumimaid-70B-v0.1 about 1 year ago

feedback

#2 opened about 1 year ago by

New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw about 1 year ago

3.75 please?

#2 opened about 1 year ago by

New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_3.0bpw about 1 year ago

2.75 bpw high EQ bench

#1 opened about 1 year ago by

New activity in Dracones/WizardLM-2-8x22B_exl2_2.5bpw about 1 year ago

Could you help to create the 3.25bpw model so it can fits on A100?

#1 opened about 1 year ago by

New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw about 1 year ago

Can this version be loaded with vllm?

#1 opened about 1 year ago by

New activity in sophosympatheia/Midnight-Miqu-70B-v1.0 over 1 year ago

Question about prompting and System prompt in Vicuna format

#10 opened over 1 year ago by

New activity in Dracones/miqu-1-70b-sf_exl2_2.25bpw over 1 year ago

Update README.md

#1 opened over 1 year ago by

New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_4.0bpw over 1 year ago

Measurments

#1 opened over 1 year ago by

New activity in miqudev/miqu-1-70b over 1 year ago

Any chance anyone is quantizing this into a 2.4bpw EXL2 version for those of us with a single 24GB video cards?

#30 opened over 1 year ago by

New activity in Dracones/Midnight-Miqu-70B-v1.0_exl2_2.24bpw over 1 year ago

3.5bpw request

#1 opened over 1 year ago by

New activity in Dracones/Midnight-Miqu-103B-v1.0_exl2_4.25bpw over 1 year ago

Error

#1 opened over 1 year ago by

New activity in sophosympatheia/Midnight-Miqu-103B-v1.0 over 1 year ago

EXL2 Quants

#2 opened over 1 year ago by

GGUF Quants

#3 opened over 1 year ago by

New activity in sophosympatheia/Midnight-Miqu-70B-v1.0 over 1 year ago

5.0 bpw exl2 quant request

#2 opened over 1 year ago by