mariozupan/zephyr-support-chatbot
Updated
Mario Zupan
mariozupan
·
AI & ML interests
None yet
Recent Activity
replied to
leonardlin's
post
13 days ago
My weekened project ended up being doing some testing between torchtune, axolotl, and unsloth. I *think* it's a 1:1 comparison of what LoRA fine-tuning performance looks like between the different hardware I have in my dev boxes (4090, 3090, 7900 XTX, W7900) with a few other interesting tidbits.
Tonight I wrote up a WandB report (the panel editor is super broken in Firefox 😔) that sums up some of the more interesting bits from the results: https://wandb.ai/augmxnt/train-bench/reports/torchtune-vs-axolotl-vs-unsloth-Trainer-Comparison--Vmlldzo4MzU3NTAx
liked
a model
2 months ago
WizardLMTeam/WizardMath-7B-V1.1
liked
a model
2 months ago
TheBloke/WizardMath-13B-V1.0-GGML
Organizations
None yet
models
1
datasets
None public yet