FlowerTune Medical LoRA Model

This is a LoRA adapter for meta-llama/Llama-3.1-8B-Instruct fine-tuned with Flower federated learning framework on medical NLP datasets.

Model Performance

  • PubMedQA: 0.5994
  • MedMCQA: 0.6940
  • MedQA: 0.5994
  • CareQA: 0.5774
  • Average: 0.6175

Training Details

  • Domain: Medical
  • Training method: Federated LoRA fine-tuning with FlowerTune
  • Framework: Flower

This model is a LoRA adapter fine-tuned on meta-llama/Llama-3.1-8B-Instruct using the Flower federated learning framework. It was trained on medical NLP datasets through distributed learning. The model achieved scores of PubMedQA: 0.5994, MedMCQA: 0.6940, MedQA: 0.5994, CareQA: 0.5774, with an average score of 0.6175.

Links

Downloads last month
87
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for zjudai/flowertune-medical-lora-llama-3.1-8b-instruct

Adapter
(890)
this model

Collection including zjudai/flowertune-medical-lora-llama-3.1-8b-instruct