README.md

metadata

license: apache-2.0
base_model: Qwen/Qwen2-VL-7B-Instruct
tags:
  - qwen2-vl
  - weather
  - satellite
  - morocco
  - meteorology
  - adalora
  - fine-tuned

Qwen2-VL Weather Analysis - AdaLoRA

Fine-tuned using AdaLoRA technique for weather satellite imagery analysis.

Model Details

• Base Model: Qwen/Qwen2-VL-7B-Instruct
• Technique: AdaLoRA
• Domain: Weather satellite imagery analysis
• Dataset: Weather satellite images with meteorological metadata

Usage

from transformers import Qwen2VLForConditionalGeneration, Qwen2VLProcessor
import torch

# Load base model
model = Qwen2VLForConditionalGeneration.from_pretrained(
    "Qwen/Qwen2-VL-7B-Instruct",
    torch_dtype=torch.bfloat16,
    device_map="auto"
)
processor = Qwen2VLProcessor.from_pretrained("Qwen/Qwen2-VL-7B-Instruct")

# Load fine-tuned adapter
model.load_adapter("azdin/qwen2-vl-weather-adalora")

# Use for weather analysis...

Training Details

• Technique: AdaLoRA
• Quantization: 4-bit NF4
• Training Data: Weather satellite imagery with metadata
• Target Modules: Attention layers