keremberke/satellite-building-segmentation
Viewer β’ Updated β’ 9.67k β’ 661 β’ 12
How to use Yifeng-Liu/rt-detr-finetuned-for-satellite-image-roofs-detection with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("object-detection", model="Yifeng-Liu/rt-detr-finetuned-for-satellite-image-roofs-detection") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoImageProcessor, AutoModelForObjectDetection
processor = AutoImageProcessor.from_pretrained("Yifeng-Liu/rt-detr-finetuned-for-satellite-image-roofs-detection")
model = AutoModelForObjectDetection.from_pretrained("Yifeng-Liu/rt-detr-finetuned-for-satellite-image-roofs-detection", device_map="auto")Roof detection model for remote sensing imagery, fine-tuned using RT-DETR.
The following example shows roof detections produced by the model:
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model.
Use the code below to get started with the model.
from transformers import AutoModelForObjectDetection, AutoImageProcessor
import torch
import cv2
image_path=YOUR_IMAGE_PATH
image = cv2.imread(image_path)
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model = AutoModelForObjectDetection.from_pretrained("Yifeng-Liu/rt-detr-finetuned-for-satellite-image-roofs-detection")
image_processor = AutoImageProcessor.from_pretrained("Yifeng-Liu/rt-detr-finetuned-for-satellite-image-roofs-detection")
CONFIDENCE_TRESHOLD = 0.5
with torch.no_grad():
model.to(device)
# load image and predict
inputs = image_processor(images=image, return_tensors='pt').to(device)
outputs = model(**inputs)
# post-process
target_sizes = torch.tensor([image.shape[:2]]).to(device)
results = image_processor.post_process_object_detection(
outputs=outputs,
threshold=CONFIDENCE_TRESHOLD,
target_sizes=target_sizes
)[0]
Base model
PekingU/rtdetr_r101vd_coco_o365