
Models
Imageomics Models
Updated • 1Note This is a behavior recognition model for in situ drone videos of zebras and giraffes, built using X3D model initialized on Kinetics weights. It is trained on the KABR dataset, which is comprised of 10 hours of aerial video footage of reticulated giraffes (Giraffa reticulata), Plains zebras (Equus quagga), and Grevy’s zebras (Equus grevyi) captured using a DJI Mavic 2S drone. It includes both spatiotemporal (i.e., mini-scenes) and behavior annotations provided by an expert behavioral ecologist.
imageomics/yolo_beetle_detection
UpdatedNote This model detects beetles and scale bars in images by drawing bounding boxes around the respective items. This model was developed to facilitate downstream applications during BeetlePalooza 2024.
imageomics/butterfly_detection_yolo
UpdatedNote This model takes in images of butterflies as photographed for museum collections and detects butterfly components (L/R forewings, L/R hindwings and body) as well as color checkers and metadata labels.
imageomics/bioclip-2
Zero-Shot Image Classification • Updated • 7.54k • 14Note BioCLIP 2 is a foundation model for biology organismal images. It is trained on TreeOfLife-200M on the basis of a CLIP model (ViT-14/L) pre-trained on LAION-2B. BioCLIP 2 yields state-of-the-art performance in recognizing various species. More importantly, it demonstrates emergent properties beyond species classification after extensive hierarchical contrastive training.
imageomics/bioclip
Zero-Shot Image Classification • Updated • 163k • 51Note BioCLIP is a foundation model for the tree of life, built using CLIP architecture as a vision model for general organismal biology. It is trained on TreeOfLife-10M, our specially-created dataset covering over 450K taxa--the most biologically diverse ML-ready dataset available to date.
imageomics/INTR
UpdatedNote A simple Interpretable Transformer for fine-grained image classification and analysis.
imageomics/bioclip-vit-b-16-inat-only
Zero-Shot Image Classification • Updated • 4Note This model is trained on iNat21, different from BioCLIP which is trained on TreeOfLife-10M.
imageomics/BGNN-trait-segmentation
Image Segmentation • Updated • 2Note This model takes in an image of a fish and segments out traits.
imageomics/Drexel-metadata-generator
Object Detection • UpdatedNote This model was designed to generate metadata for images of [museum] fish specimens. In addition to the metadata and quality metrics achieved with our initial model, this updated model also generates various geometric and statistical properties on the mask generated over the biological specimen presented (examples: convex area, eccentricity, perimeter, skew). The updates to our model further improve on the accuracy, and time and labor cost over human generation.
imageomics/butterfly_segmentation_unet
UpdatedNote This model takes in an image of a butterfly (with or without body attached to wings) and segments out any existing hindwings and forewings, in addition to pictured equipment.
imageomics/butterfly_segmentation_yolo_v8
UpdatedNote This model takes in an image of a butterfly (with or without body attached to wings) and segments out any existing hindwings and forewings, in addition to pictured equipment.