See github here for usage: https://github.com/ReyaLab/AI_Organoid_Counter

https://reya-lab.org/

We have since updated to this model.

Custom fine-tuned version of NVIDIA's segformer model for colony slides in microscopy.

Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J. M., & Luo, P. (2021). SegFormer: Simple and efficient design for semantic segmentation with transformers. arXiv preprint arXiv:2105.15203. https://arxiv.org/abs/2105.15203

This model takes 512x512 images for segmentation.

The Segformer-Cityscapes model was changed to a ternary classifier and fine-tuned on custom training data, where organoids and necrosis were made as separate masks and then merged with different grayscale values. test12.png Mask_test12.png Mask2_test12.png

After training, it was able to correctly identify organoids and necrosis. example2.png example.png

The python program (see linked GitHub) then uses the masks to annotate the images and provide statistics about the colonies. Group_analysis_results3.png

Downloads last month
5
Safetensors
Model size
47.2M params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ReyaLabColumbia/Segformer_Organoid_Counter

Finetuned
(5)
this model
Finetunes
1 model

Space using ReyaLabColumbia/Segformer_Organoid_Counter 1