Fast Segment Anything (FastSAM) vs SAM | Is it 50x faster?

Description:
We compare Segment Anything (SAM) and FastSAM, highlighting their differences in performance and application. We take you through the installation process, inference modes, and deep comparison of these two models, offering insightful observations about their strengths and limitations.
This video serves as a comprehensive guide, packed with valuable resources for FastSAM and SAM, ideal for AI enthusiasts, developers, and researchers alike. Don't miss the opportunity to deepen your understanding of AI, computer vision, and the latest tech breakthroughs!
Chapters:
- 00:00 Introduction
- 01:07 Fast SAM
- 02:10 Installation
- 04:35 Everything Prompt
- 07:36 Box Prompt
- 09:01 Point Prompt
- 09:42 Text Prompt
- 11:05 SAM vs FastSAM
- 13:06 Conclusions
- 15:28 Outro
Resources:
- 🌏 Roboflow: roboflow.com
- 📚 Roboflow Notebooks Repository: github.com/roboflow/notebooks
- 🌌 Roboflow Universe: universe.roboflow.com
- 🗞️How to Use FastSAM blogpost:blog.roboflow.com/how-to-use-...
- 🗞️What is FastSAM? The Ultimate Guide. blogpost: blog.roboflow.com/what-is-fas...
- 🗞️Fast Segment Anything (FastSAM) paper: arxiv.org/abs/2306.12156
- 📓Fast Segment Anything Model (FastSAM) notebook: colab.research.google.com/git...
- 🌌 SA-1B dataset: segment-anything.com/dataset/...
Complementary SAM resources:
- 🗞️How to Use the Segment Anything Model (SAM) blog post: blog.roboflow.com/how-to-use-...
- 🎬 Segment Anything Model (SAM) KZbin video: • SAM - Segment Anything...
- 🎬 Accelerate Image Annotation with SAM and Grounding DINO KZbin video: • Accelerate Image Annot...
Don't forget to like, comment, and subscribe for more content on AI, computer vision, and the latest technological breakthroughs! 🚀
Stay updated with the projects I'm working on at github.com/roboflow and github.com/SkalskiP! ⭐

[@donniezheng9163]

Thank you so much for your hard work! There are all brilliant videos.

[@zappist751]

roboflow is my favorite youtube channel :)

[@Roboflow]

That’s what I wanted to hear 🔥

[@bhaktiras.r]

Thank you for this video❤️, will you pls make a video on speed estimation of vehicle on the road?

[@cyberhard]

Another excellent video and demo.

[@Roboflow]

Thanks a lot! I really try my best this time.

[@muhammadumarsotvoldiev8768]

Thank you very much for yor work, and contribution to open source👍

[@Roboflow]

My pleasure!

[@lengocdatk16_hcm58]

Hi. how can i get results after Segment to txt file to train with yolo ?

[@romanbreyer4291]

great video! is there an existing approach which handles non-complete segmented objects and makes them complete? E.g. segmenting a car, but the back has been covered by another object.

[@nizarelharrouni2351]

Hi piotr, I hope you are doing fine. First I'd like to thank you for your contribution and dedication to the open source community and your innovation. I wanted to ask you regardin S.A.M and the geospatial aspect of it or and deeplearning derived application to the classification of image. Are you familiar or have you tried or have any idea if it is possible to classify different types of buildings ,in my case riyadhs which are a specific type of traditionnal housing in Morocco and other regular buildings, the main goal is to do a time series of the evolution of this type of housing through the years. And if it can be done on GEE (google earth engine ) or just regular collab notebook And finaly if it can be exported as a shapefile. Thank you for your time i hope to hear from you soon and sorry for any inconvenience .

[@TUSHARGOPALKA-nj7jx]

Such a great video. Can you please tell me how to train Fastsam on a custom dataset like Coco or ade20k to also have image classification and detection

[@gexiang471]

Whether to support inference using c++

[@inquisitiverakib5844]

how can we get .json file from this annotated image which will carry the co-ordinates of the polygon mask as text format???

[@jeffersondefaria3476]

up

[@adityashrivastava9183]

Does this work for medical images in TIFF format ?

[@Roboflow]

I’m not sure if it works with TIFF, but personally I would not use this model with medical images. You should aim for top prediction quality not speed optimization.

[@fourier_mourier]

Hi, using several rtx series gpu i found out Fast SAM is almost x100 faster than the original one. Sometimes predictions may seem not so accurate but it's worth noting that, as the authors specified on their github page, fast sam was trained only using 2% of the original sam training dataset. I think many will be ok with such tool working realtime rather than waiting another 20-40 seconds inferencing SAM. How's about yolov8 vs yolo-nas comparison?) testing on my personal datasets has showed yolo-nas was not better than v8 so it would be great if you compare them using different tasks

[@Roboflow]

So you touched on a number of important topics. I think many people will be happy with FastSAM replacing SAM. Like I said for simple scenes FastSAM may be just what you need. 20-40 seconds for SAM inference? I didn't experienced that latency. As for yolov8 vs yolo-nas, you meant pretrained COCO models or fine-tuning?

[@fourier_mourier]

​@@Roboflow I just did inference on a bit higher resolution images so original sam turned out to be too slow As for v8 vs nas i think fine-tuned or trained from scratch will be much cleaner since we can't be actually sure about which data authors used to get their "sota" map values)

[@Roboflow]

@@fourier_mourier same goes for any model. You are never sure about the training process. All you know is the score on COCO. Thats actually one of the biggest problem with model benchmarks...

[@fourier_mourier]

​​​@@Roboflow yeah, so i would be glad if you have time to compare them too: i used some custom datasets of mine and yolo-nas didn't perform any better than v8 despite their claims =/ Maybe rt-detr can be included too - it seems it has now stable training pipeline in ultralytics package

[@atomadeus]

I think using FastSAM to develop a semi-automatic annotation tool is a great idea.

[@samiaghezal]

how to use with MPS

[@Roboflow]

What’s MPS? 🤔

[@samiaghezal]

Metal Performance Shaders from Apple@@Roboflow

[@user-yw6wf3uu1o]

Also handle mobilesam!!!

[@Roboflow]

Not sure if I want us to cover every SAM-based model. Curious why you think MobileSAM is worth takings look?