DINOv2 Explained: Visual Model Insights & Comprehensive Code Guide

[@adityapillai3091]

Really good explanation. Would love to see you make more videos. You're very clear and the visual content you present is easily digestible

[@aiape6954]

Thank you! Started at a start-up and it has eaten my time lol

[@adityapillai3091]

@@aiape6954 Start up grind ain’t no joke fr

[@Erosis]

Awesome explanation!

[@pratyushk2693]

Really easy to understand! Thanks!

[@arseniypolyubin7076]

Thanks a lot for this video!

[@零鱼芃]

Amazing work! I really want to know how to decide the cropping parameters based on different datasets. Is it completely based on experience?

[@aiape6954]

The research does not explain any optimization strategies of tuning these parameters, so you have to assume it’s some mixture of intuition and trial and error. I would be interested in applying some evolutionary algorithm to find the best parameter set and see if you can push DINO performance.

[@leeyuguang4424]

How is it different than DINO itself? I wish there's more explanation.

[@elahe4737]

Thank you so much. It was clear and interesting. I have a question please, is it possible to modify the attention maps in this model?

[@aiape6954]

Checkout this repo! I use it all the time. github.com/ShirAmir/dino-vit-features/tree/main

[@VLM234]

that's a great explanation. Are you planning to make a video on the Florence-2 model? I would love to see for livestock use case.

[@mortezasjah6168]

Thank you for wrapping up the code and explanation, does your code support multi node implementation? and is there any difference between your notebook and DinoV2 code?

[@Kofi-qu9zc]

Hi, great video. Had a tangent question, I am trying to use the base pretrained model of DINOV2 from huggingface on the broad institutes BBBC021 dataset of MCF7 breast cancer cells and I'm finding that the CLS embeddings when clustered don't align with the labels (MoA's) in the dataset... Given your experience with DINO, do you think this is due to the cropping strategy used in the pretrained model, and I would have to retrain a bare-bones DINOv2 model on millions of microscopy images to achieve the task of classification correctly? Thanks for any help!

[@DevelopmentTeam-b8x]

well Explained!!

[@vizlifestudios]

thank you!

[@WildWonders7-u9z]

Hello i have a paid project on DINO IBOT and DINOV2 will you help?

[@aesaerthherbo3783]

Amazing explanation, but I think you are just explaining DINO instead of DINOv2.

[@aiape6954]

Everything in this video applies to both. The process was optimized for DINOv2 but the structure remained the same.

[@rickli3746]

I wonder if you think DINOv2 could be applied to CNNs?

[@aiape6954]

My intuition is that it would work but not as well as the transformers. Transformers are slow and computationally expensive but they hold information in a way that CNNs cannot. Probably better off distilling down to a CNN from a transformer.