Mask Region based Convolution Neural Networks - EXPLAINED!

In this video, we will take a look at new type of neural network architecture called "Masked Region based Convolution Neural Networks", Masked R-CNN for short. And in the process, highlight some key sub problems in computer vision.
Please SUBSCRIBE to the channel for more content on Machine Learning, Deep Learning, Data Science, and Artificial Intelligence. Hoping to build a community of AI geeks. You'll fit right in!
INVESTING
[1] Webull (You can get 3 free stocks setting up a webull account today): a.webull.com/8XVa1znjYxio6ESdff
REFERENCES
[1] Main paper: arxiv.org/pdf/1703.06870v3.pdf
[2] Code: github.com/facebookresearch/D...
[3] Convolution Neural networks: • Convolution Neural Net...
[4] Semantic segmentation in deep learning: blog.qure.ai/notes/semantic-se...
[5] Top papers: www.arxiv-sanity.com/top?timef...
[6] Recurrent Instance Segmentation: www.robots.ox.ac.uk/~tvg/publi...
[7] Mask R-CNN Presentation by the Author: • Mask R-CNN
[8] Mark Jay's Video: • Mask RCNN with Keras a...
[9] COCO dataset: cocodataset.org/#home
[10] Fully Convolutional Networks: people.eecs.berkeley.edu/~jon...
[11] Faster R-CNN explained: / faster-r-cnn-explained
[12] Notes/summary of Masked R-CNN: www.shortscience.org/paper?bib...
Music at : www.bensound.com/royalty-free...

[@umeshbhati9540]

You explained in a very simpler way. A big thank you from my side. All the best for your upcoming codeEmporium.

[@lukec5838]

Subbed this is a really really well made easy to understand video. Hope to see more from you in the future!

[@kim_monica89]

what a great video!!! great exploration just started learn a computer vision, for me this video is the most understandable

[@rongzhou6498]

Nice explanation especially on the ROI align part! I understood based on your explanation!!! Thanks!

[@jalbouta746]

You explained it really well. Big thank you. But in the recent modification of the the paper, the author changed the FCN to FPN (Feature Pyramid Network).

[@youssefmaghrebi6963]

you explained what all the others didn't. Thanks a lot now all the dots are connected in my mind.

[@fahnub]

bro you're doing such a great job. your videos are so helpful.

[@yiweijia6922]

Thanks for your explanation! It saves me from the complicated explanations of my lecture.

[@hiyamghannam1939]

Thank you so much. Very nice Introduction and Explanation. I understood a lot even though I lack a proper background in computer vision!!

[@CodeEmporium]

Awesome!! Thanks for watching!

[@011azr]

This is great! Please keep on making stuff like this xD.

[@CodeEmporium]

Thanks. Will do. Working on another video on various Convolution Neural Net Architectures. I'll have that up in a few days. It's going to be a new kind of video, but I'd consider it "stuff like this". So stick around :)

[@kabuda1949]

Thanks Man. You are a beast in explaining, everything is perfect.

[@prashanthnvs3719]

Great content and able to understand the concept in a very little time

[@pavithrae874]

Thank you! Simple and clean thought process :)

[@TummalaAnvesh]

Great video, keep rocking.

[@brianthomas9148]

Thank you for this, really good explanation and straight to the point

[@youtubecommenter5122]

This channel is so legit good omg

[@tensorfreitas]

Great Explanation, will follow your videos! Thanks for the share

[@CodeEmporium]

Thanks Tiago Freitas. Glad to know you are on board!

wow boy, this is a REALLY GOOD video. Thanks!

[@DanielWeikert]

Thank you great work! Is there an easy (beginner friendly) explanation how ROI align works?

[@ajajalam6690]

your video is very helpful and to the point.thank you very much

[@lail3344]

Good summary and ROI ALIGN description.

[@theempire00]

Thanks!!!

[@amitprasad26]

Great explanation!

[@s57452]

Awesome. Thanks!!

[@leelavathigarigipati3887]

Great video! Thank you

[@sanjeetkumar7646]

very nice explanation. Thanks

[@zishanahmedshaikh]

Gr8 work dude.Subscribed

[@CodeEmporium]

Thanks !

[@MansaKundrapu]

Great explanation 👍🏻👍🏻

[@yahya89able]

Fantastic

[@mihirichathurikaamarasingh7396]

Very detailed video. Thank you very much.

[@CodeEmporium]

Welcome!

[@user-ml3gu1cc9e]

Great video

[@oliverdeane1003]

Great explanation, thanks a lot! Can I ask what you mean when you say "when computing the mask, a loss of KM squared is incurred" at 6:44?

[@youssefmaghrebi6963]

the time complexity to compute all the masks for M*M region of interest for k possible classes is k*(M)²

[@darasingh8937]

You made this video in 2018! Great job in being so update!

[@CodeEmporium]

Glad this is still relevant :)

[@shonischannel5405]

Very well explained....can you please elaborate the mask branch with pixel values

[@archonsouthpaw8690]

preciate you stay blessed

[@darkside3ng]

Nice work man!!!!

[@CodeEmporium]

Thanks! As long as it's useful!

[@user-or7ji5hv8y]

Excellent video!

[@CodeEmporium]

James Thanks! So glad you liked it !

[@AbhinavKumar-mm1ys]

Nice, You made it look easy!

[@CodeEmporium]

That's what I was going for. Research papers make everything complicated. Why not change that ;)

[@shahriarshakirsumit9258]

At first thank you very much for this video. Your videos quality are very good. I have started to watch your videos. Can you Using Mask RCNN we can detect human class, from that human class can we detect human face ? Then which algorithm will i use to detect face ? Can you please give me some suggestions. And is it possible to use same dataset for human detection along with face detection ??

Thanks! \m/

[@MarkJay]

nice explanation. subbed

[@CodeEmporium]

Thanks Mark! Been following your channel as well. Interesting stuff.

[@MarkJay]

thanks! glad to see more channels making videos on the subject.

[@jodumagpi]

@@MarkJay Quality content creators!!!! Thank you guys!!!

[@VictorVelazquezEspitia]

great vid

[@rahuldeora5815]

At 3:48, how exactly does max pool rotational invariance?? I understand translational invariance but a rotation would make different features activated

[@himanshusrihsk4302]

Please make a video related to visual question answering

[@dev_morgana]

Your video is very good! Ask me a question, what would be the variables or conditions that I should consider when defining the variable STEPS_PER_EPOCH? Because I have a dataset with 50 images.

[@DjKryx]

Steps per epochs is the data size divided by batches, but in a rounded sense: if your batch size was 25, you would have 2 steps, but if your batch size was 24, you would have 3 steps, one for the two images that are leftovers after the batches have been created. And the thing is, there is no "rule of thumb" when deciding the batch size - it is more theoretical, because bigger batches imply that your weights and biases will be updated less often in one epoch so it is easier for your computer to do, but smaller batch sizes contribute to the precision of the model since they act like a regularization. I would go with 25 steps, so batch of two, in your case. I use 64 or 128 when working with millions of inputs. But the great thing is that your small dataset can be made better by using image augmentation - it is a built in tensorflow function for that, it will flip your images at random, rotate them, crop them, making your dataset seem larger than it is because, if you just use the flipping option, your one image can be seen as 4 different images in the input. It is important that, if you are doing segmentation, you apply the same augmentation on your "gold data", or the manually created masks and segmentations that are used as true output, one you compare your predictions to.

[@gianlucabison9330]

Thanks :)

[@muhammadijaz7412]

explain very easy! thanks

[@CodeEmporium]

Anytime

[@inquisitiverakib5844]

very much lucid explanation. I would request you to make a detailed video on the subtopic discussed here ROI,ROI pooling and ROI align

[@CodeEmporium]

Thanks a ton the the compliments. Maybe a future video? I need to motivate it more generally if I’m going to make a video on it. So possibly:)

[@inquisitiverakib5844]

@@CodeEmporium Yes, requesting you to nailed it 😅.

[@manuthvann7560]

that’s impressive 😍

[@CodeEmporium]

It is indeed :)

[@miftahbedru543]

If i want to use pretrained R-CNN for my own dataset to segment ( delineate) background from foerground , do i need to annotated or label my data ? The data i am using if person image ..

[@dexterslab7750]

how to prepare own dataset for this I dont want to use cocodataset thank you

[@shivamsisodiya9719]

Just found another great tutorial on AI

[@CodeEmporium]

Why - thanks for the kind words ;)

[@vannycrispino5566]

Does it apply to orbit semantic segmentation?

[@handdddd2]

At 6:41 what is "analog is 2 a 1 versus rest approach"? Thank you very much.

[@CodeEmporium]

I said "analogous to the One-Vs-Rest approach". It is a method of multiclass classification where we construct K (number of classes) binary classifiers. Each classifier determines whether a sample belongs to class k or not i.e. "one" Vs "the rest". I use it in this context to represent the construction of 3 binary masks (human, dog, cat). Thanks for watching Ha Nguyen! Stick around for more content :)

[@shepearl8782]

Can this masked rcnn be used for overlapping leaves with diseases???

[@muhammadsarimmehdi]

you should explain ROI align in more mathematical detail

[@mridulavijendran3062]

What do you mean by pixel to pixel alignment?

[@HungPham-pg6oq]

Tự động đánh dấu phân biệt sắp xếp vào những người và điểm thường lui tới vào kho

[@undergrad4980]

Kyaaa bat hai

[@rajum9478]

Thank you for explanation how do i save the model ?

[@manuelignacioperezcarrasco6311]

Thank you for the explanation!! Can you share me your slides?

[@ssagonline]

hello can you also explain ho to plot graphs on mask rcnn demos

[@HungPham-pg6oq]

Nhà thông minh của trí tuệ nhân tạo🙂

[@xzxxie3167]

非常好

[@JohnDoe-vr4et]

Isn't Object Detection + Semantic Segmentation = Panoptic Segmentation?

[@user-to9zg3xb3i]

I want to classify body movements. What are your ideas?

[@2parinda]

I'm also in a similar research, if you could found related details please let me know, my email is [e-mail]

[@HungPham-pg6oq]

Đánh dấu địa điểm thường xuyên đến

[@jerrinjoevarghese]

Do u know where I can find a code for it

[@thedrumify]

link in the description

[@RemiDav]

Thank you for taking the time and efforts to make this video. Side note: the creepy whispered "subscribe" at the end of the video has more of a repulsive effect and doesn't really make me want to subscribe (more like making me want to close the video as fast as possible). The positive energy given during the video would probably work a lot better if it were used to ask for subscription too.

[@henrydozie4520]

Can I please get the ppt? Amazing video

[@CodeEmporium]

Thanks! These aren't actually slides. I create these slides in my video editor directly.

[@henrydozie4520]

Very well... thanks for the video.. I had some difficulty completely understanding how ROIalign eliminated mis-alignment.. I understand better now... Thanks

[@CodeEmporium]

Glad it helped! Really sorry I can't help you out with the slides though.

[@henrydozie4520]

its ok.. thanks

[@HungPham-pg6oq]

Thu thập thói quen hành vi người dùng hay đi qua chung một tuyến đường của trí tuệ nhân tạo

[@alejandrocanelo3058]

I love your non indian accent

[@SS-yb1qd]

Don't put ur scary face

[@piyushkumar-wg8cv]

You give very vague overview, no insights into how the training is done and all.