Mask R-CNN Practical Implementation

Mask RCNN with Tensorflow2 video link: • Instance Segmentation ...
Implementation of Mask RCNN on Custom dataset.
Explained:
1- How to annotate the images for Mask Rcnn?
2- Train Mask RCNN model
3- Test Mask Rcnn model.
4- Calculate mean average precision (mAP)
5- Confusion Matrix plotted
For any queries: [e-mail]
Github link of used code: github.com/AarohiSingla/Mask-...
#maskrcnn #Objectdetection #MaskRCNN #AI #artificialintelligence #computervision #deeplearning #pifordtechnologies

[@CodeWithAarohi]

This code is tested on Python 3.8.0, tensorflow 2.4.0, keras 2.3.1 and h5py 2.10.0

[@student747]

YOU ARE THE BEST WOMAN IN THE WORLD!)))

[@rupakdey6753]

The explanation from the previous video and the implementation in this video is too good ❤️. Keep up the good work mam ❤️Try to make videos on Big Data too 😊🙏

[@CodeWithAarohi]

Thank you, I will make videos on Big data

[@rajatvardam2787]

Mam your videos are very on-point, easy to understand and implement. Your previous videos helped me as well just like how this video helped me now. You are doing a good work. Thankyou.

[@CodeWithAarohi]

Glad to hear that 😊

[@dariodellamura64]

Hi Aarohi, I have a question to ask: how can the total IOU be calculated for each single class to be predicted? Thanks for your deep learning videos.

[@DeathlessLife786]

Hi Mam, I have completed all steps what u have taught in your tutorial. Actually i want to mask liver from CT image. So I have created two classes for Liver and Spleen using CT image. ( The python is installed in C drive anf my project is stored in the path C:\New_project_mask_rcnn) Finally i got the following in the output window.......... objects: ['liver'] numids [1] objects: ['spleen'] numids [2] objects: ['liver'] numids [1] objects: ['liver'] numids [1] Traceback (most recent call last): File "C:\New_project_mask_rcnn\custom.py", line 167, in dataset_val.load_custom(r'C:\New_project_mask_rcnn\Dataset',"val") File "C:\New_project_mask_rcnn\custom.py", line 103, in load_custom image = skimage.io.imread(image_path) File "C:\Users\HP\AppData\Local\Programs\Python\Python36\lib\site-packages\skimage\io\_io.py", line 48, in imread img = call_plugin('imread', fname, plugin=plugin, **plugin_args) File "C:\Users\HP\AppData\Local\Programs\Python\Python36\lib\site-packages\skimage\io\manage_plugins.py", line 209, in call_plugin return func(*args, **kwargs) File "C:\Users\HP\AppData\Local\Programs\Python\Python36\lib\site-packages\skimage\io\_plugins\imageio_plugin.py", line 10, in imread return np.asarray(imageio_imread(*args, **kwargs)) File "C:\Users\HP\AppData\Local\Programs\Python\Python36\lib\site-packages\imageio\core\functions.py", line 159, in imread with imopen(uri, "ri", plugin=format) as file: File "C:\Users\HP\AppData\Local\Programs\Python\Python36\lib\site-packages\imageio\core\imopen.py", line 161, in imopen request = Request(uri, io_mode, format_hint=format_hint) File "C:\Users\HP\AppData\Local\Programs\Python\Python36\lib\site-packages\imageio\core equest.py", line 248, in __init__ self._parse_uri(uri) File "C:\Users\HP\AppData\Local\Programs\Python\Python36\lib\site-packages\imageio\core equest.py", line 388, in _parse_uri raise FileNotFoundError("No such file: '%s'" % fn) FileNotFoundError: No such file: 'C:\New_project_mask_rcnn\Dataset\val\image1.jpg' ------------------------------------------------------------------------------ In the valitation folder named "val" The image1 is a picture stored in Training folder named as "train". i donot have stored any image with name image1. ------------------------------------------------------------------------------------ How do solve this issue? Please guide me mam...

[@bayualiffarisqi3251]

hai ma'am i have error in may program after training, the error like this UnboundLocalError: local variable 'image_id' referenced before assignment

[@sanjayankali7006]

very neat, clear, and simple explanation.. Keep it up madam

[@CodeWithAarohi]

Thank you so much 🙂

[@anonnymous3440]

Amazing explaination. Super helpful; thank you!

[@CodeWithAarohi]

Glad it was helpful!

[@senthamilselvirajavel]

good evening mam..your teaching is more excellent mam..kindly upload this implementation of mask rcnn in colab platform mam..so that it can very much useful for our students mam...thank you so much for your excellent effort mam..

[@CodeWithAarohi]

Hi, Follow this process to run the code in colab. Just paste this entire code folder in your google drive. Then the code which I wrote in custom.py file, paste it in the colab and run. Make sure to select the GPU from notebook settings. Also, make sure to change the paths in custom.py file code when you paste it in colab. You can ask me queries if you face any problems while running on colab.

[@DeathlessLife786]

A very clear explanation mam.. Thanks a lot...Live long ....

[@CodeWithAarohi]

Glad my video is helpful!

[@laurangome5016]

thank you so much you dont how much you are helping me right now God bless you

[@CodeWithAarohi]

Glad to hear that!

[@alakanandamishra4242]

Thanks Mam for your valuable guidance. I have few queries: 1. I have implemented it as per your steps but test performance is very poor. What should be the training strategy for improved performance? 2. Min. Epochs required on COlab?. How can I run on video?

[@pavaramanupriya4457]

Thank you so much❤ This video helps me a lot to complete my research.

[@CodeWithAarohi]

Glad it was helpful!

[@themlexpert_]

This is a great video illustrating the MRCNN implementation. Currently, im working on a project and im trying to visualize the top masks of random images in my training dataset and the top masks are showing distortion. I went back a few steps to print out the masks in from the for loop of image_ids and i got a bunch of arrays of false as output. Im not sure why im getting false as output.

[@soravsingla6574]

Wow. Very nicely explained

[@CodeWithAarohi]

Glad you liked it

[@eliot2884]

Thanks for the share, but I have a remark On this lines : "assert subset in ["train", "val"] dataset_dir = os.path.join(dataset_dir, subset) annotations1 = json.load(open('D:\\env_with_tensorflow1.14\\all_maskrcnn\\maskrcnn_truck_car\\Dataset\\train\\train_json.json'))" The dataset dir end with '\train' or '\val' but on your 'annotations1' there is only the path to 'train' subset. The problem is that when the subset will be 'val' the image_path = os.path.join(dataset_dir, a['filename']) on line 95 will be incorrect because a['filename'] access to the file names of the train json image and not the val image. So if the filename is image_train.jpg the path would be ''...\\Dataset\\val\\image_train.jpg" but on the val_json there is not train image but only "v1","v2" so there will be an error. So its necessary to change the path of the annotations1 according to the subset.

[@Sandhya_Bytes]

Mam in which file i have to perform preprocessing techniques mam Please reply mam??

[@juanej7]

You're amazing 👏, thank you!

[@CodeWithAarohi]

Happy to help!

[@andianzanulzikra5729]

how to display matrix, and accuracy?

[@ainulhakimbinfizalsabillah4011]

Hi, Madam. That is very informative knowledge to learn step by step using mask rcnn. I wonder, how can i continue or extend the learning epoch. I have following your step but making some adjustment with my own dataset and about 50 epochs. but my result is not fulfill, so i want to extend the training but does not want to start over because my training will take about 6-7 hours. so can you guide me? thanks.

[@fredbaafi9013]

Hi Aarohi, that's a very good explanation, but how do you count the class when you want to detect a car and a number plate? Should one call car as class 1 and number plate as class 2?

[@prodbyryshy]

i might need to implement mask r cnn for 3D image stacks, havent found any good implementations yet, was wondering how hard it would be to achieve this

[@dr.sanjayankali3410]

Thank you mam.. But if I keep different images then during inference mode it shows run time error about as image not found

[@dr.sanjayankali3410]

It works fine only if there are same images in train and Val folder madam

[@arnavthakur5409]

Best KZbin channel / Platform to learn Artificial Intelligence , Data Science , Data Analysis , Machine Learning. #BestChannel #KZbinChannel #ArtificialIntelligence #CodeWithAarohi #DataScience #Engineering #MachineLearning #DataAnalysis #BestLearning #LearnDataScience #DataScienceCourse #AytificialIntelligenceCourse #Codewithaarohi #CodeWithAarohi Code with Aarohi

[@tech4tomorrow]

mam how one can get the train data as images rather than json file. and if I want to add some new classes example glass then how it is possible plz make video on that.

[@harinderkaur8320]

It is showing warning: you are using default load mask(),may be you need to define your own one...repeatedly..plz help

[@BHAUKALEXPERIMENT]

FileNotFoundError: No such file: 'C:\Users\ml\weed detection algorithm\Dataset\val\agri_0_975.jpeg' why it found the same file which is in the train file should ichange the code

[@salmanahmed3938]

please make the video on the HAM10000 dataset for skin lesion that how to import this dataset and use it.

[@sanjayankali7006]

Hello madam, please confirm whether the data in train and validation while creating annotation using VGG annotation should be same or different because i am getting very low detection precision here is the output for detecting KNEE MRI BONE Processing 1 images image shape: (1024, 1024, 3) min: 0.00000 max: 64280.00000 int32 molded_images shape: (1, 1024, 1024, 3) min: -123.70000 max: 64176.10000 float64 image_metas shape: (1, 16) min: 0.00000 max: 1024.00000 int64 anchors shape: (1, 261888, 4) min: -0.35390 max: 1.29134 float32 the actual length of the ground truth vect is : 3 the actual length of the predicted vect is : 3 Average precision of this image : 0.0 The actual mean average precision for the whole images 0.0

[@CodeWithAarohi]

The images used for training is different than the images used for validation

[@angelospapadopoulos7679]

on the mean average precision i get this error: AttributeError: module 'utils' has no attribute 'gt_pred_lists' even though the utils has this attribute, i don't get it!

[@captainofthewhitetower]

How can we show this on like Vscode using python?

[@biplabdas8635]

Ma'am can you tell us where we need to see accuracy in the training

[@MSCAIMLRBRITHANYA]

mam what if i have different json file from each images? how do i train a mask rcnn

[@chun-julee6942]

Great job, Ma'am!!

[@CodeWithAarohi]

Thank you! 😊

[@sanjayankali7006]

one doubt madam, while training the maskrcnn, we have to have same images in train and val folder or different?

[@CodeWithAarohi]

different images for training and validation

[@mrfusion_ad]

Mem one error occurred during execution of train(model) the AttributeError: SGD' object has no attribut How to resolve the issue

[@CodeWithAarohi]

please provide additional context and code related to the error you are encountering

[@deeplearningwithfawadsalam4762]

Hi mam, I want to know how can we compute the feature map of mask rcnn? Any code or help you can give.thanks

[@PremKumar-zb8gt]

if you get long data set how to validation

[@RanjaniAnbalagan-nl4gu]

mam the object that i wanted to detect is not there in pretrained models in that case,how would i get cocoweights?.should i necessarily use coco weights? what would i do otherwise? pls guide mam

[@CodeWithAarohi]

If the object you want to detect is not in pretrained weights then collect images related to your custom object, annotate those images in the format which Mask R-CNN accepts. Then train your model on that custom dataset. You can train in 2 ways- 1- Train the model from scratch. 2- Use pretrained model and then fine tune it with you custom dataset.

[@RanjaniAnbalagan-nl4gu]

Thankyou mam for your concern to take time and reply.one more doubt mam,can i annotate objects after zooming it,,will it cause any performance variation when i use that model in online..can you please tag video on training a model from scratch using mask rcnn.

[@subhajitrakshit9866]

Hi Aarohi, many thanks for the explanation..one thing--> why we need to choose latest epoch? may be your 2nd last epoch or some epoch in middle could give you min loss value compare to all others right??

[@CodeWithAarohi]

Hi, you can choose any weight file as per model performance

[@saadsalmanresearchassociat674]

First of all, thanks for an amazing tutorial. Secondly, when I run the file, I get this error: FileNotFoundError: No such file: 'C:\Users\Saad Salman\Desktop\Mask-RCNN\Dataset\val\angry.8affb600-fe31-11ec-bcdd-b46bfc8af0c1.jpg'. However, this file is in the training folder. I dont know why is it searching for it in the val folder

[@AnumFatima427]

I'm facing the same issue

[@saadsalmanresearchassociat674]

@@AnumFatima427 I pasted a comment referring to a blog that uses Mask RCNN, which was deleted, I don't know why. Using the code from that I solved this issue in my implementation.

[@saadsalmanresearchassociat674]

@@AnumFatima427 I think I cant post links to blogs here.

[@AnumFatima427]

I found a solution from comments and it worked for me, 1. Place Json file in val and train folder with "same name" 2. Give json file path like this: annotations=json.load(open(os.path.join(dataset_dir, 'Json file name')))

[@yesidospitia8990]

Hi, somebody had this error when trying to train the model: "TypeError: cannot pickle 'generator' object ForkingPickler(file, protocol).dump(obj)". I also have this warning "WARNING:tensorflow:Model failed to serialize as JSON. Ignoring... cannot pickle '_thread.RLock'". Thank you a lot.

[@rafif6617]

Hi Aarohi, i have a question. so, from this line: annotations1 = json.load(open('D:\\env_with_tensorflow1.14\\all_maskrcnn\\maskrcnn_truck_car\\Dataset\\train\\train_json.json')) my understanding is that we only use the training annotations. so how do we us the val annotations? or when? because I didn't see it called. Thank you

[@CodeWithAarohi]

You can use if else statement and can call train.json from train and val folder.

[@nasimthander1296]

Here you are using .h5 for model file, will the code be same for the .pkl model file? If not please help me to counter this problem.

[@Sandhya_Bytes]

Mam is there a necessary to do any preprocessing for images if yes in which file I have to do them please reply for this mam

[@CodeWithAarohi]

Proprocessing is important.

[@richasharma5949]

I am getting the following error: File "custom.py", line 77, in load_custom annotations = [a for a in annotations if a['regions']] File "custom.py", line 77, in annotations = [a for a in annotations if a['regions']] TypeError: list indices must be integers or slices, not str

[@THEULTIMATEPRASHANT]

same error, u got any solution?

[@eyeris5812]

@@THEULTIMATEPRASHANT have you found a solution yet?

[@THEULTIMATEPRASHANT]

@@eyeris5812 yes you need to change it to str.. where it accepts as int… it’s mid night in my region and Saturday too.. i will reply in detail on monday

[@eyeris5812]

@@THEULTIMATEPRASHANT Bhai, we might be from the same region, thank you though!

[@chanchan6312]

@@THEULTIMATEPRASHANT how to correct this? Plz help if you know how, thank you so much

[@prudhvinarayana5331]

Hi Aarohi,i am unable to download the class-descriptions-boxable.csv file, train-annotations-bbox.csv file from the command Can u please help me to fix it?

[@CodeWithAarohi]

What is the issue you are facing?

[@vishalpahuja2967]

for setting enviornment can you provide specifications you have used. Thank you.

[@CodeWithAarohi]

python 3.6.8, tensorflow 1.14.0, keras 2.3.0, h5py version 2.10.0

[@BHAUKALEXPERIMENT]

when i run this then keras.engine not found erorrs acurs my tensorflow is 2. version and python is 3.11

[@CodeWithAarohi]

Use oython 3.6.8 and tensorflow 1.14

[@farellfahroziofficial]

hiii mam, My Proggram AttributeError: module 'keras.engine' has no attribute 'Layer' , can you please help me mam?

[@farellfahroziofficial]

I use Tensorflow version 2.2

[@CodeWithAarohi]

Use Tensorflow 1.14 and keras 2.3.0

[@nailashah6918]

Hi Arohi ji I want to ask one thing: If we are annotating images using vgg annotator.It seems applicable for train set images but why to annotate validation set using vgg annotator?It should be now a task of mask rcnn to identify objects and apply mask

[@CodeWithAarohi]

Hello...Training set is used to train the model. We annotate val data because Validation data is used for regularization. It also helps in avoiding the problem of overfitting. It basically estimates the prediction error. Test data is used to evaluate model.

[@developerr4001]

Hi Aarohi maam, I have two classes for which I followed your tutorials on RCNN. I am getting an error: raise FileNotFoundError("No such file: '%s'" % fn) FileNotFoundError: No such file: '/Users/r/Desktop/mrcnn/dataset/val/checkbox_on_1.jpg' In my dataset, I have 66 training data (for 2 classes) and 09 validation data. At the time of execution, the program gives the error. The file, program is looking for, is in the training folder. But it searches for that particular file in the validation folder as well. "checkbox_on_1.jpg' file is only in the train folder, not sure why it is also asking for the same file in tge val folder? How can I solve this?

[@shabirahmed6510]

Hello I had the same problem , just change your subset = "train" and comment these lines # Train or validation dataset? #assert subset in ["train", "val"] dataset_dir = os.path.join(dataset_dir, "train")

[@shabirahmed6510]

this happens because the model is taking val folder always so we just set the subset to train

[@ritusingh6855]

@@shabirahmed6510 how do we resolve this?? I am getting the same error, the images from the train folder is getting checked in the val folder.

[@ritusingh6855]

Try this annotations1 = json.load(open(os.path.join(dataset_dir, 'wee_paddy.json'))) keep the name of the json files in the both train and val folders

[@rafif6617]

i had the same issue, anyone solve this? its like annotations for train applied to the val??

[@madanparajuli9080]

Hi Ma'am, can you provide us the version of tensorflow, keras and python you used for successfully running this code? I did the exact same thing as you mentioned in this video but I am having a error called "ValueError: Tried to covert 'shape' to a tensor and failed. Error: None values not supported."

[@CodeWithAarohi]

I am not sure why are you getting this error. I have to see the code

[@bolzanoitaly8360]

pip install tensorflow == 1.14.0

[@devendrakoribilli7441]

Mam !!! how many images should be trained to get an accurate object detection output to detect grapes?

[@CodeWithAarohi]

The number of images required to train an accurate object detection model for grapes can vary depending on several factors such as the complexity of the grape images, the number of classes to be detected (e.g., green grapes, red grapes), the quality of the images, and the desired level of accuracy. In general, a good rule of thumb is to have at least 400-500 hundred training images

[@filipt8945]

Hello Aarohi, in other implementations to calculate the mAP I have seen that before applying the model.detect function on the image they apply the functions of mold_image from modellib and expand_dims from numpy, to convert the pixel values and to convert the image into only one sample. Using your method I get a higher value of mAP than with the other implementations. Are those steps that I am telling you necessary?

[@CodeWithAarohi]

I am not sure about the other methods which you are talking about as I worked with this method only. And I think the approach we are using to get the mAP is correct

[@altafsarfraz526]

Thanks a lot ma'am for your guidance. Ma'am in your test_truck_car_model.ipynb notebook.... Is the Confusion matrix code In the last cell working correctly?

[@CodeWithAarohi]

Yes, it is working

[@akankshitkumar2095]

indebted to you maam .

[@CodeWithAarohi]

Glad my video is helpful :)

[@namalnshashi923]

Hi, You have given the path to json file of annotation info of training data but json file for validation data is not given. I faced this error and passed separate json files for train and validation data. Now it starts to train Epoch 1 but I cannot see CPU or GPU consumption. Please help.

[@amnasiddiqui1017]

how to pass separate json file for validation data?

[@prashanthabib452]

Hello Mam, Thanks for your good explanation and detailed video. One doubt here : is it necessary that the number of images in the train and val folders be same ? Or in the JSON file? As the "annotations" variable is calculating nubmer of indexes from the train.json file. And i am also getting the error for the same saying that , val.json cannot find some files when number of images are different in train and val folder. However when i careful checked in your video that is not the case. Thanks.

[@CodeWithAarohi]

Number of images can be different in train and val folder. Just have the json file of train and val folder with a same name then use if else condition to read train and val json file

[@nikitamohod7971]

Hello mam You explain the concept of MRCNN so good, It's my request to you plz give the demo of same mask rcnn on any video file.

[@CodeWithAarohi]

Will upload soon

[@fahadulislam863]

Can you please mention the versions u use?

[@DeathlessLife786]

Do i want to generate separate coco weight file for different images like CT, MRI..etc..?

[@CodeWithAarohi]

You need a single json file for all your training images. Ans there can be more than 1 class in your training dataset.

[@DeathlessLife786]

Hi mam, to run custom file i am getting many errors.I have installed python 3.11.0 in my laptop. Which tensorflow and keras are suitable to run code from your github?

[@CodeWithAarohi]

Use python 3.6.8 , tensorflow 1.14 and keras 2.2.5

[@DeathlessLife786]

@@CodeWithAarohi thank you mam...Will try my level best...

[@onewhoflutters4866]

Hi, How can I change the python version to 3.8.0 in google colab?

[@CodeWithAarohi]

Try these commands: !sudo apt-get update -y !sudo apt-get install python3.8 !sudo apt-get install python3.8-dev !sudo apt-get install python3.8-venv

[@gowithgaurav9617]

Hello ma'am, You have explained really well but when we do data augmentation for example flip,or rotate than our original annotations position will also be changed? For example if I annotate a building which is on right side than if we do augmentation of flip than the building will be augmented on left side does the annotation also change its position?how does it work? Please explain

[@CodeWithAarohi]

You can do this : # model.train(dataset_train, dataset_val, # learning_rate=config.LEARNING_RATE, # epochs=600, # layers='heads', #layers='all', # augmentation = imgaug.augmenters.Sequential([ # imgaug.augmenters.Fliplr(1), # imgaug.augmenters.Flipud(1), # imgaug.augmenters.Affine(rotate=(-45, 45)), # imgaug.augmenters.Affine(rotate=(-90, 90)), # imgaug.augmenters.Affine(scale=(0.5, 1.5)), # imgaug.augmenters.Crop(px=(0, 10)), # imgaug.augmenters.Grayscale(alpha=(0.0, 1.0)), # imgaug.augmenters.AddToHueAndSaturation((-20, 20)), # change hue and saturation # imgaug.augmenters.Add((-10, 10), per_channel=0.5), # change brightness of images (by -10 to 10 of original value) # imgaug.augmenters.Invert(0.05, per_channel=True), # invert color channels # imgaug.augmenters.Sharpen(alpha=(0, 1.0), lightness=(0.75, 1.5)), # sharpen images # ] # ))

[@gowithgaurav9617]

@@CodeWithAarohi yes this I know but what I am actually asking is what about the annotation i.e the mask?When for example an image is fliped, will the ground truth polygon from the json file i.e the cordinates for the particular instance in the image also fliped? Because if the image is fliped, then the instance is in another position, right?how to do this? I would appreciate your answer.

[@CodeWithAarohi]

Mask R-CNN does not automatically handle updating the annotations when applying transformations to the images. We have to do it manually. Detectron2 or TensorFlow's Object Detection API, provide functionalities for data augmentation and automatically handle updating the annotations when applying transformations to the images. Below is an example of a custom Python code that uses the popular library imgaug for image augmentation and creates new annotations for the corresponding augmented images in the context of Mask R-CNN. pip install imgaug import imgaug.augmenters as iaa import numpy as np import cv2 # Function to apply horizontal flipping to the image and annotations def flip_image_and_annotations(image, bounding_boxes, segmentation_masks): # Create an augmenter for horizontal flipping flipper = iaa.Fliplr(1.0) # Apply the flip augmentation to the image flipped_image = flipper.augment_image(image) # Get image width for calculating new bounding box coordinates image_width = image.shape[1] # Flip bounding boxes flipped_bounding_boxes = [] for box in bounding_boxes: x_min, y_min, x_max, y_max = box x_min_flipped, x_max_flipped = image_width - x_max, image_width - x_min flipped_bounding_boxes.append([x_min_flipped, y_min, x_max_flipped, y_max]) # Flip segmentation masks flipped_segmentation_masks = [] for mask in segmentation_masks: # Assuming segmentation masks are binary (0 for background, 1 for object) flipped_mask = np.fliplr(mask) flipped_segmentation_masks.append(flipped_mask) return flipped_image, flipped_bounding_boxes, flipped_segmentation_masks # Example usage if __name__ == "__main__": # Load the original image, bounding boxes, and segmentation masks original_image = cv2.imread("path_to_original_image.jpg") original_bounding_boxes = [[50, 100, 150, 200]] # Example format: [x_min, y_min, x_max, y_max] original_segmentation_masks = [np.ones((original_image.shape[0], original_image.shape[1]))] # Apply augmentation and get augmented image, bounding boxes, and masks augmented_image, augmented_bounding_boxes, augmented_segmentation_masks = flip_image_and_annotations( original_image, original_bounding_boxes, original_segmentation_masks ) # Save the augmented image and annotations or use them for training Mask R-CNN cv2.imwrite("path_to_save_augmented_image.jpg", augmented_image) print("Augmented Bounding Boxes:", augmented_bounding_boxes) print("Augmented Segmentation Masks:", augmented_segmentation_masks) In this example, we used imgaug to implement horizontal flipping. You can similarly add other augmentation techniques or combine multiple augmenters from the imgaug library to perform a wide range of data augmentation.

[@biplabdas8635]

Ma'am my training has run successfully but during testing when we take random image the box is not appearing and it is appearing in the whole image so ma'am can you suggest me what I need to do now

[@CodeWithAarohi]

I need more details like how many classes you are working upon? How many images per class you have etc. Mail me all your project details at [e-mail]

[@waleedak6164]

I don't have a GPU on my PC, can you share a video that runs on google Colab?

[@SiddharthaBhaskaran]

the epoch is taking too long any fix for this ??? please reply mam

[@CodeWithAarohi]

Adjust the batch size. Smaller batch sizes may lead to faster training per epoch. And you can also adjust the learning rate. A learning rate that is too high may cause the model to converge slowly or not at all, while a learning rate that is too low may slow down convergence. Experiment with different learning rates to find an optimal value.

[@syedmuhammadraza1779]

Kindly help me from this error .... objects: ['toy', 'person'] numids [5, 1] objects: ['toy'] numids [5] objects: ['person', 'gun'] numids [1, 2] Traceback (most recent call last): File "custom.py", line 196, in train(model) File "custom.py", line 163, in train dataset_train.load_custom('/home/syed/Desktop/Mask-RCNN/DataSet', 'train') File "custom.py", line 94, in load_custom objects = [s['region_attributes']['Labels'] for s in a['regions']] File "custom.py", line 94, in objects = [s['region_attributes']['Labels'] for s in a['regions']] KeyError: 'Labels' When my training is starting I am getting this error. Kindly guide me please

[@CodeWithAarohi]

Check your json file for Labels.

[@Sandhya_Bytes]

Mam I have a doubt actually i am doing a project on landslide detection using mask rcnn ...in this particular video the changes u have done for the custom.py file for the above project are the same changes i have to do for my project also or there are some other to make changes.Please reply mam it would be helpful for me 😊🙏😊🙏

[@CodeWithAarohi]

Same changes

[@Sandhya_Bytes]

@@CodeWithAarohi Thank you soo much mam u are a good teacher and.. this video is very helpful for my academic project

[@Sandhya_Bytes]

@@CodeWithAarohi Mam in which file i have to perform preprocessing techniques mam Please reply mam??

[@CodeWithAarohi]

Glad it is helpful@@Sandhya_Bytes

[@rigvedsanku5128]

Arohi ji, thank yiu for the explaination... How do we proceed if we already have the masked images as our target ?

[@CodeWithAarohi]

Then start by running custom.py file

[@MuhammadRashid-hu3wo]

Hi Arohi, Can you please tell me which Python, tensorflow and keras version you used?

[@CodeWithAarohi]

Here, I have used tensorflow 1.x but if you want to work with tensorflow 2.x then check this video: kzbin.info/www/bejne/h4Gcf59jo9xrb5I

[@kishore3785]

AttributeError: module 'keras.engine' has no attribute 'Layer' can you please help me mam

[@CodeWithAarohi]

Are you running this code on tensorflow 1.14 and keras 2.2.5 ?

[@madanparajuli9080]

@@CodeWithAarohi After running on Tensorflow 1.14 and keras 2.2.5, I am still experiencing another error AttributrError: 'Node' object has no attribute 'output_masks'

[@shreejalmaharjan2001]

@@CodeWithAarohi I am facing the same problem too.

[@unggulprabowo1045]

Amazing sis

[@CodeWithAarohi]

Thanks 😊

[@sravanmudiraj677]

I got data of 30k. what should i do?

[@darkdk20]

My Epoch has be running from 1/20 for pass 5-6 hrs and it could not run till 20/20, i not sure whats the problem

[@sean9734]

same, did you solve this?

[@datasciencewitharbaaz5221]

Which tensorflow and keras version are you using for this particular project, because I am getting problems with versions of tf and keras.

[@CodeWithAarohi]

tensorflow 1.15, keras 2.2.5, h5py 2.10.0

[@datasciencewitharbaaz5221]

@@CodeWithAarohi Thank you mam. and can you please tell us the python version as well.

[@thu-anhtran9787]

Hello, Sorry if this is simple, but I am getting an indexing error "IndexError: index 50 is out of bounds for axis 1 with size 50" on the line mask[rr, cc, i] = 1 in load_mask. Do you have any suggestions on how to fix this? Thank you

[@prashanthabib452]

Hello, i am also getting this error ... Have you figured out this ?

[@addisbelayneh1585]

Hi Aarohi, I have a question to ask:how to lebeling ,detect and classify multiclass in one image using MaskRCNN ?hint,one image has multiclass and also one class has the more than one object so how to leveling them using VIA or how to perpare json file ?

[@CodeWithAarohi]

The Process is same. Just create mask for every object present in that image and Assign class name to every object.

[@addisbelayneh1585]

@@CodeWithAarohi ok thanks madam,but ,how to lebeling more than one object in one class?for example object1,object2 ,object3,....... etc all are lebeling in one class and also class2,class3,.....etc

[@gayathrit.v8844]

what are version used for tensorflow and keras

[@CodeWithAarohi]

This code is tested on Python 3.8.0, tensorflow 2.4.0, keras 2.3.1 and h5py 2.10.0

[@deepalisharma1327]

Mam, I am running the code on MacOS and now getting any file generated under logs folder. Instead, I am getting warning as : I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA. Could you please suggest?

[@CodeWithAarohi]

you can ignore the warning. Warning will stop your code processing

[@deepalisharma1327]

@@CodeWithAarohi I was able to solve the issue. I am not getting any errors but model files are also not getting created under logs folder.

[@pascallapebie326]

Hi Aarohi, Thank you very much for this very useful tuto. Actually, I am facing an issue, the bounding boxes are too small, and I do not know how to extend their limits? If you have any idea... Thank you! PL

[@CodeWithAarohi]

Hi, Thanks for liking my video and you can do the modifications through the visulize.py file which are present in mrcnn folder.

[@abdullahalnakib5150]

Your videos are awesome. Ma'am, I will be really grateful if you make a video about how to set up the environment to run this MaskRCNN with a GPU of nvidia 30 series, Thank you.

[@CodeWithAarohi]

Process is similar as we do for other GPU's

[@Neon-lens]

AttributeError: module 'utils' has no attribute 'gt_pred_lists' when trying to calculate mAP I get the above error. In the file utils.py the function "gt_pred_lists" is missing. Do you have the code for this function?

[@CodeWithAarohi]

Take utils file from this location and copy that missing function in your utils.py file : github.com/AarohiSingla/Mask-RCNN-on-Custom-Dataset-2classes-

[@malusisibiya3330]

Does this work with tensorflow 2.x. I noticed that in your directory the active version of tensorflow is 1.14?

[@CodeWithAarohi]

This code work with tensorflow 1.14

[@lorenzoleongutierrez7927]

Hello Aarohi (perhaps this is some basic, sorry.) . I'm following this and other tutorials and I would appreciate an orientation on how to create the environment for running this code (as the one you use from min 20:00 onwards). I'm searching an (*.yml) file with the specs on the repo... but in can't find it. thanks in advance!

[@CodeWithAarohi]

Install python 3.6.8, then install tensorflow 1.15 , keras 2.2.4, h5py 2.10.0

[@lorenzoleongutierrez7927]

@@CodeWithAarohi Okay, Ill do that , thanks a lot!

[@DeathlessLife786]

Respected mam , today the second time watching this particular video. Can I use this code to detect brain tumor and liver tumor?

[@CodeWithAarohi]

Yes, If you have proper dataset to train then you can use it.

[@DeathlessLife786]

@@CodeWithAarohi Thank You Mam... I will try and give you reply...

[@sudhanshugulhane2004]

Hello mam, I am getting this error when i run the code File "D:\my_file\custom.py", line 17, in from mrcnn import model as modellib, utils File "D:\my_file\mrcnn\model.py", line 255, in class ProposalLayer(KE.Layer): AttributeError: module 'keras.engine' has no attribute 'Layer' could u plz help?

[@CodeWithAarohi]

Try with tensorflow 1.15, keras 2.2.5, h5py 2.10.0

[@sudhanshugulhane2004]

@@CodeWithAarohi okay Mam I’ll try

[@sudhanshugulhane2004]

@@CodeWithAarohi and one more doubt mam, what if the annotations are in coco json format, then is there any code available for it ? Thank you

[@adityask865]

Hello ma,am Amazing tutorial for maskrcnn when i run custom.py i get the following error File "custom.py", line 17, in from mrcnn import model as modellib File "D:\Zipfiles\Editha_tensorflow\mrcnn\model.py", line 255, in class ProposalLayer(KE.Layer): AttributeError: module 'keras.engine' has no attribute 'Layer' can you please tell me the problem?

[@CodeWithAarohi]

Tell me the keras version you are using.

[@adityask865]

@@CodeWithAarohi 2.11.0

[@salmabo3809]

Hi Aarohi, please can you tell me what the tensorflow and keras version you used?

[@CodeWithAarohi]

Use tensorflow 1.14 and keras 2.2.4

[@salmabo3809]

@@CodeWithAarohi thank you

[@manoharnookala4212]

Hi Arohi, at 5:53 minutes, you told we need draw line on object. if i have 1 lac images then do i need to mask all the images or else only for few?

[@CodeWithAarohi]

Yes you have to do annotations for all the images

[@manoharnookala4212]

@@CodeWithAarohi Then how it works in the live video??

[@sangavisivanandham2737]

@@manoharnookala4212 same doubt ... how we can annotate n number of files??

[@bhatiapkaur]

@@sangavisivanandham2737 have you got any solution to this, if i have a large dataset then how to do annotations for all images?

[@devavratpro7061]

Ma'am, tensorflow 1.x has been unsupported by Colab. Will it run on tensorflow 2???

[@CodeWithAarohi]

This code is compatible with tensorflow 1.x. You can downgrade the pip version of colab and then you can install the tensorflow 1.x

[@devavratpro7061]

@@CodeWithAarohi I tried but it is suggesting to update the code on tensorflow 2. Can you please upgrde your code? Thanks in advance.

[@waleedabu-khader5367]

Thanks great work How did you create a separate environment? And my PC doesn’t have a dedicated GPU how can i run the training this way? How did you launch the test model file on jupyter notebook? I downloaded the file but I can’t open it! Kindly help!

[@CodeWithAarohi]

You can set GPU_COUNT in config.py file which is in mrcnn folder . And use tensorflow instead of tensorflow-gpu

[@aminmemar416]

Does mask rcnn supports binary mask as training in json file?

[@CodeWithAarohi]

No

[@aminmemar416]

@@CodeWithAarohi how about RLE json annotation format?

[@subbusainagesh169]

Hi Aarohi, I am getting an error as no module named loggings from model.py file. I have tried to install pip install loggings and logger as well. But the I am still getting the same error. any suggestion on overcoming the error Thank You

[@CodeWithAarohi]

Tell me the tensorflow, keras and h5py version you are using

[@salmabo3809]

Hi Aarohi, I am sorry for all this questions. Please how can I use tensorflow 1.14 with python 3.8?

[@CodeWithAarohi]

Python 3.8 support requires TensorFlow 2.2 or later. If you want to use tensorflow 1.14 then create a seperate environment with python 3.6.8 and then install temsorflow 1.14 on it

[@Lucas-nw7lj]

Thank you for your explanation. I'm executing the test_truck_car_model.ipynb with own datasets. When I want to perform the prediction, which predict images which are not present in dataset, the result showed "No instances to display". Do you have any idea about this error?

[@CodeWithAarohi]

"No instances to display" means objects are not detected. You need to improve your model. Try to increase dataset , epochs

[@Lucas-nw7lj]

@@CodeWithAarohi thanks so much for replying

[@salmabo3809]

Hi Aarohi, please I have an error in load_weights(self, filepath, by_name, exclude), if you have any idea pleaase.

[@CodeWithAarohi]

what is the error

[@sameera3017]

Di can you please update a requirement file , which has every installation version required

[@CodeWithAarohi]

I have pasted a new requirements.txt file with a name of requirements_new.txt github.com/AarohiSingla/Plant-Disease-Detection-Using-Mask-R-CNN

[@sameera3017]

Thanks a lot Di@@CodeWithAarohi

[@CodeWithAarohi]

Welcome@@sameera3017