Video Data Processing with Python and OpenCV

[@boseashish]

I dont but if I had this much knowledge that you have, I would not have made a video. This makes you a greater human and a generous professional. Thanks for helping us folks out

[@AlbertLau-jp6xq]

Man, your video is really a life-saver for me. I am currently working on a video streaming project which requires me to do a lot of video processing. However, I had zero knowledge on doing any video data processing. I had spent almost ten weeks on figuring out how to do the video processing in my project but was still struggling with it. I did a lot of researches and tried to code it, but still did not make any progress eventually. When I was in despair and really deemed that I was not able to complete my project anymore, I found this video and watched it. This is the greatest explanation I had ever found on video processing and OpenCV explanations. Literally, no one has not talked about this in such a clear manner, but you did it. At the end, I managed to complete my coding and obtain a basic result for my project, just using one day. You are such a legend! And I hope you can keep going. All the best!

[@deltax7159]

just started using Kaggle notebooks and it is my absolute favorite free data science environment to work in. Lightening AI is also quite good, and offers cloud-based VScode IDE to do work in. Its free offering is almost identical to Kaggle notebooks. Really great videos Rob. I love the way you pace things and explain along the way why you are import specific libraries and what they will be used for. A lot of other tutorials online tend to skip over some of these things which creates confusion.

[@linuxmill]

it was beautiful watching a quaestion get so quickly converted quantitaive analysis that is easily visualized.

[@robmulla]

Glad you liked it. Thanks for watching and let me know if there is anything I can do better.

[@AndrewBerry-uo3hy]

Great video! Even after 2 years this video slaps. Thanks!

[@pavlostsoukias8147]

Our Data professor is back !!

[@robmulla]

Haha. I'm just trying to create content about things I find interesting and I hope people will learn from!!

[@VauRDeC]

This video saved my week-end ! Thank you so much for it !

[@ddjLai-b5e]

Thank you! You explained very clearly on the code and how you did it. ❤

[@DataCraftsman]

Love your work as always. You should do a follow up video on using a neural network to do the labeling. I imagine it would just be some sort of CNN that outputs the coordinates for the box using the bounding pixels of the detected shapes.

[@RobertMulla]

Thanks! Great minds think alike. My next video will be a quick introduction to object detection using yolov5 and I run it on this dataset.

[@DataCraftsman]

@@RobertMulla Awesome! Looking forward to it.

[@vaijrb]

Very well done! Thank you for making this video.

[@robmulla]

Glad it was helpful! If you know of anyone who might learn from it please think about sharing the link.

[@zacharydube4890]

absolutely sick video, super informative. ty

[@DerZeroHero]

Would be very nice to include the download and setup of the ffmpeg package around 6:05 before using it.

[@vivekpadman5248]

This is absolutely a great tutorial for beginners. Learnt a lot and the way you explain is soo perfect. I'd definitely share it with my friends. Can you if possible make video on complete kaggle project walk through and how you approach the problem?

[@robmulla]

Awesome, thank you for the feedback. Please do share it with friends and/or on platforms that you think people might learn from it. I actually recorded a video walking through a kaggle competition but never released it. I do have a competition starter guide video you should check out.

[@ThanhHa-zo7lp]

Great work. Nice perform. Many thankss for sharing!

[@robmulla]

Many thanks!

[@CarolinaMunoz-vy3ni]

I haven't watched it but I already like it

[@robmulla]

Thanks Carolina! Let me know if you have any feedback once you have a chance to watch.

[@CarolinaMunoz-vy3ni]

@@robmulla thanks!

[@LeoSo]

Thank you for the tutorial! I'm interested in processing and analyzing sport video using Python. Google brought me here. I like the presentation in kaggle. Keep up your good work. I will check out all your videos!

[@robmulla]

Thanks so much for the feedback. I’m glad you found this helpful. Please share the link with anyone else you think might find it helpful.

[@sharau.99]

Great explanation! Keep it up 👍

[@miodice3]

really neat overview thank you

[@pleasedont2270]

Me too on my first page man, good luck

[@robmulla]

Love it. Hopefully it shows up for more people!

[@radodo69]

Can you make table from the metadata? If we can do it, it is probably easier to analyze and doing EDA with it if we needed to

[@wooprime3482]

Ooooh, this appeared on my KZbin front page, are you gonna finally pop off?

[@robmulla]

Fingers crossed! 😅 - Thanks for commenting and (hopefully?) watching too.

[@nkrumahminsinga1541]

Thank you for this exercise, it was very helpful but please how am i supposed to do if i don't have labels datasets or how can i buid it? thank you

[@vijayalaxmiise1504]

Thank you so much sir. It would be great help if you release some videos on Action Recognition, Detection , Classification in video

[@robmulla]

Noted! Have you seen my video on object detection?

[@MrEck95]

Hey thanks for the very insightful video, if I wanted to train a model with video data, do you have any recommendations on the simplest way to generate the csv file of labels and data for the segmented objects we want to annotate?

[@scullyy]

This seems like what I need to get rid of flickering in my video! First I'd need to automate detecting a completely black frame (responsible for the flickering) and then copy paste the nearest valid frame (one that isn't black) onto the black frame. Wish me luck :)

[@AbtihalAlomairi]

That's a great video! Thank you. But, step five ( Total number of frames in video) whenever am trying to run the code I got an error saying that module 'cv2' has no attribute 'cv2'. Although , I've download all the datasets

[@LesterMoran-y6u]

Wow amazing thank you

[@upendrad6081]

Where did you got the annotation label dataset CSV?

[@andrewl.4277]

Legend has it he's still getting to the fun part. (alright and now to the fun part....3 min later....alright and now to the fun part) jokes. awesome video

[@youmnaification]

I know this video is 2 years old. But how did you get the annotation video data.?

[@Az-jt2zp]

So did someone go in manually and identify the labels and draw the frames?

[@nisheethsrivastava8345]

Hi Rob I am New to the video processing and the video is very helpful. I wondering that how did you get the csv file for video so that category of the images could be built. I need to use this method to create the labels. I am using Wowza streaming server to stream the video to the analytics application where i have to capture the stream & read the stream. I am stuck at category of objects. please let me know how it can be used

[@RichardGreco]

What are the parameter sizes for width and height? Seems arbitrary you choose 500 or 700. Why not 5000? What does the number refer to. I have the same question for matplotlib plot sizes.

[@robmulla]

Great question. I think the height and width you are referring to is with the IPython display module. I found the documentation about it and this value just relates to the html height and width: github.com/ipython/ipython/blob/master/IPython/core/display.py#L1109-L1115 I believe this is just the number of pixel values displayed in the website. I might have not been clear about it, but this is different than the actual video image resolution, it's only for displaying the video in the notebook. Hope that helps!

[@RichardGreco]

@@robmulla Thank you. You were clear about the actual video resolution. I thought the answer would have been more arcane, but as always, the answer is in the documentation!

[@fenfire3824]

Hi, i am looking for some libraries or even frameworks on how i can find graphical items on my screen, like you can do in Auto it. E.G. if you play a video game and you want to automate pressing buttons or keys. I did it in the past in Auto It but I don't like Auto it that much and would like to do the same in Python maybe. Or even Java or C#. Is it the same as object tracking? Is OpenCV the right library for that? My problem is, it is difficult for me to find the correct documentary or tutorials because the whole topic is quite new for me and i don't know all the terminology. I am also not english, i can speak english very well, but it makes researching more difficult. Could you give me some hints on what i have to look for? It is not object tracking in video or images, it should me tracking from screen capturing. I would like to do lots of stuff with it just to learn it. Maybe something like a simple bot who can play a fighting game or a click bot for simple games. Just to learn the basics.

[@yoonseokheo9487]

Thanks for your amazing work sharing. I have a question about annotation. As far as I know, you have mentioned that the frame index(frameIndex) should be transformed with respect to the video frame. So you set the value as 11.9 . I want to know how to calculate the value. Thanks in advance. + I am just wondering if you have any plans of "fiftyone" package which is also an interesting toolkit for vision datsets.

[@robmulla]

Not sure I exactly follow your question. But I need to look into that package and might make a video.

[@yoonseokheo9487]

​@@robmulla Thanks for answering my comment, and let me clarify my question. In the video(19:08), You add another column named "video frames" by transforming the column named "frameIndex" multiplied by 11.9. I am confused about the reason for multiplying the value(11.9) and how the value is set up.

[@ghadadodo3865]

Could you give us the link of the video sir? And thanks for this video ✅

[@ChezChicago]

Impoet does not work in window command line. Where are you entering the import statements in Windows?

[@robmulla]

Import? I’m using Linux. But you could try in colab or a Kaggle notebook.

[@ChezChicago]

input_file = ‘.\\ANYFILE.mov’ ## Actual file name subprocess.run([‘ffmpeg’,’-i’,input_file,’-qscale’,’0’, ‘026c7465-309f6d33,mp4’]) ERROR: Traceback (most recent call last): File "", line 2, in File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.7_3.7.2544.0_x64__qbz5n2kfra8p0\lib\subprocess.py", line 488, in run with Popen(*popenargs, **kwargs) as process: File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.7_3.7.2544.0_x64__qbz5n2kfra8p0\lib\subprocess.py", line 800, in __init__ restore_signals, start_new_session) File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.7_3.7.2544.0_x64__qbz5n2kfra8p0\lib\subprocess.py", line 1207, in _execute_child startupinfo) FileNotFoundError: [WinError 2] The system cannot find the file specified

[@stephenkolostyak4087]

you can't thread the rectangles?

[@maxy9095]

How to find videos full RGB values

[@magnuswootton6181]

how do you make it look like a movie?

[@robmulla]

Sorry, I'm not understanding your question.

[@aomo5293]

Hi Thank you for the great video. Total frames is 2393. On each 100 frame you displayed 1 image. That s why you have 2393%100=24 images If i want to extract 30 images I should do 2393%80 Is it true?

[@robmulla]

I think you might be right now I’m not completely sure.

[@aomo5293]

@@robmulla thank you.

[@igorekudashev]

AttributeError: module 'cv2' has no attribute 'cv2'

[@robmulla]

What version of cv2 are you running? I think the imports changed in one of the releases.

[@phillipchananda]

Try to use remove one cv2 inside the get function like cap.get(cv2.CAP_PROP_FRAME_COUNT)

[@mohammadkheder8994]

I can know if Vehicle is empty or not by camera in paython

[@SiliconSchematics]

I did nt understand how it recognises the objects

[@eaduction9901]

how to label annatations in csv file

[@upendrad6081]

Same question. How he got the CSV?

[@anuranjith2002]

I have a genuine doubt.....how do you know each and every code and you run every one of them without any errors....how did you learn coding in such a manner?

[@sriram-xp5sg]

Ever heard of video editing

[@newstodayyt1]

No pytesseract used here

[@robmulla]

I have a video about detecting text in images where I use it!

[@newstodayyt1]

@@robmulla nope do video ocr video pls

[@jackkelly4277]

I live in that neighborhood!!! So weird

[@jl2696]

Is there any way to install OpenCV through conda-forge? That's what I mainly use instead of Pip