AI on the Jetson Nano LESSON 22: Creating ROI (Region of Interest) in OpenCV With Mouse Clicks

[@miloszrzepecki168]

Thank You Paul. Small hint for someone, who wants to drag from any direction without crashing the program: if y1

[@danbishop4035]

"Vanilla Plantation" - Great strategy for the plantation I think you are going to help a lot of people in Africa as your method becomes successful and word spreads. Thanks for all of the knowledge you share and for helping me to look at all of the things around me more closely...you are truly an inspirational man!

[@JSEEngineering]

Great lesson Paul - "Vanilla Plantation" . . . on this note - me and my wife visited La Digue, Seychelles - vanilla plantation under the palm trees, with only OX wagon and bicycles on the island for transport - beautiful and fresh island food.

[@jamespeterson166]

Sounds like the start of a good smoothie too . Thoroughly enjoyed your lesson 22 looking forward to 23

[@TheKverbeeck]

Great lesson Paul, also found the solution for fixing following issues: 1) If x2/y2 > y2/y1 (not drawing the RoI from top left to bottom right) ==> program will crash (2 different fixes) 2) If x2/y2 = y2/y1 (clicking/double clicking/... ==> program will crash (fixed) 3) while drawing the RoI, the rectangle is not showing ==> fixed

[@cnerd]

Hello Paul, love your videos, keep up the great work. FYI this last project you have a few things that will crash ubuntu. It mainly the moveWindow and no mouse move problem. I added didIT and startDOT under mouse click then under goFlag added two more if statements. if event==cv2.EVENT_LBUTTONDOWN: x1=x y1=y goFlag=0 didIT=0 startDOT=1 if event==cv2.EVENT_LBUTTONUP: x2=x y2=y if x1!=x and y1!=y: # if mouse did not move then do nothing goFlag=1 After the mouse click only draw the rectangle and not do moveWindow in the loop it will not crash. I also added didIT and startDOT variable. didIT says only draw rectangle to fix the crash. And also show a startDOT to show where you started the click window. Appears to all be working now SMILE if goFlag==1: cv2.rectangle(frame,(x1,y1),(x2,y2),(255,0,0),3) roi=frame[y1:y2,x1:x2] cv2.imshow('Copy ROI',roi) cv2.moveWindow('Copy ROI',705,0) goFlag=0 didIT=1 if didIT==1: cv2.rectangle(frame,(x1,y1),(x2,y2),(255,0,0),3) if startDOT==1: cv2.circle(frame,(x1,y1),3,(255,0,0),-1)

[@cliffchism9187]

360Rize good job. That was the same problem I was having. You fixed it better than I did.

[@josgrootaers1881]

Thanks again for all the excellent video's and good luck with the Vanilla plantation project.

[@Mircea007]

Hi Paul, great lesson as always. I was too lazy to do the homework so I watched the video. I noticed that the square can only be dragged from top left to bottom right, otherwise the code will crash. So I added three more if statements to re-arrange the coordinates when the rectangle is dragged in any other direction, and booom! it worked ! PS: Vanilla plantation. I did not know about you project in Africa, hope one day I can help others at least as much you do.

[@billkieffer4513]

Bananas and nuts, that's where I would be without your lessons. THANKs AGAIN

[@RayosMcQueen]

I did manage the homework, but struggled more than before. The LBUTTONUP event was unknown to me so I struggled some time to check if LBUTTONDOWN stopped being an active event, which does not seem to be how it worked. I then struggled a little with the weird Column Row Transposition in images, but I got it done. Thanks for supporting my learning.

[@charliestricklin]

got the homework done and then played around some. I can now drag any direction, and just click the mouse. With no drag, I remove the ROI. Great homework assignment!

[@johnganci933]

Nice example. There is one typo that causes "interesting results". At 10:45 in the video, when entering line 10, "glFlag=0" should be "goFlag=0". One other thing: attempting to create the ROI by dragging other than from upper left to lower right (for example, from lower left to upper right) will result in the program terminating. The error message indicates that a "size" value is not positive. This can be fixed by computing minX=min(x1,x2), maxX=max(x1,x2), similar y values, and replacing the "frame=cv2.rectangle...", "roi=frame..." lines using these values.

[@TheKverbeeck]

I fixed the issue like this, will test your solution too. if event == cv2.EVENT_LBUTTONUP: # Mouse left button click (event == 1) print(f"Mouse event was {event}") print(f"X-Pos2: {x}, Y-Pos2: {y}") x2 = x y2 = y # Program will no longer crash because of the switch of x1,y1 and x2,y2 variables !!!! if (x1>x2) and (y1>y2): swapx = x2 x2 = x1 x1 = swapx swapy = y2 y2 = y1 y1 = swapy if (x1y2): swapy = y2 y2 = y1 y1 = swapy if (x1>x2) and (y1

[@TheKverbeeck]

Your solution is also fixing the issue, very cool. while True: ret, frame = cam.read() if goFlag == 1: # Calculate the min and max values, the values of x1/y1 should always be lower than x2/y2 !!!! xMax = max(x1,x2) xMin = min(x1,x2) yMax = max(y1,y2) yMin = min(y1,y2) cv2.rectangle(frame,(xMin,yMin),(xMax,yMax),(0,255,0), 2) roi = frame[yMin:yMax, xMin:xMax].copy() cv2.moveWindow("RoI", 0,532) cv2.imshow("RoI",roi) cv2.moveWindow("piCam", 0,0) cv2.imshow("piCam", frame) if cv2.waitKey(1) == ord("q"): break cam.release() cv2.destroyAllWindows()

[@TheKverbeeck]

Still working on the double mouse click crash issue now.

[@vitaliipylypenchuk]

​@@TheKverbeeck lol i've fixed the issue using the same "swapX"/"swapY" variables (like in Paul's sorting lesson). But it works with only two "if"s: ... if goFlag==1: if x1>x2: swapX=x1 x1=x2 x2=swapX if y1>y2: swapY=y1 y1=y2 y2=swapY for double click issue I think it's possible to solve the problem like this. it also adds frame if you click anywhere just once: defRect=8 (default size of rectangle which will replace 0 value if double click occured) if x1==x2: x2=x1+defRect if y1==y2: y2=y1+defRect PS. i used spacebar for tabulation here, so it wouldn't work by copy-pasting. have to make tabulations manually

[@sous2235]

Banana plantation. This has been a most excellent series, like all your others. I'm getting anxious for the AI portion coming up. Thanks.

[@borisfursov9245]

I have approached lesson 11 and unfortunately paused a bit to solve my camera compatibility with nano. Thank you Paul and good luck with next lessons production!! Looking forward to reach your current number of lesson to be more live in discussion.

[@richardsteward7808]

Hey Paul! I did the homework! It was a really fun exercise, I have the box update in real time as you move the cursor so you can make the box grow and shrink as you move it before you unclick and you get the nice visual reference and you can create the box from any corner not just top left, so you can click and drag the mouse up and left and it will create the box as well, It was great Paul, thank you for these videos, I’m looking forward to your solution and this lesson!~ Also vanilla plantation xD

[@TinFoot]

Another superb lesson - banana-plant/vanilla-bean/macadamia-nut. You are the top banana!

[@vaughntaylor2855]

Paul, I am just getting started on these lessons again since retiring. But yes to show that I am watching the complete video....banana plantation!!!!!

[@GAment_11]

Vanilla Plantation--very thankful for this quality education!

[@opalprestonshirley1700]

Sorry to hear that you've been ill, hope it will pass soon. Now that sounds interesting, bananas, vanilla and macadamia nuts, I had no idea that the vanilla beans and the nuts were that costly. Good luck with that project. The lesson was great getting closer. Thanks Paul.

[@paulmcwhorter]

Thank you for the kind words. This video was made earlier, so I am fine and recovered in a day or two. It is just I made lots of videos that couple days, it will sound like I am stuffy for a while.

[@Gaz964]

Banana plantation: also thats freaking genius that you are able to contribute to the world on a level beyond education. NEXT LEVEL TOP TECH BOY!

[@gplayer01]

Great lesson AND your work in Africa with the Banana plantation is fantastic!!

[@marksholcomb]

got it. Great lesson again. God bless Paul for doing this!

[@marksholcomb]

Banana plantation

[@tretty07]

Banana plantation. Great Lesson, really struggled with the homework, I was almost there,

[@quaternion-pi]

Fascinating, did not realize the vanilla bean flower must be (hand) pollinated within 24 hours of blooming. Maybe use the Jetson to alert you when the flower blooms, and fire the "laser" attachment when the scofflaws come to harvest your exquisite crop ;-) Seriously, you are the archetypal polymath. Thanks.

[@paulmcwhorter]

Constantly thinking about use of technology in 3rd world. Probably lots of interesting possibilities.

[@derekcurry5688]

I really like the vanilla banana plantation idea!

[@roblanham6047]

Love the banana farm, with nuts. Hydroponics fan here. Intelligent farming!

[@sanfinity_]

Finished my homework sir at first it seems noway then I used the paper and pen method and found that it's very easy. Banana Plantation with vanilla plantation, Thanks for this video sir

[@kavacado3517]

[@robjameson7965]

'shamba la vanilla - Asante!'

[@tejobhiru1092]

i was able to do it partially. i did get the display of the ROI in my second window. but the picture in the second window was not moving. now here to see where i had gone wrong. but the moment the picture came in the second window , i was extremely happy with my self !!😆

[@TheJavinhood]

this plantation was a great idea! may be as good as your AI videos :) Thanks Paul!!

[@SH-vv7zq]

Great Vanilla plantation :) - good lesson too

[@filipstojanovicmechanicale9265]

That is some nice banana plantation, i wonder how is vanilla plants now after 2 years when this video has been recorded. I am following this series by improvising on my laptop, and on my homemade gimbal and some cheap WebCam. Thanks for all Paul! I will send you my progress with gimbal when i finish this series.

[@markdion3344]

"Vanilla Plantation" Thank you again

[@paulmeistrell1726]

Banna beans taste like chocolate!!!! Thanks for your lesson.

[@jeraldgooch6438]

Ok - I play. Vanilla plantation with macadamia nut topping. Also tried Mr. Ganci’s suggestion, which seems to work. Thanks

[@SuperAlex5]

Did homework. Great tutorial! Hope you have awesome intelligent banana plantation.

[@jessekloberdanz246]

Thanks Paul. Cool crop staggering! This series is a couple of years old, how is it going? I am going to start a cool desktop experiment using Farmbot.

[@andruwilliams841]

I think instead of coding the multiple click release directions to avoid an error, I will add two and statements: if x1

[@ahmedmk8227]

Done the homework work 👍👍🏻👍🏼👍🏽👍🏾👍🏿 Banana plantation🔥🔥

[@noholdorelse4827]

Hi curious learners! Discovered something interesting. First mouse click in upper left spot, move to lower right spot, release mouse. In other words, from higher point to lower point, left to right. Works as intended. Try first mouse click any place and second mouse release any point higher than first point or any point left to any point right . My code crashes! Interesting challenge to figure out how to fix that.

[@ricardobjorkeheim775]

great lesson...thanks Paul! but it was very difficult to perform the assignment, I got error all the time.

[@bertbrecht7540]

Got the homework to work on my own and I ran into all the issues you did plus some. Looking forward to the Machine Learning. How many more weeks until that? Vanilla Plantation

Vanila Banana! (I feel like a minion from Gru!)

[@michelangelo2465]

Paul, nice video. When I did the home work. Aren't nuts picked by vibrating the tree with a machine? Is there room for that in your bananna farm?

[@paulmcwhorter]

In Africa everything is done by hand. Very little mechanization. Good way to give people jobs

[@jalopyjones6460]

BANANA! only concern that may arise would be the amount of nutrients in the soil required for 3 different species, in a confined area, might bode poorly for crop production.... good idea tho, let me know if it worked or appears to be going as planned...

[@andreasschiller4687]

Vanilla plantation. Thanx, it was delightful.. ;-)

[@matthewjohnson2497]

Thoroughly enjoying working through this series, love the banana plantation idea too, how do you find time for all this stuff?

[@paulmcwhorter]

Thank you for the kind word, and good question. I do all the the things I do because I do not waste time on silly useless things. So, I dont have a TV in my house, dont watch sports or movies or play video games. I am deliberate in how I spend my time. I spend my time making things, growing things, designing things, fixing things building things, teaching things and stuff like that. I spend my time DOING not WATCHING

[@matthewjohnson2497]

@@paulmcwhorter I fully agree Paul, there is nothing but junk on TV anyway, better to be an active participant in life rather than just a spectator. Keep up the good work and thankyou for these extremely valuable tutorial sessions.

[@matthewjohnson2497]

I'd just like to add...and thanks to your fantastic Arduino tutorials which greatly helped me understand the principles of Arduino programming I have started a small blog documenting some of my little projects, I have only recently started it but would you mind taking a look when you get 5 mins.This is no way any form of promotion and I dont earn anything from it, I just do it because I enjoy it... Appreciated, thankyou www.clockanddata.com

[@kennytrinh3415]

I store position into a list of tuple, make the code a little cleaner, but losing some readbaility. And from reading other comments. I just realized the app will crash if we crop upward. Learned something new

[@marklewis2736]

Hi, thanks for the great content. I've noticed in the example shown in lesson 21 the rectangle remains after the roi is selected, however in lesson 22 it disappears? Finally, what is the benefit of: frame = cv2.rectangle(...... vs cv2.rectangle(...... B.Rgds Mark

[@cepwin]

Vanilla plantation with bananas. see my content at the end of the live comments...it reminds me of "The Omnivore's Dilemma" where a farmer in Swope, VA. combines and rotates livestock so the sustain/clean up after each other without antibiotics, etc. Thank you for the lesson!

[@Diamond_Hanz]

nuts, banana , vanilla

[@irakandjii2496]

Vanilla Plantation ... la la ... I tried the homework and had to stop, I tried to find a way to draw the rectangle in real time and display what I was going to select. I noticed the video motion would stop whenever the mouse was moving. I discovered the EVENT_MOUSEMOVE was generated whenever the mouse was moving in the window and was interrupting the while loop. I spent a lot of time, too much time actually, trying to get around this. Came here and discovered your example also froze the video, so I was chasing a dead horse. Still curious how to suppress the mouse events.

[@geeksatlarge]

LOL That's in interesting pyramid scheme you got there, nuts and bananas. No coffee?

[@paulmcwhorter]

I am growing coffee bushes, just not among the banana, nuts and vanilla. It is a seperate plot.

[@normb2780]

Hi Paul: I thought I accomplished the same thing as you until I saw your roi image move as it tracked the main video. My roi's turn out to be like roi.copies that are no longer "live" but more like snapshots. The reason for that is that I put the formation of the roi, the showing of the roi and the moving of the roi window all in the LBUTTONUP event. Here's what my call back function looks like. It works fine and every time I do another mouse click over a different part of the frame a new "roi" image takes the place of the old one, but once again they are all just copies, not live regions of interest. def grab_roi(event,x,y,flags,param): global ix,iy if event == cv2.EVENT_LBUTTONDOWN: ix,iy = x,y if event == cv2.EVENT_LBUTTONUP: roi=frame[iy:y,ix:x] cv2.imshow('ROI',roi) cv2.moveWindow('ROI',650,0)

[@ThomasPalowitchSr]

A very nice and concise solution to the problem. Thank you

[@MarioTalavera]

Vanilla plantation in a comment! Cheers.

[@envirotoxicologistordeq4337]

Love the vanilla and banana plantation. Say. There us a new version of jetson nano out. Should I buy the new one or stick with old version for your series?

[@paulmcwhorter]

I dont really see a reason to upgrade at this time . . . still so much to learn of just the basics of AI

[@railcat7083]

"banana plantation" Am enjoying these lessons. Homework well-designed for hands-on learning experience. I would like to experiment with this code using an IMX477 camera. What changes would be needed in our "camset" line? Clearly maximum width can be 4032 and height 3040. How can I test for acceptable combinations of size and frame rate? Have you done a video on this camera?

[@fclooi]

Hi Paul, banana tree produces fruit once, then I think it stay 'barren' unless it is chopped and regrown.

[@cliffchism9187]

Paul, I’m still going through the code to see if i did something wrong. Just wondering if you are seeing problems with multiple runs of the program. Seems to be some issue with garbage collection maybe. If i draw multiple boxes or quit the run normally with q command, next run crashes big time. Like i said, it may be something on my end. Still looking.

[@wayneswan3092]

So, obviously there's a pretty big market for the banana nuts at $20 a pound? Anyway, I've been spotting your mistakes like crazy! Don't feel bad, I make more mistakes than usual when I'm sick too! Ironically enough, as I sit here working my way through these videos about a year later than they were put out, I too am sick! PS, I did do the homework assignment, and I was successful in doing it on my own. However I ended up with a box around the POI, not just a new window with the POI. Cool tip, If I flip my image to mirror me before I display it, I can't do my mouse functions on it. I have to display the original frame in order to draw on it before I can flip it and display it in a new window. Weird huh?

[@alpertemizel9892]

Where I live, summers are hot and winters are rainy. Can I grow vanilla too?

[@bertbrecht7540]

The Jetson Nano has a CPU and a GPU. Is there a simple program that would do a matrix multiplication on the CPU and then on the GPU to show the big speed improvement?

[@amitjaiswal9054]

How many tutorial has for Arduino Please ans me In that only 45 episode has been showing

[@AlanHeigl]

bannanas and great lesson

[@donthomas9669]

You seem to have your vanilla plantation all figured out. It looks to be a lucrative business in 5-7 years.

[@Sebastian-yl5vz]

Vanilla Plantation!

[@weipengwang9960]

vanilla/banana plantation! Hi Mr Paul, would you do a list of videos introducing your home in Africa, that will be very eye opening! Thank you for your great contents

[@JSEEngineering]

I've combined 20 elements, lines and a circle - how to group these elements as one object (group)

[@r1rmndz507]

Vanilla Plantation.I wonder how are the banana trees right now.

[@tdcau1luis]

Thank you for your tutorials! #Vanilla plantation.

[@davewesj]

Most excellent indeed!, ( Banana )

[@JoachinYnchausti]

vanilla plantation....thank you for the tutorials.

[@AlanHeigl]

banana plantation is very nice

[@MagDag_]

Hi Paul! What do you think about a new version of Jetson Nano ?

[@paulmcwhorter]

Not sure what you are referring to

[@Mystic0Dreamer]

@@paulmcwhorter The new Jetson Nano is basically identical to the original with the exception that it has two camera connectors instead of just one. It's also the same $99 price. The idea is that you can then work with 3D graphics and Stereo Vision. Other than the extra camera connector I don't think there are any other differences. But don't hold me to that. Check the NIVIDIA site for the details. I almost forgot: Banana plantation, vanilla fudge, and twenty-dollar-per-pound nut trees. *smile* Yep, I'm watching everything like a A.I. Jetson-Nano-lov'in freak. :)

[@MagDag_]

@@Mystic0Dreamer Yes, It's still packs a Maxwell GPU with 128 cores, but version 4.3 of its Jetpack software now supports TensorRT 6.01 and cuDNN 7.6.3.

[@AppieBing]

Banana plantation: as before i got the theory right like the if statements with the coords and the rectangle part, but the rest i just couldn't come up with , like the global, goFlag and the roi.....i hope it will sink in over time

[@irwinlopez1692]

vanilla BANANASSSS

[@balooleffe]

vanilla/banana plantation cheer !!

[@epixexplorations]

vanilla plantation!!, thanks for the awesome vid

[@TheRealFrankWizza]

If you release the left button without dragging, it crashes.

[@uvatham]

Is your date is correct ? 59 days for premier

[@paulmcwhorter]

Understand one video from this series is released each week, on Satuday. I have to build them ahead as I have time.

[@liamharding6538]

Vanilla Plantation. :-)

[@MrVacia]

banana planatation!!!!!!!

[@victorwilliams5131]

I try the homework but i had issues tiring to make it work correctly

[@charliestricklin]

Don't go bananas, but I think the rectangle should be in the frame instead of the ROI

[@thomasboosinger5403]

Thank you! banana plantation

[@pralaymajumdar7822]

Banana plantation...great work instead of your cold and calf.

[@CRAZYELON]

Vanilla Plantation

[@robertharrie6464]

Me and my dog loves bananas ;-)

[@G8YTC]

Vanilla even

[@codecage9333]

Banana or Vanilla Bean Plantation

[@lilgator1580]

banana/vanilla plantation.

[@tejobhiru1092]

vanilla plantation !!!!

[@craigrotay3732]

banana plantation

[@itsmeintorrespain2714]

Vanilla plantation

[@cliffchism9187]

Banana plantation

[@mehulchowdary5305]

Vanila Banana!

[@ricardobjorkeheim775]

banana plantation

[@cujino]

Vanilla plantation

[@G8YTC]

Banana plantation

[@badger5821]

banana plantation