Teach sign language to AI drone

  Рет қаралды 5,843

RobotAndCode

RobotAndCode

4 жыл бұрын

I've added new classes to my existing machine learning model (beside tracking my face) to detect specific sign language alphabet. This allow me to enter different modes (auto-tracking, auto-monitoring & emergency power down) using hand gestures.
Object recognition using YOLO Darknet has never been easier, with ready-baked YOLO-Python wrapper, you can use your favourite (at least mine) Python programming language to perform further processing using Python, OpenCV etc.
3:00 New classes to be trained and their purposes
3:48 Getting the right training dataset
5:26 Create Python program to slice video into images
8:55 Evaluate trained machine learning model via Darknet
9:12 Indoor field testing
10:12 Outside field testing
Top Level Design
docs.google.com/drawings/d/1W...
Install, Training and Use YOLO the easy way
• Easy Installation, Tra...
Source code for simple DJI Tello SDK
bitbucket.org/RobotAndCode/te...
Source code for simple object recognition using YOLO Darknet +
script to slice video into images
bitbucket.org/RobotAndCode/te...
Pascal VOC annotation to YOLO converter
github.com/hai-h-nguyen/Yolo2...
Hardware & Software:
► DJI Tello: invol.co/clo03j
► Ubuntu 18.04: bit.ly/2zLMJGV
► Intel core i3-9100F @ 3.60GHz: invol.co/clo03f
► ZOTAC GTX-1050 @ 2GB: invol.co/clo03d
Recording gear:
► GoPro Hero 5: invol.co/clo03r
► BOYA BY-M1 - Lavalier microphone: invol.co/clo03t
Facebook: / robotandcode
Twitter: / robotandcode
LinkedIn: / murtadha-bazli-tukimat

Пікірлер: 33
@robotandcode1474
@robotandcode1474 4 жыл бұрын
Trained small object detection using YOLO Darknet require deeper understanding on how it works. If you guys interested in YOLO Darknet, sign language detection training may be a good start.
@hannahlambdaa
@hannahlambdaa 3 жыл бұрын
Very good quality work, Thanks a lot for sharing!
@robotandcode1474
@robotandcode1474 3 жыл бұрын
Thanks 😊
@Saeromlife
@Saeromlife 3 жыл бұрын
really helpful. great video. Thanks!
@robotandcode1474
@robotandcode1474 3 жыл бұрын
Thanks 😊
@user-ct4uf8fj7e
@user-ct4uf8fj7e 3 жыл бұрын
Best tello video ever
@robotandcode1474
@robotandcode1474 3 жыл бұрын
Glad to see you enjoy it even though it may not be as high quality as it should be 😅
@aaditghule8401
@aaditghule8401 2 жыл бұрын
Amazing
@paulacamacaro4765
@paulacamacaro4765 2 жыл бұрын
One question, to train the model did you only use the images from your tello camera? Or did you keep the kaggle dataset class and add the images from the tello camera?
@noamamir0942
@noamamir0942 3 жыл бұрын
how did you use your trained model in the code? ive tried with opencv dnn but it wont use my gpu
@robotandcode1474
@robotandcode1474 3 жыл бұрын
I use YOLO Darknet
@bzonemy101
@bzonemy101 3 жыл бұрын
mantop.. pernah try tello untuk buat SLAM dgn ROS tak?
@robotandcode1474
@robotandcode1474 3 жыл бұрын
Yang tu in progress 😊
@noamamir0942
@noamamir0942 4 жыл бұрын
what did you use to detect and put a square on your hand
@robotandcode1474
@robotandcode1474 4 жыл бұрын
Hi, I use YOLO and it detect hand gesture based on trained model. The output is the bounding box and draw it using OpenCV.
@spaceenginerocks2800
@spaceenginerocks2800 3 жыл бұрын
You look like Ravi from hey Jessie
@noamamir0942
@noamamir0942 4 жыл бұрын
can you send the source code of your project?
@robotandcode1474
@robotandcode1474 4 жыл бұрын
You can checkout YOLO darknet by AlexeyAB on github. There is python wrapper example on drawing the box.
@aqeelyusof7413
@aqeelyusof7413 4 жыл бұрын
Robogamez jom hahaha
@robotandcode1474
@robotandcode1474 4 жыл бұрын
Okay je, as long as ada open category :D
@aqeelyusof7413
@aqeelyusof7413 4 жыл бұрын
@@robotandcode1474 kali ni buat bole terbang punye
@xangelcrusadexgaming6807
@xangelcrusadexgaming6807 4 жыл бұрын
boleh buat video pasal extend range dengan wifi repeater selain dari xiaomi wifi repeater x?
@robotandcode1474
@robotandcode1474 4 жыл бұрын
xangelcrusadex gaming ada contoh model wifi extender?
@MartPixChannel
@MartPixChannel 3 жыл бұрын
@@robotandcode1474 buat wifi lagi jauh dan tinggi boleh program ke boss? normal tello boleh 100meter je jauh..tinggi boleh sampai 30meter je.
Improve Drone Flight Time with Ducted Propeller?
6:50
RobotAndCode
Рет қаралды 10 М.
I create AI tracking drone using DJI Tello
17:32
RobotAndCode
Рет қаралды 71 М.
Heartwarming moment as priest rescues ceremony with kindness #shorts
00:33
Fabiosa Best Lifehacks
Рет қаралды 38 МЛН
Smart Sigma Kid #funny #sigma #comedy
00:26
CRAZY GREAPA
Рет қаралды 12 МЛН
Mom's Unique Approach to Teaching Kids Hygiene #shorts
00:16
Fabiosa Stories
Рет қаралды 26 МЛН
FIVE COOL PROJECTS WITH TELLO DRONE
4:16
UiT Narvik - Industrial Engineering
Рет қаралды 19 М.
Connecting to Ryze Tello Drone using Python
11:21
STEAM IT with Steve
Рет қаралды 5 М.
Tello drone and computer vision: selfie air stick
8:56
geaxgx1
Рет қаралды 64 М.
Drone Face Tracking PID using OpenCV Pyhton | Tello (2020) p.2
13:52
Murtaza's Workshop - Robotics and AI
Рет қаралды 17 М.
Voice Activated #Tello #Drone with Python | #176 (Python Drone #4)
14:09
НЕ БЕРУ APPLE VISION PRO!
0:37
ТЕСЛЕР
Рет қаралды 119 М.
Battery  low 🔋 🪫
0:10
dednahype
Рет қаралды 13 МЛН
Rate This Smartphone Cooler Set-up ⭐
0:10
Shakeuptech
Рет қаралды 2,2 МЛН
S24 Ultra and IPhone 14 Pro Max telephoto shooting comparison #shorts
0:15
Photographer Army
Рет қаралды 9 МЛН
Самый тонкий смартфон в мире!
0:55
Не шарю!
Рет қаралды 111 М.