ESP32-S3 USB Camera & Audio WebSocket Test: UVC + UAC Data Streaming Demo (ft. WebSocket)

[@achalasamapriya2701]

Awesome next level work. Thank you for sharing the knowledge ❤

[@TrasteIAm]

I need to try this.

[@zhdanvadim9536]

Awesome! Thank you!

[@behzadabf]

wonderful...❤❤

[@SalvatoreRaccardi]

Very interesting video! Have you tried implementing it on the ESP32-P4?

[@ThatProject]

@@SalvatoreRaccardi P4 is a monster. It’s gonna be crazy. 😃

[@maheshmustapure7668]

why there is no main.c file in UVC_UAC_Test_Project/uvc_uac_test

[@ThatProject]

The file name does not need to be main. The uvc_uac_test.c is the main file.

[@maheshmustapure7668]

@ThatProject thank you for replying I got it all together Wifi is connecting but it's not connecting to server Problem is something about timeout Can you please help with it

[@ThatProject]

@@maheshmustapure7668 It seems like you can't connect to the local server after connecting to WIFI. Please check the IP and Port of the local server again.

[@bennguyen1313]

I'm using the EspressIf IDF-IDE, but it doesn't have an example template/project for using websockets.. do you think your project could be ported to work with the IDF IDE? The webserver project template works, but I'd like to now add websockets to push data out. (BTW, 'ESP32 ESP-IDF WebSocket Web Server with LED Control Example' also uses VS-Code/PlatformIO)

[@ThatProject]

Check this out. github.com/espressif/esp-protocols/tree/master/components/esp_websocket_client

[@noweare1]

Excellent, have to look into this. I have been trying to get audio and video using esp32 cameras for image and i2s microphone for audio but audio seems to be my kryptonite

[@ThatProject]

@@noweare1 I tried it too, but it didn't work as I thought.

[@peekpt]

I'm wondering if it's possible to make a wireless USB cable with two ESP32.

[@ThatProject]

@@peekpt On one side, you have an ESP32 with a USB cam connected, and you are getting this image data from another ESP32 through WiFi and outputting it to a connected display?

[@Idontlikethisname-zy3zn]

Hi I have a uvc camera that transfers image 120*160, I tried this code but the 192.168.4.1 just shows constantly one frame of white image every5 seconds, the rest is just dark image. Do you think this is the clock frequency issue or the width must be larger than height? or any other reason? thx

[@ThatProject]

Well, I'm not sure what the root cause is. Before trying this code, it seems like you need to first check whether the image frame is acquired normally from UVC.

[@Idontlikethisname-zy3zn]

@ThatProject yes the potplayer can display the real time video no problem. Never mind, thanks for the video, I just need to debug it somehow.

[@ThatProject]

@@Idontlikethisname-zy3zn Well then, getting images via WebSocket should be no problem either. I suggest you try using UVC only, without UAC.

[@slartybardfast1972]

Once again, awesome work. I notice you say next time you will try with a USB-C breakout. The can you not get the onboard USB-C OTG connector to run the camera?

[@ThatProject]

@@slartybardfast1972 You are right. It works with OTG port. I have devices that don't have this port, so I always connected via GPIO 19/20.

[@AdithyaSurjun]

Can I use esp32 for this project plase reply

[@ThatProject]

Works with ESP32-S2/S3, models with built-in PSRAM.

[@AmanSinghal-ny3ik]

you can actually use this to basically convert any webcam into a wireless IP CAM !

[@sonu8236]

BRO can this project be made with ESP32-WROOM-32 30-pin board Please reply me please

[@ThatProject]

@@sonu8236 Unfortunately this uses the native usb interface supported by S2/S3. ESP32-WROOM-32 cannot do this, but ESP32-S3-WROOM-1 can.

[@brunobilame2528]

Thanks, interesting. I've an old cam unable to work due to unupdated drivers. it may work this way.

[@ThatProject]

@@brunobilame2528 That's great. Before you start, check the USB Descriptors to see what formats are supported.

[@RyanShen-w1m]

I use the same esp32s3 and the C270.But I get the different result. I find that in C270 there are two Speed Configuration Descriptor, one for high speed and one for full speed. I want to know which configuration descriptor do you get in your project. And as I known, esp32s3 can only support full speed, so how can the C270 in your project transfer the right descriptor to capture the pictures. Thanks a lot.

[@ThatProject]

@@RyanShen-w1m I haven't had any issues with the C270 and Espressif specifies the C270 in their examples so I don't think it's an issue with the C270 itself. Did you notice anything different when you checked the device info using the USB Descriptor Dumper Tool as I mentioned in the video?

[@randomhk8634]

Does it record with high frame rate?

[@ThatProject]

@@randomhk8634 It cannot have a high frame rate because it is not made for recording.

[@UnexpectedMaker]

Very cool project - Have you tried a higher resolution UVC camera to see the maximum resolution/fps you can achieve?

[@ThatProject]

The maximum resolution for MJPEG on the C270 camera is 1280x720, but the negotiation failed. The highest resolution I've been able to achieve is 800x600 15FPS.

[@UnexpectedMaker]

@@ThatProject Ok, thanks for the clarification :)

[@YigalBZ]

Nice project. Did you try custom image recognition with it?

[@ThatProject]

Not yet. That will probably be done by another project.

[@vananvo6885]

What is the highest supported image resolution?

[@ThatProject]

The maximum resolution for MJPEG on the C270 camera is 1280x720, but the negotiation failed. The highest resolution I've been able to achieve is 800x600 15FPS.

[@leo940806]

Seems the UVC, UAC project is removed by espressif? When I git clone the repository, there is a readme file in the folder saying that it is removed. Is it a problem they found or other reason? How can you still work on it?

[@ThatProject]

Did you clone esp-iot-solution correctly? It's still there. github.com/espressif/esp-iot-solution/tree/master/examples/usb/host

[@ThatProject]

DId you get this error? ERROR: Cannot establish a connection to the component registry. Are you connected to the internet? URL: components.espressif.com/api

[@muhammedfuatnuroglu3025]

Were you able to figure out the reason?

[@leo940806]

@@muhammedfuatnuroglu3025 do you have the same issue? I did not work on it anymore. I used DVP camera instead

[@muhammedfuatnuroglu3025]

@ I'm trying to figure out whether it is a good idea to connect a USB camera to the ESP32 S3

[@TechInventorAman]

What is UVC ?

[@ThatProject]

@@TechInventorAman UVC stands for USB Video Class, a class of devices that transmit in-stream video over USB. docs.espressif.com/projects/esp-iot-solution/en/latest/usb/usb_device/usb_device_uvc.html

[@xamashee]

Although the processor wasn't design for such applications rather just another Arduino like board for basic stuff with comms, it's fascinating how capable it has turned out to be 🎉

[@UnexpectedMaker]

The S3 was 100% designed for projects like this other high-end "non-Arduino makery stuff" - The maker/tinkerer/dev board community makes up a tiny proportion of the customer base for the Espressif chips.

[@stanissovet9571]

Ничего не видно

[@ThatProject]

What's wrong?

[@stanissovet9571]

@ThatProject need scale text You simple record screen

[@ThatProject]

@@stanissovet9571 I'm always concerned about that. I'll try to make the text more visible.