Unreal Engine 5 and ROS2: A Powerful Combination for Robotics Simulation

[@roboage1027]

If you like my content, you can support my channel. I will greatly help me to develop more interesting projects 😀 To support channel: PayPal:www.paypal.com/donate/?hosted_button_id=XHXABEQL94444 Patreon:www.patreon.com/robo_age Buy me a coffee: bmc.link/roboage21Y

[@ВладШевченко-ц7т]

Very cool! I was waiting for the second part. Thanks a lot!

[@HereIsLuo]

Oh my god! It's so cool! Thank you, looking forward to your next video!

[@roboage1027]

Thank you 😊!

[@keepfighting8402]

Tank you for the video!

[@ВладШевченко-ц7т]

Thanks, good video

[@yuier2883]

Best Tutorial, Thanks

[@msuegajnriorpenda9745]

Really cool video! I have plans on using unreal engine for its photorealism too. What Ubuntu version did you install your Ros humble on. Did you use Ubuntu 22 or Ubuntu 20? Thanks for the great content!

[@roboage1027]

Thank you for your comment. I use Ubuntu 22

[@mescalinum]

Very nice! Thanks for sharing. I would have used a simple messaging system similar to ROS, like ZeroMQ which is available to a lot of languages. The use of shared memory segments looks a bit tricky and low level.

[@vikavr5641]

Very nice 🎉🎉🎉

[@KillerRobotz]

this is amazing !

[@WTBLOUU]

Very cool!!!! But how did you add the camera? I couldn't find it in the previous videos.

[@roboage1027]

Thank you for your comment! I use uscenecapturecomponent2d as a camera. Its just an ordinary component which you can add to actor class and place it wherever you want.

[@AzharKhan-cy5kt]

Do you have github where is all the libraries if i want to experiment with it?

[@hasanozfidan8208]

do you using any plugins for ROS. For example rclUE ?

[@hydrawq]

amazing content! i have a doubt is it possible to make Barcode scanner in unreal engine, like ingame Like how we do using ROS and gazebo?

[@kot2905]

Цікаве рішення! Просто і ефективно.

[@roboage1027]

Дякую!

[@martinkaras775]

Amazing! Does this solution support headless mode? I want to capture photorealistic environment with my agent (reinforcement learning).

[@roboage1027]

Yes, I believe. Unreal engine redefines all standard C++ libraries. So I suppose, this solution should work in headless mode too.

[@phantomside]

how can you use camera path data in unreal to to execute to actual robot

[@nospamarinointhechatarino4247]

Why do you use gazebo as physics engine in UE5? UE5 has physics engine itself doesn’t it?Sorry that I’m new to ROS, but want to build the environment to simulate robotics in UE5.

[@roboage1027]

I'll certainly try Unreal Engine's built in physics engine in future videos . I don't know, which one is better actually. Thank you for your comment.

[@enstein_industries]

what is in the visibility control

[@svitlana1367]

Video is very good 👍 Tank you 🇺🇦

[@Mr30friends]

Did you experiment with sockets at all before going with the shared memory solution?

[@roboage1027]

No. What are the advantages?

[@Mr30friends]

@@roboage1027 In my non-expert opinion, sockets are probably easier for beginners and better for separating everything into distinct components. So I am thinking of using them to achieve something similar to your application. But your solution looks pretty straight forward too so now you got me wondering... I am mostly asking in case you had actually tried them but they didn't work for you. Then it would be good to know what their shortcomings were compared to shared memory.

[@roboage1027]

@@Mr30friends Thank you for advice! Let me know, how your solution will work. I actually don't stick to shared memory only. I just wanted to setup communication between Unreal Engine and ROS somehow without dealing with third party library integration.

[@Mr30friends]

@@roboage1027 I'll stay in touch. Awesome channel by the way.

[@pruthviraj_mane]

Thank you. Can we implement existing ROS-Gazebo (ros1) simulation into the UE5 world ?

[@roboage1027]

I think you should recreate your gazebo world in unreal engine

[@pruthviraj_mane]

@@roboage1027 thanks for response. Also can Unreal5 send images to ROS1 over Rosbridge or any other tool ?

[@roboage1027]

@@pruthviraj_mane No, I belive. There was rosbridge plugin for UE4. It doesn't work in UE5. Probably it is possible to write new one. But writing plugins for UE is pain in a bud in my opinion.

[@reinzler4090]

Thanks for video, can u please share your GitHub rep with this project?

[@samidjennane5133]

Hello thanks alot for the video, just wanted to ask a question, should i be a pro at unreal engine 5 (C++) to use it for robotics simulations, or just learning the basics with blueprints will be enough to build complex simulations, ps: bare in mind that i will integrate everything with ros2,

[@roboage1027]

Hi! Thank you for your comment. I think you should be quiet proficient in Unreal Engine. And I'd advise you to use C++ for your projects. I studied UE for game development and I use all the tools that I've learnt for game development in my robotics projects as well .

[@lempreuretiavina]

Impressive! So you were able to install and use unreal engine on linux?

[@roboage1027]

Thank you! But it's not difficult. There's linux version of UE5. You can download it just like windows version.

[@СашаЯковенко-ы6в]

👍

[@石川元太-n9w]

what you use OS Linux?

[@roboage1027]

Ubuntu 22.04

[@GenIshikawa]

@@roboage1027 thank you! Is it difficult to integrate with Windows?

[@fawadkhan8905]

what is the key difference between an unreal engine and a gazebo?

[@roboage1027]

I use Uinreal mainly because it is possible to create photorealistic environments in it, which is good for things like deep reinforcement learning. Gazebo is good for physics simulation. Though Unreal Engine has its own physics engine. I didn't check which one is better.

[@fawadkhan8905]

@@roboage1027 First, I would like to thank you, so I am working on human robot collaboration in the construction industry, and I just come to know as watched your this video that unreal engine is great for 3D reconstruction. But my final goal is to make a digital twin for safe and secure human robot interaction. Could you put light on this please, this is my PhD research focus.

[@roboage1027]

@@fawadkhan8905 I'm working on the similar problem. I'll definitely move in this direction. So stay tuned for more videos 😁

[@fawadkhan8905]

@@roboage1027 thank you and the least I could do is smashed the subscribe and like button, In addition, shared with others, thanks!

[@yacinekhaledhefied7037]

Why do we need a gazebo as a physics engine when the unreal engine already has a powerful physics engine?

[@roboage1027]

Hi! UE5's physics engine is no very good. It is more suited for games performance and not for accurate physics simulation.

[@icesec2678]

Nice video?

[@christianmoreno7390]

Hello! If I were to pay you $$, could you help me integrate ROS2 with UE5? Willing to pay a good amount of money for help. There doesn’t seem to be any resources online using Python. Any advice?

[@roboage1027]

Hello! I can try to help you. Can you explain me in more detail what is your project. You can write me in Instagram. robo_age - int's me in Instagram.