This AI can re-orient you eye towards the camera. Look at script in film, NVIDIA redirect the gaze

NVIDIA MAXINE can re-orient your gaze in film. You can keep your eyes at your pre-written scripts now during filming as NVIDIA AR SDK tools can redirect your gaze towards the camera/audience in each frame!!!
This tutorial will teach you how to use NVIDIA MAXINE AR SDK tools to redirect your seeing direction to camera from recording.
=============================================================
1. download 2 stuff:
* github.com/NVIDIA/MAXINE-AR-S...
* catalog.ngc.nvidia.com/orgs/n...
2. Copy Paste these 4 lines to replace lines in run.bat:
SETLOCAL
SET PATH=%PATH%;..\..\samples\external\opencv\bin;..\..\bin;
SET NVAR_MODEL_DIR=..\..\bin\models
GazeRedirect.exe --offline_mode --split_screen_view=false --in=
=============================================================
00:00 App re-orient your gaze in film so you can keep eyes on scripts during being recorded
01:18 Download the 'app' and other resources
02:43 Move files to the right folder
04:47 Edit run.bat to indicate your input video
10:16 Run the 'app', and find the output
11:24 Tip1: follow the instruction exactly unless you know programming
11:46 Tip2: No post-processing your video before gaze redirection
12:27 Tip3: Filming conditions not so good? It's okay :)
12:51 Tip4: No Mac version at this moment ;(
13:13 Funny fact: not many know this yet
14:14 AI will play bigger role in future

[@arbility8971]

I have seen so many comments here... did not expect to get this much attention. Thanks! So please follow the instruction carefully (especially the part when editting the run.bat file), you need to give the right path. Also, you need, 20xx/30xx/40xx or titan NVIDIA GPU to run this program. I cannot address comment one by one (sorry). I am now writing a software wrapping this program so you can download and double click to run ;). Stay tuned for the time when i publish the software. Thanks!

[@markzhaopkugse]

wonderful work! It is very helpful for many people.

[@Brainboostnetwork]

would you might know why the file isnt downloading from the maxine AR SDK wesbite?

[@junpengqiu4054]

@@Brainboostnetwork If you log in, you shall be able to do so? Or maybe you internet connection is unstable to Nvidia's website?

[@renzluyao]

so 1660 super won't really work for this right? sadge

[@farinazz]

the zip file does not download anymore.

[@brianltran]

Thank you so much for sharing with us! I am so excited and will be trying this soon

[@Shmittery]

Thanks for this great helpful video! Your assessment on why this wasn't pitched to content creators is spot on. Well done video, your phone slap made me laugh pretty hard.

[@Nathan.Klemstein]

Thanks dude! For some reason I can't do it live but I wanted it for pre-recorded video anyways. The output is decent but it makes the eyes move around a lot in my case. Thanks for the clear tutorial though!

[@iambauwz]

Man thank you for this tutorial, that's awesome !

[@AloSilvestre]

thank you so much for taking the time to share this! 👏👏👏 I can't believe why is not that known neither... By the way, a windows tip that saves me time and mistakes. To open a console at certain folder location, just open it in explorer, the type "cmd" at the location bar. A command promt will open at the folders location ;)

[@arbility8971]

yes, I did not put this in my video because I am afraid ppl could be clicking at another window/desktop before breofore typing that "cmd"

[@davidforday]

Dude your a KING! Subscribed ✅✅

[@mackmother]

Wheneve this can be used in MAC I will use it. You did a fantastic job explaining it to us as we are 5 years old, without making us feel belittled. Kudo to you!

[@arbility8971]

thanks, you kinda can use it on Mac, you need an additional rtx windows to run the program. The windows will act as a server, your Mac can visit the ‘server’ for the gaze repose function. Also, your windows machine and Mac need to connect to the same router

[@bohdansaranchuk6162]

@@arbility8971 it would mean a world to all of the Mac users, if you showed/explained how to do it in detail.

[@GreasednGassed]

Awesome tutorial! Thanks!

[@joebravetti3023]

Liked and subscribed. Good work.

[@MassimoTodaro74]

super job - thanks for sharing

[@hackwise]

Great video ! One question, I have a webcam and also use elgato camlink , how can I specify to GazeRedirect that I want to use my camlink ? regards.

[@Zinjo]

perfect tutorial much love

[@alpaykasal2902]

Thanks! FOR ANYONE WHO GOT AN ERROR - I forgot I have an AMD card in the computer I was trying this on, which obviously would not work :) I moved over to a pc with an Nvidia card and it worked perfectly.

[@simon_ns]

It would be fantastic to have this on any video call. Its so annoying to talk to someone who never makes eye contact

[@c.k.demirdzhiyan]

Thank you so much!

[@LofiStacy]

Nice, thank you very much

[@VelikoBekir]

Thank you!

[@iago_varela77]

¿Does the new video keep the original quality, for example HD? Great video!

[@arbility8971]

thanks for commenting, sure... you know what, I was even thinking about integrating video downgrading as an option in my conversion, lol

[@aaldere1]

Thansk for this. The weird issue I am having is even though the video is present in the GazeRedirect folder, I still get 'no video source has been found'. I double checked the filename, extension, etc. I get 'ERROR: Unable to open the input video file....' then it errors out with no video source found.

[@SizzlyPK]

Gonna use this for the german homework

[@jihad.k.saadeh]

I hope someone can answer me. Amazing video however when i did everything and typed run.bat, i got an error unable to open the input file try1.mp4 error: no video source has been found kniwing that my video file is located inside the GazeRedirect folder, name and extion are correct, and i have changed the run file inside to the same commands and the --in=try1.mp4 what could be the problem?

[@arbility8971]

wait a sec, did you name your video try1.mp4 though?

[@HolisticMotion]

commenting for algorithm thank you

[@user-ny2js9kt5r]

if later i want to do for my second video , do i need to do the same process from the start ? or i just need to do at the "run" step ......

[@ninja_guides]

The only issue I have is it only can be done with having a web cam it cant use a video to analyze eyes and then edit it

[@yoshimitsutv]

Thanks. but I have an error. I have 3070RTX gPU ERROR: The requested feature is not yet implemented, line 77 ERROR: An error has occured while initializing Gaze Redirection ERROR: an error has occured while creating a feature [ WARN:0] terminating async callback Also i would like to use in live streams Can I?

[@gatochamuscador]

like me bro

[@juanculonico356]

same error here with 3060

[@gatochamuscador]

Same error with rtx 3050 laptop

[@dantejr.inciong2131]

same

[@BeyondTheLineProductions]

Mine says Error: Cannot create a cuda stream: CUDA driver version is insufficient for CUDA runtime version

[@cymonargawanon9829]

Hi! Can you make a tutorial for using this as a live feed like in Zoom or Google Meet?

[@freezerbox]

use OBS with window recoring and virtual camera. both is included in base app

[@arbility8971]

you need OBS virtual camera, will share details in the upcoming app I made

[@annamarkov9293]

Thanks for this; I tried this but the commander came back with the following: "CUDA driver version is insufficient" what can be done?

[@arbility8971]

Pretty sure install Nvidia GeForce experience can solve this

[@GustavoLadeira42]

Oh, it only works with NVIDIA GPUs and with recorded videos? I thought I could use it for video calls as well. :s

[@Sehvan.]

How do I get Nvidia Maxine to run on my iPhone (webcam) vice using the my laptop webcam … I can’t figure it out

[@rezag4392]

Does this work on screen recording apps such as loom or screencast o matic?

[@medicalauxiliarynetworkinc2863]

Received an error code Cannot create a cuda stream: CUDA driver version is insufficient for CUDA runtime version ERROR: Initializing Gaze Engine failed

[@iago_varela77]

It only works with nvidia gpus that are a 20/30/40 or titan series.

[@joenaive8191]

FOR THOSE WHO IS GETTING THIS ERROR ERROR: The GPU is not supported, line 77 ERROR: An error has occured while initializing Gaze Redirection ERROR: an error has occured while creating a feature (my card NVIDIA GFORCE GTX 1650 SUPER) We must have Nvidia cards with tensor cores(RTX, Titan, or Quadro cards)

[@fgs6915]

I got 2080 and still does not work

[@shawnj1237]

is there a way to incorporate this on the phone? (without having to transfer the file from phone to laptop)

[@andzuo]

what does this mean? 'run.' is not recognized as an internal or external command, operable program or batch file. and how to fix it?

[@kalkydra]

Hi, good tutorial video, thanks for it!. I have a video card from el gato installed directly on the PC. Every software I have detects the video signal without an issue. However when opening the Gaze Redirect app, it always says no signal. Would you have any recommendation how to trouble shoot this, I already tried all the basics of restarting, shutting down, etc. Is there a way to specify which hdmi signal the GazeRedirect software uses? Thanks!

[@junpengqiu4054]

by hdmi, do you mean which camera to use? if you want to be able to specify some niche area, you have to change the code re-compile..

[@kalkydra]

@@junpengqiu4054 Yes, I only have one camera to an HDMI card on the PC, but is showing nothing, so wanted to try different input from the HDMi ports. Ok thanks for the answer.

[@siawentian2804]

ERROR: is not recognized as an internal or external command, operable program or batch file what should i do with this?

[@user-hk7zg3uk9c]

Hey bro. I`ve got a problem. cmd prints that "GPU is not supported, line 77". What should I do? I try to do it on laptop

[@goldhagendavid]

The code execution cannot proceed because opencv_world346.dll was not found. How do I fix this error?

[@junpengqiu4054]

you might have: Not cd into the samples\GazeRedirect\ but rather, you execute run.bat in the source code root or you have not modified run.bat as instructed in kzbin.info/www/bejne/en2zmoB4f7KZl6s , basically, the 2nd line of code shall fix this issue

[@irgialbert]

Cannot create a cuda stream: Error loading the dynamic library ERROR: Initializing Gaze Engine failed [ WARN:0] terminating async callback any solution?

[@shklnxdr]

Got the following error. Possibly because I couldn't download the second file, inspite of creating account. Is it no more? Anyway following is my error message. Cannot create a cuda stream: Cannot find nvCVImage DLL or its dependencies ERROR: Initializing Gaze Engine failed

[@arbility8971]

You need to download the second file, try create an account to do it

[@fiderias]

ERROR : the GPU is not supported, line 77.

[@username42]

how to install it to gtx cards ? need asap for zoom meetings :D

[@chrisperkins1585]

Why did you slap the phone off the table?

[@MarcosOrrego]

Any idea as why this error appears? ERROR: The requested feature is not yet implemented, line 77 ERROR: An error has occured while initializing Gaze Redirection ERROR: an error has occured while creating a feature [ WARN:0] terminating async callback I cannot run it in windows. :(

[@BVBowski]

did you ever figure this out? having the same issue on 2 pcs. makes me think something else needs to be installed

[@MarcosOrrego]

@@BVBowski nope. I'm not much of a developer and what I understand it's java... C++ is harder... I can compile it but can't debug it in visual studio so as to understand where it broke.

[@ahmadnaim6582]

unfortuntly it seems like your graphics card isnt compatible. I got the same problem here although I saw the file appear on GazeRedirect, it says the file is uncompatible or corrupted when I open it Cannot create a cuda stream: CUDA driver version is insufficient for CUDA runtime version ERROR: Initializing Gaze Engine failed

[@abdelrahmanrabie1]

ERROR: The currently installed graphics driver is not supported, line 77 I got this error

[@nicolasbornand2455]

how do you get 16:9 aspect ratio?

[@thechrisseries]

is this possible on a prerecorded video?

[@soultanemoussaseid5956]

hello i need help. i got this error : ERROR: The GPU is not supported, line 77 ERROR: An error has occured while initializing Gaze Redirection ERROR: an error has occured while creating a feature

[@muretimediaproductionnamibia]

Hi I am getting this Error ERROR: The GPU is not supported, line 77 ERROR: An error has occured while initializing Gaze Redirection ERROR: an error has occured while creating a feature My GPU is NVIDIA GeForce GTX 960 2GB 8GB Ram Core i7 What do I do to solve my errors, please?

[@HolisticMotion]

For some reason it doesn't let me drag GazeRedirect into command prompt. I have tried on 3 different computers... any tips?

[@ahmadnaim6582]

u didnt compress it i think, U have to compress the file

[@deegreg6005]

Can it be real time so that could be used while in a zoom call?

[@arbility8971]

sure, in kzbin.info/www/bejne/en2zmoB4f7KZl6s , if you remove --offline-mode , the program will try to attach to a camera. However, I tried that, and it does not work on my computer. I am looking into the source code to see what I need to do in order for it to successfully connect to camera in real time.

[@CunningCory]

@@arbility8971 Let us know if you figure it out! This could be very useful!

[@CunningCory]

Just reporting back that I got it working with a live feed that I was able to port into OBS. Code was simply: GazeRedirect.exe --split_screen_view=false --offline=false Make sure your webcam is not being used by ANYTHING else (Nvidia Broadcast, OBS, etc.) before running.

[@arbility8971]

@@CunningCory thanks for reminding, yes, Obs was using my webcam when I unsuccessfully run the program

[@Cynik45]

@@CunningCory How did you enable it to be captured by OBS? I am able to rout it through my webcam but I dont have a new source

[@3DLearningExperts]

Hi! I tried doing this but at the last step in the command prompt, it says "Cannot create a cuda stream: CUDA driver version is insufficient for CUDA runtime version ERROR: Initializing Gaze Engine failed" what should I do to fix this? Is huawei mate d14 compatible? Thanks for your help!

[@arbility8971]

I believe install GeForce experience and update your drivers from there could fix it

[@edtilsley]

Tried 2 different PCs, but running the .bat both tell me the GPU is not supported. What GPU is needed?

[@NemoKhan313]

same problem

[@ElijahBradley08]

I followed it all correctly, but when I'm in command prompt, I type ''run. bat'' then press enter, but it doesn't work.

[@arbility8971]

try the new video I posted later, I made it a software without need of coding

[@bassamshalaby7889]

I am not able to download the NVIDIA file! I click on it, but it doesn't download!

[@nailla20002]

i also have the same problem here. have u find any solution?

[@irgialbert]

use other browser, I was using chrome when I got the same problem like yours. Then I'm using edge and it works for me.

[@Brainboostnetwork]

@@irgialbert still didnt work

[@tinfoilclub]

Once the video is created theres a watermark in the top left corner, how can I remove this? thanks

[@arbility8971]

Try this app: kzbin.info/www/bejne/fYmqgXuohdyJjtU

[@silverwalka33]

can this be done on a mobile phone?

[@17silencemusic]

pls tell how to run in gtx gpu

[@bulanchurniati843]

is there any other stuff than Nvidia that can be used on mac?;(

[@arbility8971]

I wish... but Apple said good bye to NVIDIA long time ago

[@irisapostolaki4201]

the file that it creates it's 0 KB. What did I do wrong?

[@NemoKhan313]

same problem

[@yeni8360]

Why cant i open the file after?

[@trueAKspeaks]

Brother, it says 'GPU not supported' kindly bring solution to that!

[@NemoKhan313]

same problem

[@GameNepal07]

gaze video not opening???

[@petropsaroudis2384]

Does this work on Mac?

[@froidedace4480]

it says not supported

[@chazgrant]

ERROR: The GPU is not supported, line 77 ERROR: An error has occurred while initializing Gaze Redirection ERROR: an error has occurred while creating a feature

[@michaelbabiy4032]

Same, I think our GPU is not supported so we cant use it

[@michaelbabiy4032]

Which one do u have?

[@junpengqiu4054]

May I know the GPU you are using? Although I would assume that even lower spec GPU of NVIDIA should be supported. Are you using AMD gpu?

[@xponadprzecietny]

@Arbility same me. NVIDIA GTX 1661 Ti

[@rodriks9080]

But i am using rtx 3070 and same error

[@gregulysses]

ERROR: The GPU is not supported, line 77 ERROR: An error has occured while initializing Gaze Redirection ERROR: an error has occured while creating a feature Hi. I have this problem.

[@arbility8971]

Hate to say this, you need more recent gpu

[@Crazyworldd160]

does it work on mac ?

[@arbility8971]

No unfortunately, apple said goodbye to Nvidia long time ago

[@mastermuffin3950]

my gpu not supported :(

[@arbility8971]

:( my future app will try avoid this kind of limit

[@iskandaraemly761]

welp i cant even download the Maxine Windows AR SDK :(

[@Daussurs]

same

[@arbility8971]

kzbin.info/www/bejne/en2zmoB4f7KZl6s as someone who has made a lot by having NVDA stocks, I confessed to NVIDIA

[@JuryBelonozhkin_eLearning]

Hi! Please help me! I see this warning: C:\Users\Stas\OneDrive\Рабочий стол\Gaze\samples\GazeRedirect>SET NVAR_MODEL_DIR=..\..\bin\models C:\Users\Stas\OneDrive\Рабочий стол\Gaze\samples\GazeRedirect>GazeRedirect.exe --offline_mode --split_screen_view=false --in=1.mov ERROR: The GPU is not supported, line 77 ERROR: An error has occured while initializing Gaze Redirection ERROR: an error has occured while creating a feature What i must to do?

[@thefarmer2717]

You must have Nvidia cards with tensor cores(RTX, Titan, or Quadro cards)

[@mikebenchmarks9767]

Cannot create a cuda stream: Cannot find nvCVImage DLL or its dependencies ERROR: Initializing Gaze Engine failed

[@MarcosOrrego]

For me, it was because I had not installed the AR library SDK