DaVinci Resolve and OpenAI DIY
1:39
Next Week: AI Relighting
0:12
Жыл бұрын
Josip Broz Tito Chatbot
7:53
Жыл бұрын
Resolve Interactive Relight
0:23
Жыл бұрын
Beauty with Resolve Surface Tracker
0:27
DaVinci Resolve April Fools Day Joke
2:31
DaVinci Resolve R Notify Demo
1:18
2 жыл бұрын
RTC Demo v0.2
3:58
3 жыл бұрын
DaVinci Resolve Fusion FX
7:32
3 жыл бұрын
Color Intelligence Unveiling
1:24
4 жыл бұрын
Making Money With DaVinci Resolve
11:47
DaVinci Resolve 3D Birds Part 2
6:14
Пікірлер
@lanarkcd
@lanarkcd 9 күн бұрын
I am now beginning to see the power of Davinci Resolve and the control it gives over video intended for KZbin, so yes I would like to see more content like this
@VideoEditorObear
@VideoEditorObear 13 күн бұрын
Great tutorial! Love the simplicity of your explanations and editing!
@ephramTVR
@ephramTVR 25 күн бұрын
THANK YOU SO MUCH edit: I might have spoken too soon as it seems to not be working for me in davinci resolve v19
@kellyanzalone195
@kellyanzalone195 25 күн бұрын
I would love to have a plugin like that. It would be a game changer.
@whowhatwherelife
@whowhatwherelife Ай бұрын
An excellent option for using AI generated VO. Artlist uses AI generated VO and haven't tried it yet. Yours seem very natural spoken words and even the rise and inflection of a voice for expression of the words and context. Please let me know the progress of your work and the AI VO app you use. Thanks
@Hdhead
@Hdhead Ай бұрын
I've used ElevenLabs via their API here.
@Ziz_clips07
@Ziz_clips07 Ай бұрын
can i have the link of script to convert the text into speech?
@Hdhead
@Hdhead Ай бұрын
No, sorry. I haven't released any of this.
@abbenay2300
@abbenay2300 Ай бұрын
This is brilliant! But is there any way to edit or change the character set used? Say by adding a new or custom "ASCII style" option. Seems like a simple thing to add or edit but I can't work out if there's any way to do it.
@Hdhead
@Hdhead Ай бұрын
It's possible, but I didn't build that option in. You can hack the code though and I encourage you to do that!
@FraggedSpartan
@FraggedSpartan Ай бұрын
Any updates when it comes to Resolve 19? I get a black screen when I add the effect.
@Hdhead
@Hdhead Ай бұрын
I haven't had a chance to test it in V19 yet, but some users are reporting it's not working.
@Hdhead
@Hdhead 12 күн бұрын
I tested it on V19. It's unstable. I'm not sure what change in V19 broke it. It seems to work better if you enable the "positive" mode.
@prod.dailydailydaily
@prod.dailydailydaily 7 күн бұрын
@@Hdhead same issue, as soon you go with contrast under 1 it starts working :)
@Hdhead
@Hdhead 6 күн бұрын
@@prod.dailydailydaily yeah, I saw the same thing in Windows. It does more or less the same thing in Edit page and in Fusion. There may be a minor relief if you click on the three dot menu in Effects pane and disable hover scrub preview before applying the plugin to a timeline clip. Something in V19 messed up Fusion Fuses. I'm sure it's fixable one way or another, but since this is a free product I just haven't had time to take look yet.
@prod.dailydailydaily
@prod.dailydailydaily 6 күн бұрын
@@Hdhead no worries at all :) super happy with it! I was just curious as I tried it with square aspect ratio and for some reason it keep a 16:9 output, am I missing something or is there a workaround to change the aspect ratio, because with zoom you actually larger the pixels and its less crisp :)
@siriusleto3758
@siriusleto3758 Ай бұрын
Can you import .pdf files?
@infox8
@infox8 Ай бұрын
thank you the video, excellent tricks
@alzibaba
@alzibaba Ай бұрын
This is fantastic, great job. I'd buy it in a heartbeat!
@CGToonStudio
@CGToonStudio Ай бұрын
i am using free version of davinci Resolve, but i can not find the script folder in fusion Only few folders are visible.
@Hdhead
@Hdhead Ай бұрын
You can put a script into any of those. You can put it at the root of the scripts folder or even create a new one in which case you'll have created a new submenu in the scripts dropdown menu.
@CGToonStudio
@CGToonStudio Ай бұрын
@@Hdhead Thank you very much.
@anonanon7368
@anonanon7368 Ай бұрын
Update? Have you given up on this project?
@Hdhead
@Hdhead Ай бұрын
Well, I'd say for practical purposes probably yes. Any creative generative AI is toxic in Hollywood and a sure way to piss off a lot of people. I've been diving into other AI use cases that don't displace human workers but sort of create opportunities where none existed previously.
@anonanon7368
@anonanon7368 Ай бұрын
@@Hdhead Why you talking about Hollywood. People wanna use it for their youtube videos. Upload the script please. I will build it if you don't want to, I just need a little help since I don't know how to write DR script or where to start.
@Hdhead
@Hdhead Ай бұрын
@@anonanon7368 Because I work in Hollywood. While a product like this wouldn't be intended for Hollywood pros I don't want to alienate people I work with.
@anonanon7368
@anonanon7368 Ай бұрын
@@Hdhead Ok, I will try to build this myself then. Thanks for nothing.
@stevenwebbmusic
@stevenwebbmusic 2 ай бұрын
Hi, this plugin is broken in Davinci Resolve 19. Is there an update fix planned?
@Hdhead
@Hdhead Ай бұрын
Thanks for reporting. I'll test it out when I get a chance.
@LEUMAS_PLAYS
@LEUMAS_PLAYS 2 ай бұрын
can you please show us how to do it
@Noviex
@Noviex 2 ай бұрын
when I try to use it I get a error that says "Warning: Unknown tool found" Which prevents me from using it.
@Hdhead
@Hdhead 2 ай бұрын
Hmm, this is the first report of an issue. I'm not sure what could be going on.
@vasyl_hoshovskyi
@vasyl_hoshovskyi 2 ай бұрын
Hi Igor! Thank you for the fantastic lessons and the codes you've shared for integrating OpenAI with DaVinci Resolve. I recently subscribed to MixingLight.com just for these tutorials, and they've been incredibly helpful! I have a question, though: in one of your other videos, you demonstrated how you invoked a ChatGPT chatbot directly within DaVinci Resolve, and it looked like the window was created using Qt. Could you explain how you did that? Did you use the built-in Qt in Resolve, or is there another method to create such a window? Thanks again for all your great content!
@Hdhead
@Hdhead 2 ай бұрын
I don't remember because it's been a while, but that one was pretty simple and I may have used the built in Qt bindings. For more complex stuff where there is more than a couple of buttons I usually use the full PySide2. I have also used PyQt in the past. They are pretty much the same thing.
@vasyl_hoshovskyi
@vasyl_hoshovskyi 2 ай бұрын
@@Hdhead thank you
@parthwagh3607
@parthwagh3607 2 ай бұрын
When running on CPU it is giving me correct answers, but when running on GPU it is giving me gibberish answers. {.\llamafile.exe "C:\Users\PARTH\.ollama\models\blobs\sha256-43f7a214e5329f672bb05404cfba1913cbb70fdaa1a17497224e1925046b0ed5" -ngl 35} I am using RTX 4090, this is Qwen 7B model.
@kougan_music
@kougan_music 2 ай бұрын
Is there anywhere I can learn how to do the computer vision effect, with colors like at 1:10 ?
@Hdhead
@Hdhead 2 ай бұрын
Put your video on a track above or below the computer vision track and experiment with different transfer modes on the top track in the edit page inspector.
@sausage4mash
@sausage4mash 2 ай бұрын
is this true : in summary, the Llamafile 70B Instruct model requires a significant amount of RAM, likely in the range of 128GB or more, to run effectively without severe performance degradation. Systems with less RAM, such as 8GB, will struggle to run this large language model.
@abhishekak9619
@abhishekak9619 2 ай бұрын
this might have worked with gemini and its 1 million tokens. and i think the gemini tokenizer is different because other llms run out of tokens in fewer words. its bad in most cases until it has enlugh context and then it starts working as intended.
@TheEditWiz
@TheEditWiz 2 ай бұрын
Yes, this plugin would be very useful!
@davidsiltz
@davidsiltz 2 ай бұрын
I would buy it.
@NLPprompter
@NLPprompter 3 ай бұрын
i haven't try llamafiles yet it's it faster than ollama Inference? is it need AVX2? my old workstation stuck with AVX 😢
@Hdhead
@Hdhead 3 ай бұрын
I have a full length video on this. It's very fast.
@Gabby16bit
@Gabby16bit 3 ай бұрын
kzbin.info/www/bejne/oqfPmHuvarmErpo Is something like Excalibur, possibile to program on DavinciResolve?
@HeliumTurtle
@HeliumTurtle 4 ай бұрын
This is nuts! I feel like davinci's native relight isn't giving me what I want right now but this looks way better lol. Would love a follow-up on the tool you made/how you made it!
@Hdhead
@Hdhead 4 ай бұрын
Thanks. The Resolve's native relighting uses the same technology, but the model is not quite as good as this one (which is purportedly the best). The issue with turning this into a third party tool for Resolve is that Blackmagic could improve their model and make a third party obsolete. It's tough to compete against built in tools.
@cempack
@cempack 4 ай бұрын
Right but now try it out on a low-end computer. That's why we won't see local LLM's for a while but mostly specific tasks models that will be less performance needy.
@NLPprompter
@NLPprompter 3 ай бұрын
not really I've been using it with my obsidian copilot plugin with ollama and llama3 isn't that bad even it can understand needle in haystack inside my obsidian notes i mean my notes though it's thousands of notes.
@Ephesians-612
@Ephesians-612 4 ай бұрын
awesome stuff, where can i find out how to create ai voice overs like that?
@Hdhead
@Hdhead 4 ай бұрын
Check out ElevenLabs
@hkhatri12
@hkhatri12 5 ай бұрын
Thank you!
@trekitytrekyoself
@trekitytrekyoself 5 ай бұрын
Im going to try this to edit widescreen hd movies for vhs 4:3. Thanks
@aniketvishnupurikar2260
@aniketvishnupurikar2260 5 ай бұрын
Hi I have downloaded the cda and install it. but while trying to run it on GPU I get this error: "hipErrorNoBinaryForGpu: Unable to find code object for all current devices! I have rtx2060 gpu and32 gigs of ram. I have configured cuda in my system.
@evlnachoz9814
@evlnachoz9814 5 ай бұрын
igor this is gate keeping video. Tell us how to install the plug in
@Hdhead
@Hdhead 5 ай бұрын
There is no plugin to install. This is a software I wrote to test the whole thing out, just a proof of concept. I haven't decided yet to make this into a real product.
@evlnachoz9814
@evlnachoz9814 5 ай бұрын
@@Hdhead ok Thanks for clarifying. I'm still looking for an alternative tts at the moment.
@TMC3000
@TMC3000 5 ай бұрын
@@Hdheadbummer! I was hoping you’ve got it sorted out already
@Hdhead
@Hdhead 5 ай бұрын
@@TMC3000 I hear you. The tech part is a no-brainer. The ethical considerations are tough, especially in the Media and Entertainment industry which is where I work. I'm carefully evaluating all that.
@TMC3000
@TMC3000 5 ай бұрын
@@Hdhead oh well,….I’m rooting for your success eventually.
@EscapeStoriesMix
@EscapeStoriesMix 5 ай бұрын
I followed your video and I could see my script like you, but when I run it I recieve an error message Da Vinci Resolve is not running
@Hdhead
@Hdhead 5 ай бұрын
It's hard to say. If you're executing external script make sure you're running Resolve Studio.
@EscapeStoriesMix
@EscapeStoriesMix 5 ай бұрын
@@Hdhead I am running scripts in the console not externally. What I noticed is that in the DV free version preferencies panel there isn't the option to enable scripting
@Hdhead
@Hdhead 5 ай бұрын
@@EscapeStoriesMix I see. Can you post the snippet of the code all the way down to where it returns this error message?
@Hdhead
@Hdhead 5 ай бұрын
Also, I don't use the free version of Resolve and don't know much about the limitations other than it won't do external scripting. What happens when you restart Resolve and execute print(resolve) in the console, First using Lua and then using Py3?
@EscapeStoriesMix
@EscapeStoriesMix 5 ай бұрын
@@Hdhead Lua> print(resolve) Resolve (0x00007FF6646AD7E0) [App: 'Resolve' on 127.0.0.1, UUID: 69a39824-ce1a-4bc1-b11b-052e85c26545] Py3> print(resolve) Resolve (0x00007FF6646AD7E0) [App: 'Resolve' on 127.0.0.1, UUID: 69a39824-ce1a-4bc1-b11b-052e85c26545]
@frongle6268
@frongle6268 5 ай бұрын
i tried putting this over an image in the media pool and now the money and the image are gone and its just black did i miss a step or something?
@Hdhead
@Hdhead 5 ай бұрын
I'm not sure what you mean by putting it over an image in the media pool.
@frongle6268
@frongle6268 5 ай бұрын
@@Hdhead sorry mistyped. i put it over and image in the timeline
@frongle6268
@frongle6268 5 ай бұрын
@@Hdhead i did basically exactly what you did at the end but instead of the bars i put an image
@frongle6268
@frongle6268 5 ай бұрын
@@Hdhead ok i figured it out i just had to connect the Renderer3D to my MediaOut ty for the help and for the great tutorial man!
@Hdhead
@Hdhead 5 ай бұрын
@@frongle6268 Sure thing. Whatever you're sending out of Fusion to Edit or Color page has to terminate in MediaOut.
@JJ.R-xs8rf
@JJ.R-xs8rf 5 ай бұрын
Why go through all of this fuzz when people can just download LM Studio that is far easier to use? Why are people still so obsessed with command lines? If you're a nerd.... ok.... but the average John and Jane don't want to deal with that bullshit. The Windows OS shows that you don't need that nonsense to run some amazing applications or games on your computer. Stop living in the 90's
@A_Simple_Neurose
@A_Simple_Neurose 3 ай бұрын
brainrot
@dimeloloco
@dimeloloco 2 ай бұрын
Llamafile allows you to run models at insane speeds from your CPU. LM Studio doesn’t. Ram is a lot cheaper than GPU vRAM. It’s insanely fast too based on some really innovative techniques the developer found for running matrix computations on a CPU. LMstudio doesn’t let you do much. It’s good for simple chatting but that’s about it. Its web and documents RAG setup sucks. Anyone seriously working with local LLMs is doing it from the command prompt, or IDEs and running custom Langchain scripts.
@JJ.R-xs8rf
@JJ.R-xs8rf 2 ай бұрын
@@dimeloloco What are you rambling about? The topic was only about the fact that Llamafile isn't user-friendly enough for the average user. *_"LMstudio doesn't let you do much. It's good for simple chatting, but that's about it."_* What nonsense... ~sigh~ A model itself (just the bare-bones model with nothing added or changed) doesn't become smarter by running it with Llamafile, compared to running that same model in LM Studio and without any quantization. It will just run faster. Most people don't want to dive into AI like professionals or basement nerds like you do. I have several local AI models installed, but unless I have privacy concerns, I always use one of the three major AI models online because they're way faster, and their output is of superior quality. Secondly, they don't need my CPU/GPU/memory sources, which I might need myself for something else. I don't even see the need to invest more time into diving deeper into AI for local use, for the simple reason that I consider AI rather useless for important things I want to do, where the accuracy of the output matters. I have fiddled with numeric data using the large AI models online, and it continues to mess things up. I could ask the most simple questions about a data set, and it gets it often completely wrong, whereas Excel just gets it right... all the time, it just takes more effort. All those major AI models are language models, and as a result, they hallucinate like crazy, even the best models. I don't see myself using AI for critical applications anytime soon, and a lot of businesses think the same way. Sure, it will change when AI models become more reliable, but I don't see that happening anytime soon, when they fail to come up with something way more sophisticated than the current language models, something that can actually think, help us beat climate change, help us make the correct economic decisions, find cures for common diseases, boost progress in space travel, etc. Sure, what we have right now looks cool, but the more you work with it, the more you will notice how flawed it is. In 20 years, we will all laugh about it, just like we laugh about Eliza now. Bye.
@abrohamlincoln2232
@abrohamlincoln2232 6 ай бұрын
Davinci definitely needs the voice over function, please release it👍
6 ай бұрын
It's great thank you very much. I'm struggling with cut clips or editing IN and OUT points. Is there any way to do that?
@SkydiveSim
@SkydiveSim 6 ай бұрын
Wow this is pretty impressive. Is it available for purchase?
@Hdhead
@Hdhead 6 ай бұрын
It's not available for purchase as annofd the shelf product but I could build it as a custom tool.
@hasansalame
@hasansalame 6 ай бұрын
Very interesting tool except on the edges and hair it feels like photoshop in the beginning of this Millennium
@silversurfertech7922
@silversurfertech7922 6 ай бұрын
Just found this video. Brilliant idea. I'm working a military documentary, and finding it difficult locating a real sounding voiceover.
@PFnove
@PFnove 6 ай бұрын
a recent update to llamafile allows it to run much faster on the cpu than on the gpu (don't ask me how, i have no idea, but it works)
@Hdhead
@Hdhead 6 ай бұрын
Across all architectures? I haven't played with it in a couple of months. I have to check that out. Thanks.
@PFnove
@PFnove 6 ай бұрын
@@Hdhead should be across all architectures as far as i know
@alcalina636
@alcalina636 6 ай бұрын
Please!!!. I get here thinking was ready to use lol
@alexanderbajkov2993
@alexanderbajkov2993 7 ай бұрын
VO 001 - is the voice of Orson Welles
@Hdhead
@Hdhead 7 ай бұрын
I thought it was Richard Burton.
@alexanderbajkov2993
@alexanderbajkov2993 7 ай бұрын
@@Hdhead It might be, they are very similar.
@thepandeslar8062
@thepandeslar8062 7 ай бұрын
Fantastic idea. I went to Workspace and Scripts. But I don't have AI listed. Is this something you inserted? How did you do that? Starting at the beginning of the video, there's no indication that this was added. Can you explain how you got it there? (I've got DaVinci Studio's latest upgrade as of 3/24) hvala
@Hdhead
@Hdhead 7 ай бұрын
I wrote all the Resolve-side software that interacts with the OpenAI API. I have not publicly released any of it.
@Hdhead
@Hdhead 7 ай бұрын
But you may like my Resolve Assistant GPT which is publicly available. chat.openai.com/g/g-zipXVEhhX-resolve-assistant
@thepandeslar8062
@thepandeslar8062 7 ай бұрын
@@Hdhead Thank you
@waxlion4
@waxlion4 7 ай бұрын
I'd love this especially if I can expose the normals in Fusion
@jeromebrack2195
@jeromebrack2195 7 ай бұрын
So much helpful, thanks a lot.
@henrybirdseye
@henrybirdseye 8 ай бұрын
"Amazing" barely begins to cover it. Wow.
@dave_mcbain
@dave_mcbain 8 ай бұрын
Thank you very much!🎉
@airfilm_it
@airfilm_it 8 ай бұрын
where can i find this interesting script? The system recognize the Turkish language?
@Hdhead
@Hdhead 8 ай бұрын
This is a proof of concept tech demo. I haven't released any of this.
@airfilm_it
@airfilm_it 8 ай бұрын
Will you release it?
@Hdhead
@Hdhead 8 ай бұрын
Maybe.