I Tried Making a Real-Time Painterly Renderer, Van Gogh Style

[@DaviRibeiroSSilva]

Really, this is art meets engineering at it's finest.

[@yosoyautismo4797]

Yeah!

[@dahahaka]

Sadly too many people are currently arguing that something like this can't be art because "obviously" it's generated by a computer

[@Yusef28]

I really appreciate that!

[@MLIGHT-vl9gr]

@@dahahaka you mean gen ai?

[@yosoyautismo4797]

@@dahahaka are you sure they are not talking about image generating ai that steals pictures from small creators and big companies without anyone's consent?

[@therealpersonion]

youtube compression hates this man

[@zankfrappa93]

lol

[@ripnukeman]

“He didn’t paint what he saw, he painted how what he saw made him feel” is such a beautiful way to describe Gogh’s art. Great video!

[@Yusef28]

I'm glad you think so!

[@MrUndetermined]

Van Gogh is the last artist I still have respect for

[@ThisUsernameSystemF-ckingSucks]

​@@MrUndeterminedokay? weird

[@jammyg1779]

@@MrUndetermined you can appreciate him and his work without putting other artists down. This is a such a negative comment that adds nothing to the discussion.

[@blu3260]

@@MrUndetermined Womp womp

[@Teflora]

would love to see this effect used on a pixelart game!

[@skittleguys]

would all be blurry so idrk

[@Yusef28]

Interesting, can you suggest a specific game? (just so I have an idea of what you mean)

[@Teflora]

@Yusef28 I just thought with pixel art games you have pretty big blobs and a small palette. You could try something like Celeste for example,

[@skittleguys]

@@Yusef28 or super mario bros from the nes

[@Pockeywn]

@@Yusef28 what about noita? might work really well

[@davidnorman9570]

I love the idea of using this effect in some game where the main character has a psychological effect, especially if this effect was purposefully implemented into the game.

[@davidnorman9570]

Also a game built around this would lose at least one feature that makes popular games today so popular: fast action-based playthrough. However, the level of detail everything has to be built at could be lower since there's less detail - I feel like a game in this style would focus more on the character's perception of events rather than what really is. This could be interesting because there's not many games like this, most try to perceive what is going on as realistically as possible. A game could focus on the beauty of life, the small things you don't notice that maybe someone irl would take time to stare at (or zone out staring at) - the wall of a train in the metro, the grass by a sidewalk - small things that don't normally matter, all with the purpose of displaying what effects the character and the player the most. A method of describing emotion more than providing adrenaline would make a game of this kind the most playable and the most capturing and unique.

[@Yusef28]

Great ideas, especially the idea of describing or even exploring emotion instead of just adrenaline

[@future.unwrap]

That actually has been done in the Witcher 3

[@a64719]

this shader turned out beautiful, you're an incredible artist/programmer and it's so kind of you to not only share your work but also your process!

[@Yusef28]

Thanks it's great to know poeple are getting a lot out of this video!

[@ThatGuy_33]

This is insane Van Gogh’s paintings are so stylized that I wouldn’t think they could be emulated with a shader but you 100% pulled it off. very rarely do these oil painting filters look like they have intentionality or artistic intent but this one truly does.

[@Yusef28]

Thanks! There are filters and effects like kuwahara and AI that are painterly and beautiful on their own. I'm glad viewers seem to agree there is still ample room for more intentionally styled rendering as well. It validates the whole idea and process to hear that.

[@FallibleThings]

Another incredible shader. Well done, man. As a painter, it's lovely to see the attention to detail you've put into this. I can imagine a way of changing this so that there's a budget for how many strokes can be made each frame and have that hook into the size of brush strokes, and writing recency of brush stroke to a buffer to influence the next frame (if neither of these are already done).

[@Yusef28]

Wow ok well I know we can use a hash function as a percentage chance that a random voronoi cell will draw it's stroke. So a global variable can hold a budget. What would the recency buffer idea allow for though?

[@FallibleThings]

@@Yusef28 mostly to prevent too many brush strokes in specific areas. If you've put down a brush stroke you're less likely to want to put down another brush stroke there for a while (at least in an impressionist-influenced context). I think this might have contributed to the noisiness in the darker parts of the batman game you applied this to. but games being in motion might mean that doesn't work out as a thing to consider.

[@jburtson]

This has got to be the best effect you've made. You've really become proficient in controlling and building upon the effects you want

[@Yusef28]

Thanks, it's really important that my videos/projects are better each video so this is great feedback

[@oat1000]

This is by far the best painterly shader I've seen

[@FunielAudio]

Wowow! This is insane! Glad to see there is still content like this where someone didnt just slap a neural net on top of something and call it a day.. Really goes to show what these extra details of actually learning about the process and then modeling it in code can achieve! Looks absolutely incredible and I learned a ton about shaders in the process :D (Also this video was super relaxing to watch!)

[@Yusef28]

Glad to hear you liked the vid and found it relaxing! ^^ Yeah I think it's a much richer experience than just letting AI do it for me.

[@Unknownuser-jz8jc]

absolutely amazing video. i love how you don't only look at some works, but you instead delve deep into his history to develop a shader that is truly as close to his art as possible. a great tribute to a great artist. (and the code itself is so cool, and i appreciate the explanations).

[@Yusef28]

Thanks! Good to hear I didn't lose people trying to balance the deep dive with the developement!

[@oyeomi]

Hands down the coolest shader video I have ever watched!

[@Red_Oak.]

I like the first shader a lot! It looks like Monet's work. Also love the lesson on Van Gogh. Your videos are so well done and so polished. Keep up the great work!

[@Yusef28]

Oh that's great to hear, and thanks!

[@axhfoediv]

Damn this is insanely cool. I can already imagine how cool this would look directly coded into games, like having individual objects render their own brushstrokes on seperate layers for more clarity.

[@Yusef28]

Oh yeah being able to render specific objects like you say would be rad and the strokes could be different depending on th object so clouds could be thicker and curled, grass thin and straight, etc.

[@skop6321]

@@Yusef28 That would be amazing to see, maybe someone will see this a try making a demo

[@franzcrack]

It's the first time I stumble on your videos and I must say that the way you were able to carry out the ambitious idea you had is pure genius. I just LOVE when art and technical concepts combine together. This is gold

[@Yusef28]

I appreciate that especially you noting the work involved. I had this comment in my head a for a bit actually and just realized I never responded lol

[@ruichenliu7207]

Absolutely amazing! The normal mapping of the stroke really gives a true realistic feeling

[@mage443]

Man this channel is so underrated. I hope to see your stuff blow up to the size of stuff acerola or Sebastian Lague

[@Yusef28]

oh yeah I hope so too, Thanks!

[@Arch4ngell]

You would deserve it soooooo much ! This stuff is unbelievable, as usual ! Thanks Yusef !

[@zero.the.prototype]

Your work is incredible. Great editing. Great voiceover. Great script. Unbelievably fantastic development. Can't wait to see what's next.

[@Yusef28]

Thanks for the specific feedback!

[@xenontesla122]

This is incredible! I love how every step along the way you acknowledged and showed your respect for Van Gogh's process.

[@Kram1032]

this looks great. It might make sense to try to use some feature extractor /object detector to highlight particularly important features though, For instance, focus more on getting the right shape of eyes. Make it generally stick to features that are salient specifically to humans, basically In the context of games might also have access to depth and normals to further improve clarity

[@Yusef28]

This is a great suggestion, I'm adding it to the list!

[@StainlessHelena]

You created something really beautiful here! A game with this artsytle would be amazing, although fast-paced like an FPS may be difficult to pull of. To add to your suggestion of scaling stroke size with distance from the camera, you could also scale it with distance from the center of the screen as that area is usually most important. If the game was built from start with this shader in mind, there could also be a tool for the developers to add an "importance" value to objects that should be drawn in more detail than the rest.

[@Yusef28]

This is a great suggestion about scaling from center of the screen especially since it woudln't be too hard to scale the uv's of the screen based on that which means getting a lot done with a single layer. Excellent idea thanks, I will add it to my feature list for the next iteration! You're right the ideal situation would be the game is built around this effect.

[@bloo_ya]

​@@Yusef28 Also, if a game were to be built around it, maybe the lighting of the strokes could default to the center, but if a light is on the screen, then it moves to there? (I know next to nothing about shaders, there are probably so many inaccuracies in my reply)

[@Yusef28]

This could be possible though I can't think of how and especially how to handle multple lights in the scene in that case.

[@bloo_ya]

@@Yusef28 Either position the light between them or (this might be more resource intensive) add another light? Also, you could choose the strongest/closest light in a scene and use that one

[@AliasA1]

This is the best attempt at this I've seen yet, super impressive! I'm sure this is something you're already on top of, but I think the biggest hurdle left to making it readable is not just making the strokes smaller around higher detail areas, but have strokes that follow the contour of edges, like drawing an outline. I don't know how it could be done, but that intentionality of painting strokes along sharp edges is what is missing to me. Excited to see where this goes if you decide to keep working on it!

[@Yusef28]

Thanks!, yeah the edges are something I'll be mulling over along with a few other potential improvements

[@jusk2ru]

I feel like a bunch of musicians would love this for their videos as well as game devs.

[@RiverReeves23]

You've done a great job. I think the application is clearly for large shapes (mid shot to close up) applied to very slow moving camera shots like a pan, zoom or still. I think this would be best applied to the intro menu movie. You get the the most emotional impact, while the player is emotionally available. Really awesome project, you should be really proud of your work.

[@Yusef28]

Oh yes its great for intros, and all the things you described are common in intros, you're right!

[@kro_me]

this is the best application of programming to art ive ever seen, looking forward to more!

[@CobaltTS]

Tried? You succeeded! This is amazing

[@Yusef28]

Glad you think so!

[@thorkildkappel8536]

This is actually so amazing. I dont think people realize how hard it is to create something like this. It is not only a creative idea, it also requires a creative mind to actually bring it into reality. Good job man! This is cool as f*ck!🤘

[@Yusef28]

I appreciate this thank-you!

[@NaifAlqahtani]

Wow. Just wow. Well done mate.

[@wyz.]

This is such a well explained video, shocked to see you only have 6k subs, crazy underrated.

[@TheMrLeoniasty]

This is crazy well made, good job man! It looks great

[@EnricoRodolico]

your channel is a gold mine. I don't go looking for it but whenever one of your videos pops up I am amazed by the engineering and novelty of the productions you make.

[@MFKitten]

This is absolutely WONDERFUL, man! It looks incredible! I remember seeing actual stop-motion animations made with painting, and it does look very similar to that in many ways!

[@jaytayner4292]

this is likely the best video on making any shader, period. great video, hope to see more

[@BobHuckleberry]

i cant thank you enough for linking the resources you use in the description. the book of shaders is incredible for a free learning source

[@Yusef28]

Excellent, I'm happy to hear if even just one person is using those linked resources to learn about shaders!

[@NilsAdam]

Extremely cool!

[@tiredcerulean]

love how you incorporated artistic theory and analysis into this!! so cool!

[@ChickenFingers42]

Wow! What a creative and interesting use of shaders. Hope the algorithm picks this video up, I'm sure this will inspire people!

[@Yusef28]

I hope so too!

[@SergeyLergDev]

Very impressive, you definitely nailed that art+programming niche that I strive to do myself. Deep respect

[@Yusef28]

Glad you found it impressive!

[@pindab0ter]

The idea is great, but the implementation is what made it amazing! The normal maps for the impasto, the smaller brush strokes for higher detail regions, only drawing regions with change… chef’s kiss

[@flriso]

This is so beautiful. I imagine making a game around this would be quite challenging, but the unique vibe is already there.

[@jammjumble9928]

This is insanely impressive! I have a whole new respect for render creators now, I didn't know they are/ could be this complex. You put so much thought into every aspect, it's really admirable and inspiring.

[@Yusef28]

I'm glad to hear that, thanks!

[@dzejk1653]

Amazing work, keep it up!

[@NakamuraSatou]

This is truly incredible! I love your videos so much!

[@DaviRibeiroSSilva]

Oh my, such a beautiful renderer! Amazing video man. I'm astonished!!

[@123user123name123]

Hotdamn that is one kickass shader! Very well done!!

[@HoovyTube]

The bumpmap solution is incredibly elegant!

[@watson-disambiguation]

The fade effect that occurs whenever there is some kind of cut is really cool.

[@Yusef28]

Ok this is good to know, I wasn't sure if that would stand out to people.

[@devinperez7547]

such a cool project

[@sumnerseanwalters3238]

most beautiful thing I've seen this year!

[@karnytten]

Suuuper interesting! Many cool ideas along the way you could dive into, even just the first circle experiments were really interesting.

[@hippocratesm.d.1543]

i do not know coding, but i do love art and video games, I enjoyed this video and didn't skip a sec, just to watch the process the perseverance, trial & error and the masterful knowledge of your craft, truly inspiring on its own regardless of the result, which is also mind blowing and amazing! subbed!

[@Yusef28]

It's great to hear you appreciate these aspects of my process even without being a programmer. Thanks for supporting me!

[@zicraftian]

This was a very interesting video, and project. Really makes shaders look like fun! Great work on this, this is such a cool shader

[@Yusef28]

Oh yes shaders are very fun, infinite possiblities

[@SafarSofar]

This is absolutely amazing work mate. The quality of the video: content, theme, narrative - everything is perfect. Wishing you fast growth on KZbin. You deserve it

[@Yusef28]

Great feedback thanks!

[@francoyudica8635]

Loved the idea and great explanations. I've been lately working on a similar project as well, it mixes computer graphics with art and genetic algorithms to generate stylized images, and as you said at the end of the video, it's giving me a different perspective of art and computer graphics reminding me that it's not all about games. Happy to find you channel, great job and keep it up!

[@Demadz]

Been binge-watching all your videos, they all are so well-made and creative. I'm genuinely surprised you don't have more subscribers for content of this quality!

[@Pr0HoN]

Wow. Amazing presentation of an amazing project! Thank you so much!

[@NBH-xh3nq]

The first person shooter with shader applied felt like some sort of blindness or visual impairment (as well as a psychological impairment) which might be interesting to base a game around.

[@willlowtree]

this is incredible!!! interesting to see how youve used gradients the same i did for one of my last projects! im getting into writing shaders and youre such an inspiration

[@user-ws8bb8ii4n]

THIS SHADER IS ACTUALLY SO GOOD I NEED A PART TWO

[@Yusef28]

I plan to work on another iteration eventually since there is a lot I would do differently. I'll make a video when I do.

[@purplepinkclouds8882]

Unbelievably great. Bravo! Watched it twice

[@ThomasFinas]

That is beyond cool yusef, seriously man huge work

[@Yusef28]

I appreciate it Thomas!

[@a.mabulle5478]

such a nice video, pls continue to share your work, this is pure gold

[@TheAngeloiii]

I love the way you edited your creative process into such an interesting and informative video. Very cool work!

[@Yusef28]

Excellent feedback, I'm hearing people like the process so I'll make sure I have that in future videos!

[@June-ox9uk]

This is absolutely beautiful, good work!!!!

[@commodore7331]

if you plan on building on this project any more, i recommend making it so that the paint strokes are larger where pixels are more similar to each other. in painting you tend to use smaller strokes for more high frequency detail where there's a lot more variation in the area, but if you know an area is going to end up being mostly the same color you're probably just gonna use a few larger blockier strokes

[@Yusef28]

Great suggestion, yes I plan to keep working on it so I'll keep this in mind. I might even have to use multple layers of sampling just to know more about the detail.

[@bennetharvey]

Hey man, this is seriously one of the most impressive things I’ve ever seen. Truly the intersection between art and technology. I’m super excited to see what you create in the future :)

[@unknown-kj4qp]

This is sick af! This literally looks production ready, especially if someone were to implement this with the tweaks you mentioned.

[@Yusef28]

Glad to hear that!

[@Tombsar]

What an amazing result! Instant subscribe. I particularly like the way it turns camera jump cuts into stylised transitions. Not good for fast-paced games, but I could absolutely see this used in slower-paced more artistic genres.

[@Yusef28]

Yeah that transition bit is a nice side effect!

[@offchristianamr]

I love this. Most of the math went over my head but the end result is beautiful. Really incredible work. Can’t wait to check out your other videos, and to see what you do next

[@Yusef28]

Oh yeah I understand I went through the math quite fast so I'm glad you still enjoyed the video

[@lossapardo]

Crazy work So inspiring

[@Yusef28]

Thanks, your work is super inspiring as well!

[@carl4352]

Unbelievably interesting! Thank you for doing this

[@Yusef28]

Glad you enjoyed!

[@delphicdescant]

Really cool idea, and the results are better than I would have expected. Thanks for sharing.

[@Yusef28]

I'm glad you enjoyed!

[@miriamramstudio3982]

Wow, that's a super interesting project. Thanks for sharing.

[@FebvreAlexis]

This shader really is beautiful. This could make a pretty cool game if using it!

[@NaveedKhanYT]

I think when Tech & Art crossroads the best works of 21st century is made. This was amazing!

[@justincarter7954]

Well this is the coolest thing I've seen this week, I'm really impressed how far you took this. When clicking on this video I went in with the assumption that each frame would look good, but a Van Gogh style would be tough to make sense in a video format. Your ideas on how to only add strokes over time really makes the affect come alive.

[@Yusef28]

This is good feedback since I'm trying to understand what people are thinking when they click and near the beginning actually. Thanks!

[@proxd3980]

absolutelly incredible man keep it up!!!

[@birdpump]

Crazy video, well done!

[@7ellowY]

hey! that vertical brush style around 1:48 is an impressionist style commonly used in fine art restoration. its very cool!

[@SpeCarmi]

Great video! It’s a fantastic example of a handcrafted image processing algorithm rather than a deep learning approach (which in this case, would be style transfer).

[@Yusef28]

Thanks, that's right, hand-crafted post processing effects are is still relevant haha

[@-emir5484]

This looks amazing! One addition I'd include though would be edges since van gogh does use some lineart in his paintings and it would be especially great in this context since it would make everything more readable

[@Yusef28]

Defintely edges will help!

[@manmadeartists]

You seem to be a nice and very interesting person just by the topics you are interested in and how you approach them. Thanks for sharing ❤

[@scoutgaming737]

Extremely underrated channel. Only 32k views for this masterclass graphics programming work is a crime. I think I may try learning a bunch about shaders by trying to recreate your recreation of Van Goth, which will definetly be easier than your work since you explained the general structure of the shader, but it's still a challenge. And maybe one day I'll be good enough to tweak it to make a game out of it, who knows

[@Yusef28]

I appreciate it, and hell yeah go for it I hope you get to make a game out of this at some point that would be sick

[@bloo_ya]

Van Goth 😭😭😭

[@PaulHobbs23]

This is really beautiful. I can imagine putting this on my webcam at work would draw some attention!

[@Yusef28]

Haha yes I image so as well ^^

[@boembajee]

masterfully put together!

[@grimmbleaper9981]

pretty cool dude

[@johnwickham]

Phenomenal, well done

[@LuxurioMusic]

Really beautiful! It feels like a jumping off point with so many possibilities, especially in games where different elements can be separated and rendered with specific brushstrokes. For some reason this brings to mind Obra Dinn and the way they tamed dithering.

[@Gr1zh]

This is incredible work!

[@SnotjeXIV]

really cool this, would really like a coming back to video in half a year

[@Yusef28]

I hope to do that, if not sooner!

[@LeeBrenton]

so cool man.. love it! extracting depth, or segmentation will help with deciding how to redraw the background.

[@Yusef28]

Agreed and I am slowly looking into segmentation and feature detection

[@prismatic.visuals]

Incredible work! And excellent explanation 👏

[@lunaponta594]

this is so so cool. i was scared because it kinda looked like AI the first time, especially in the text. but you actually made it all, even the fucking lighting on the bitmap. amazing

[@Yusef28]

Thanks! I'm curious what part looked like ai?

[@lunaponta594]

@@Yusef28 oh wow i didn't think you'd reply, i thought your channel was huge because of how high quality the videos are, but oh well it actually doesn't look like ai videos, but the video idea itself is something i could see being achieved with those AI filters that make an image into a certain style (like anime filters), and before knowing you were the guy that made the ascii video, i thought this video could be that. in my head it kinda looked like a van gogh filter applied every frame and when text appeared, it looked incomplete or weird but trying to make something coherent (13:44 is a good example), which is common in ai images but the thing that this video reminded me the most was AI minecraft. it's not hard to find, and i'm kinda tired of it lol. it creates a new image every frame, changing the frames little by little, and it's constantly changing, sometimes to incoherent things. your shader kinda looked like it at a first glance lol (especially because of the youtube compression) but after looking deeper and understanding it more, it doesn't look that much like ai, it was just a little bit reminiscent. and because i thought it was a filter, it probably made my eyes biased to see it. love your videos :)

[@Yusef28]

I know what type of video you are talking about and I see what you mean. Still I think people could easily confuse this for that or some other ai filter so it's good to know

[@colosousaurs]

I love how you used life is strange in the video! Probably my favorite game. You are so smart that’s awesome ❤

[@Yusef28]

Thanks, It's one of my favourites too! ^^

[@gameworkerty]

This is really cool! I am using a completely different method from this or 11-11 to make a paint-like effect in my game, its great to see so many heterodox approaches.

[@Yusef28]

glad to hear someone else experimenting with painterly rendering, and thanks for the new word [heterodox]

[@bloo_ya]

woah I gotta see this

[@OtterSwims]

this is so beautiful wow

[@ellion0815]

Bam. Subscribed. Hallelujah!

[@pinkmullet4]

This is such an awesome channel. Keep up this quality and you're going to blow up for sure!

[@jackthehacker05]

6:33 first thought that came to my mind was that it was beautiful

[@Yusef28]

Great I'm glad to hear it!