Color Quantization and Dithering

[@Acerola_t]

Please let me know if this video is too shitpost-y lmao

[@_zurr]

Never

[@gonderage]

no, it's shitposty enough. i freaking love the windows movie maker montage of a sheik rendered in different ways

[@Acerola_t]

@@gonderage thanks I really peaked with that

[@dawnrock2391]

Yeah the meme cut-ins are funny af, needs more shitposting

[@TavishMcEwen]

It's great, loving it

[@Gymomanen]

The windows movie maker montage with Blow Me Away was spot on. Thanks for the nostalgia 😂

[@mou.2]

All it was missing was some "unregistered hypercam 2" in the corner.

[@magnushmann]

@@mou.2 Except it wouldn't be a screen recording, but a purely windows movie maker production, so that wouldn't really make sense. Unless you for some reason recorded your final video with the screen recorder instead of just exporting it properly.

[@devRat]

I started laugh crying. I think I made the exact montage when I was in highschool...

[@2iinfinite]

Or paralyzer

[@gigawattsfactory6777]

The memories you brought back by doing the windows movie maker bit was Insane. Thank you.

[@stevethe3307]

Thank you soo much, I developed one heck of a headache trying to even find the correct terms to describe what I was attempting to do (restrict all colors on screen after dynamic lights and such to my color pallet). At one point thought I was going to have to go for some out of the box or super inefficient brute force solution but your vid showed me the correct most efficient way in terms I could actually understand! Definitely subbing for that alone, keep up the good work man.

[@Acerola_t]

Thanks! Dithering is my comfort effect lol I will take any chance I can get to talk about it.

[@suop1234]

same, i only just remembered that acerola literally made a whole video on it... thanks acerola!

[@ddnava96]

Fun fact: Madeline (Celeste) is a combination of pixel art and 3D (or actuallh 2D). Her body and face are made of sprites but her hair is actually a flat 3D model

[@GLEPCHANNEL]

source?

[@ddnava96]

@@GLEPCHANNEL. I don't have a link for you, but you can easily find videos in KZbin that show how the game renders certain things, including Madeline's hair, lighting, etc

[@TheRealAnsontp]

I love spline 3D animation for hair

[@Luizfelipe28175]

her hair isn't a flat 3d model, its a 2d texture

[@ddnava96]

@@Luizfelipe28175 No, it's not :> Iirc they basically did that so that the hair can have physics instead of only pre-made animation

[@realastropulse]

This is pretty interesting. As an experienced pixel artist, pixel art faker, and pixel art gatekeeper, this is a great description of how it works. I actually put together my own Blender based shader that I use for 3D -> pixel art work. Really cuts down on time, especially for animations. One thing that you can do to improve 3D scenes is actually use the depth buffer to apply some outline/darkening effects. Another trick is to use more solid blocks of color, because anything too detailed creates noise. This is why in games that use this style the objects typically have one color per section of the model.

[@fiskurtjorn]

10:57 To me, this feels odd with a .5 step in the middle. I would have chosen [0.00] [0.33] [0.66] [1.00], but I also experienced my visual system playing nasty tricks on me.

[@JoBot__]

I agree.

[@RosarioLeonardi]

Is preferable to sample a pixel in the middle most of the time. So pixel 0 become 0.5 and pixel 3 becomes 3.5. Divided by the total number of pixels (4) you get a nice and uniform [0.125; 0.375; 0.625; 0.875].

[@Nayckron]

I loved the montage section, you have the perfect combination of educational, humourous and good editing.

[@mrgreenskypiano]

I love the combination of shitposting and still explaining how everything works in enough detail that I understood most of the concepts first try. Great video!

[@sparkymcsparkerton8109]

I literally almost never comment on KZbin. You can fact check that if you like. But, I could not resist sending you a message to say I love everything about your videos. Like literally everything. It is edutainment [chef finger kiss]. I didn’t even skip the ads because it’s the literal least amount of “work” I could do to pay you with my attention. And I never don’t skip the ads. I love these videos that much. I commented on this one, not because it’s my favourite, but it’s the one I most recently watched and after watching it I said, “you have got to let this person know that their work is appreciated” So, yeah, keep it up. You’re winning at KZbin and I couldn’t be happier for you and everyone that has the pleasure of watching your work.

[@Acerola_t]

Thanks!

[@anthonysilveira6181]

You're videos are fire, it's so interesting actually seeing the math that creates these effects.

[@Purely_Andy]

4:45 correction, that would be 1-bit. 2-bit would be black, dark gray, light gray, white (00, 01, 10, 11)

[@guitarguyjones]

Fun fact, the last handful of pixel-art King of Fighters games also used 3D models to create the animations (like Dead Cells and other newer games), but instead of using an automated process to convert the models to sprites, SNK's artists did it all by hand, redrawing everything in 2D, frame by frame.

[@razeenag8478]

Your channel is an absolute gem, educative and entertaining!!

[@DanTDMs-homunculus]

you just popped up on my recommended and i gotta say i love your editing, your style is just very cool and nice to look at thanks for making things

[@Acerola_t]

Thank you!

[@DanTDMs-homunculus]

@@Acerola_t 👍

[@SamiTheAnxiousBean]

As a pixel artist this was a extemely Interasting watch thank you for the incredible presentation

[@5alpha23]

I don't know why this landed in my recommended videos but boy am I glad it did! - Perfect video for a Sunday afternoon, at least in my case. 😁 Your tongue-in-cheek approach is really refreshing. 🙂

[@AutisticYui]

Pretty much just binged all your videos, great stuff. Fun style and approach to the topic. Thanks for stressing the importance of optimization.

[@dmnkb]

This gave me some fantastic mid-2000 vibes, thanks for that! Kinda reminds me of how much more fun the internet used to be back then. Thanks for your detailed explanations, really inspiring!!

[@loremaster1253]

Great video! Really helpful given how popular the pixel look is in modern indie design.

[@thecompl33tnoob]

I'm writing up my very first game design documentation and thought just yesterday "damn, I wish there was an Acerola video on converting 3D assets to pixel art, I should stop by the channel." and BOOM the heavens opened and this absolute jewel of a video came soaring down. I have no idea how I missed this one, as I've watched nearly everything on your channel. Please keep going man, your content is supremely helpful and immensely entertaining. The nostalgia hit hard on that montage. 😂😂😂

[@christianwilliam1167]

I made a very similar shader in Blender but I based on PS1 aspects, it's funny to see you came up with pretty much the same solutions.

[@KingBobXVI]

The dithering bit is super interesting, I've never actually looked into how to do it on non-ascii-art images before, lol. For the pixelization bit though, is there a specific reason to do down-sampling at all? It seems like it would be much easier (and more efficient) to render at, say, 1/4 scale and up-sample it instead (which may also avoid some artifacting you can get from nearest neighbor down-sampling).

[@Acerola_t]

Yeah that would be more efficient, I like having it parameterizable in the shader though since then this effect could be used as a photo mode effect for a game that isn't specifically made to look like this. For example, I ported the effect over to ReShade for use in Final Fantasy XIV but if it was reliant on rendering at a lower resolution then the effect wouldn't work there.

[@skylarcanode-rhodes9771]

Just found you yesterday! I'm looking forward to seeing more of your videos, keep up the good work! 😃

[@evgenyaleksandrov1206]

Your fascinating manner of explaining and good taste makes this interesting concept even more amazing. Thanks. I hit a subscribe button after first thing I saw from you.

[@JulsGeekPI]

very good work for the video, the formulas, the detailed explanation of the algorithm, thanks master Acerola, also the music and the relaxed mode of teaching.

[@mandelbro1]

Got a give a like because you use the cheapest most basic Samson mic and frankly I love it. Also, good video

[@samueldavies646]

the dither explination was amazing, I found it super interesting!

[@feelshowdy]

Great video. I know my way around Photoshop so I'm familiar with these effects, and they're actually so useful for practicing art. What I do is I pass my references through a downsamping filter to reduce the number of colors. When the reference is simplified like that, it helps me a lot with understanding how to shade and color everything.

[@peppidesu]

2:51 Mipmaps are copies of the original texture scaled down by some factor. Because the pixels being sampled at a large distance change rapidly when the camera moves around, using the original texture would introduce noise to the texture. So instead, a mipmap is used in its place depending on how far away / how small the texture is. Switching between mipmaps causes banding artifacts at the distance boundaries, though. to counter that, *trilinear filtering* is used, which fades textures from one mipmap to the next. But there is another problem. The copies of the textures are scaled down by the same amount on both X and Y axis, a.k.a. they are scaled isotropically. If a texture were to be scaled down a lot on one axis, but stay the same on the other axis (for example when you stand close to a wall) the texture becomes more blurred than normal because the mipmap used is too small. *Anisotropic Filtering* takes care of that, by making copies for every combination of X and Y scalings. Side note: The term anisotropic filtering is actually not correct because it isn't a filtering mode. It is a alternative way of generating mipmaps. In other words, you can use anisotropic mipmaps with point filtering (that is, if your GPU and graphics API support that), they are not mutually exclusive like bilinear and trilinear filtering would be.

[@fungo6631]

There's yet another problem you forgot to mention. Textures consume fillrate. Fillrate doesn't grow on trees. Mimpaps also reduce the fillrate requirements for distant objects that don't require as much fillrate. This allows you to add more detail where it matters with the same performance.

[@AlphaGarg]

@@fungo6631 Fillrate?

[@fungo6631]

@@AlphaGarg Yes, fillrate. What's so strange here?

[@ShinyVeggie]

@@fungo6631 He doesn't know what fillrate is/means and was hoping for you to expand on it instead of googling it himself.

[@Krilium]

Simplified: Mipmaps are a set of images, each half the size of the last. When the camera is far enough away (among other reasons), the lower resolution versions fade in. This is to save memory, and to avoid weird artefacts.

[@nicholasjones7822]

if possible, would be cool to see limited anti-aliasing as well to smoothen out the sometimes sharp edges of the sprite

[@Cyfrik]

Having messed around with similar effects in an image editor instead of a game engine, I've noticed you can also get some interesting effects if you give each separate color channel a different dither map.

[@andrewalvarez1480]

I started cracking up halfway through the video when I realized how hilarious your animations were. truly great video 5/7

[@cruz6550]

which software is Acerola using??? i thought he used blender

[@minidavid-devdave]

such a detailed video. I love it. I don't use unity but have learned a lot about how things work from it

[@aeleequis]

Monogatari, persona 3 (if I'm not mistaken) and more references, paired with cool jokes and awesome video editing. You deserve way more followers than you have

[@badkluster]

is this the best and most informative channel in KZbin? maybe

[@SwifterYT]

This channel's very addicting, wanting to get into shaders soon so this stuff will be helpful. Thanks!!

[@CaveyMoth]

0:16 Wait. This isn't Monogatari! The downsampling and dithering give the graphics a really nice PS1 vibe. It especially reminds me of Silent Hill's graphics.

[@ako_0256]

My thoughts exactly lol

[@lastsipahi]

I recently bought ProPixelizer asset and this video gave me the insides of how it's working. Thank you!

[@Crazymoniker]

That Blow Me Away montage was nostalgiac as hell. I really miss the good old days of playing Halo after school and watching shitty gameplay compilations on youtube.

[@sampson217]

This was amazing. Thank you. 👏

[@Acerola_t]

Thanks!

[@STICKOMEDIA]

That montage is beautiful

[@firedbluex]

the amv in the middle of the video is absolutely captivating

[@aiden_3c]

I actually really love this video, also how you actually talk about the math now I understand how I'd do some shader shit like this. Thank you

[@Enipulve]

The T-pose Sheik color pallet montage would make a great meme.

[@Roxor128]

I did something similar to this, but the destination palette was the EGA default. The shader included it as a 16-entry lookup table and found the two closest colours in the palette, then used dithering to decide which of the two to use for the final pixel. Given most of the colours in the EGA palette are so saturated, I had to add an extra stage that significantly increased the colour saturation first in order to get decent-looking results. Without it, most of what came out was greys, as the more realistic source material I was feeding into it just wasn't anywhere near that saturated.

[@theseatoad]

Using a downsample + dither on 3D looks great, but I always like a nice thick outline around my pixel art. It would be interesting to create a shader that adds outline around Sheik. It always helps distinguish characters from environment.

[@medj7218]

i really apreciate your help with dowloanding this software

[@ShinSpiegel]

This was a freaking amazing video. Thanks for sharing

[@WhiteDeVil3]

Appreciate the WMM 2000's vibe montajjjjj, cheers bruv.

[@Rubyllim]

Thanks, yoinking this for my school project

[@sarerusoldone]

the windows movie maker dithering AMV was *chef's kiss*

[@BakeBakePi]

That's so cool! Great video!

[@darknessflame101]

Love the windows movie maker throwback, absolutely brilliant

[@krawieck]

very cool video, im gonna now watch every other video on ur channel

[@Soundy777]

KZbin! light this channel up!

[@ciberman]

Came for the dithering, stayed for the montage

[@kwmcgreal]

Very helpful to learn what these functions do!

[@spuryaas]

I played Persona 3 for the first time about a week ago and now I hear music from it in every second video

[@chlorine6539]

i have no idea whats going on but this showed up on my recommended and Im having a good time

[@ragingdonut]

love the monogatari theme

[@filipgaming1233]

The montage reminded me of a video montage i watched when I was like 7 years old, just watched it again, good times.. thanks

[@Rullisi]

The montage was amazing.

[@wii58739]

That windows movie maker montage was lit!

[@augmentedcamel]

fantastic edit

[@mastef]

jesus man what a great video!

[@sig3363]

This is the first video I watched from this guy. I could spot some shitpost humor but when the montage dropped, I lost everything. I wanna be his friend.

[@blakerussell5538]

I fucking love this guys taste in video game music. WOH is neat

[@abelstypewriters]

You have a gift for being concise.

[@DeuxisWasTaken]

Thanks Acerola very cool The montage not only made me giggle but also reminded me of the existence of Breaking Benjamin to which I last listened like 10 years ago lol, thanks for the nostalgia

[@cyancatnp]

I learnt a lot from this video. Thank you

[@rainbowzzzplayzzz]

Ive never once wondered about any of this. Despite that this was a very fun video and I enjoyed it v much ty for giving me your knowledge.

[@glitched_code]

this is very useful, thank you!!

[@nottellinganyoneanything]

that color clamping montage made me feel15 years younger

[@theai_1]

I'd love to see an effect like this on larger terains - like for example that ocean simulation. Looks incredible

[@StHappyfaces]

Thank you kindly, stranger

[@AndiieRose]

I actually used this video to make my own color quantization algorithm, in Scratch of all places!

[@firecrusades3397]

the most important video of the last decade

[@tciddados]

I feel like a good addition to this might be explanation of non-standard palette dithering. The kind explained at the end is neat, but ultimately a fake color picture from greyscale, and the color-choosing algorithm shown before just assumes an RGB palette with equally-spaced items. Would be interesting to go a bit into palette-aware algorithms (like ones with a higher # of greens than blues, to make the night landscape picture show up better).

[@Acerola_t]

Very true!

[@Krilium]

I am here to say that I'm happy because I remembered what mipmaps were off the top of my head and I have minor short term memory problems. YAY LEARNING!

[@csxcatgirl9896]

ABSOLUTE BANGER

[@mr_clean575]

I would love to see what the different color shading effects using the grayscale mapping would look like on the sheik model

[@SpacerZVEVO]

1:09 I screamed

[@fernandaalmeida6670]

thanks a lot!!! so nice reverb

[@jdigi78]

love the montage

[@Xenthera]

7:35 calm down 2007 youtube

[@CrxzyYT]

as an artist who dables in the occosional programming project because im inasne and literally do everything myself from digital art to video game mod, or sometimes entire coding project. I learned something from this. And no, it wasnt that i miss the 2006 montage edits.

[@jackmiddleton2080]

I can't remember the last time I learned so much so quickly.

[@flamshiz]

the only reason I can think of not to precompute the LUT for the dither pattern would be if you're really pinching each byte of memory for size constraint purposes

[@andershour]

Gonna tell my girl I need her to do a lil dithering on my mixels tonight 😈

[@Acerola_t]

she downsample my dither make my palette swap

[@Koplerio]

This video is literally going back in time.

[@joemama-bu5ue]

The edition was filled with shitpost and super fluid, exactly the type of edit I love, congrats for whoever edit it.

[@psully212]

There's no way it was less time and labor intensive to make this slide show than to record a simple video

[@ArchOfficial]

I knew this was going to be a shitpost as soon as I heard the P3 BGM. Subscribed.

[@NoTengoIdeaGuey]

Holy shiiiiiiiiiit the Blow Me Away montage, taking me back to 2007 lmaoo. Was that a cover band that did the music or was it some kind of audio filter applied to the actual track to dodge DMCA? It sounded obviously different but pretty dang close enough to make me wonder. Edit: NVM, read the description. 🤪

[@BickSnarf]

7:35 man that hit me in the nostalgia

[@TheRealBoof]

That montage is FIRE

[@nolanj.3897]

As someone who has never done anything involving textures, very good video

[@nguyenhoangminhtrung2779]

I love these videos!

[@TheBigMaxYT]

You waited until 11:38 to blow my mind, sir.

[@aluminiumsandworm]

i was not prepared for the montage... now i have an irrepressible urge to play cod 4 until 3 am while eating junk and shittalking my friends on xbox live