Real-Time Datamoshing in Unreal Looks Mesmerizing

[@Jam2go]

I'm working on a horror game called GANGSTALK that is going to be using this effect! You can wishlist it on steam now!

[@collinbabin5517]

swag

[@Nenerii]

The music you used in this video is ethereal by the way. Good stuff

[@mozzeralleh]

gangnam stalk

[@devilleknievel2144]

the CIA is ganstanking me. they put a chip in my brain

[@Netherdan]

Looks like it can be used as a stealth cloaking effect

[@lancehildebrand4025]

"All these will be cherished and emulated as soon as they can be avoided." Unbelievably spot on. I can only imagine telling kids in the 90s that future indie devs will be doing backflips to recreate PSX warbling

[@Forcoy]

2030s indie games mimicking AI imagine errors

[@PennyEvolus]

Don't call me out bro and anyway i do side flip to recreate warbling

[@desu38]

@@Forcoy Can't wait for the VQGAN nostalgia 😂

[@abnnr]

i'm THIS close to doing axels for a better crt-shader

[@plixplop]

@@Forcoy Janky AI images will definitely be an "aesthetic" in about 10 years, like how ugly Geocities style design has had a comeback

[@PeregrineChurch]

An enemy rendered as a datamosh effect of the enironment around it like at 7:30 would honestly be such a amazingly terrifying creature to encounter in a game.

[@mankosan6737]

Dude, especially if they were weeping angel type enemies or something

[@matthewanderson7824]

Just wait for it to be in VotV

[@asianinthetree8912]

It so cool and eldritch

[@MinePlays07]

Hiss Distorted from Control kinda look like that. Not exactly, but it's very similar. Extremely unnerving to fight

[@hamburger-yh3lj]

reminds me of those flesh pigs in cruelty squad

[@Mireneye]

Actually data moshing for a pretty unique cloak effect is a great idea.

[@pfannkuchengesicht42]

kinda reminds me of those cloaking enemies in FEAR 2

[@Mireneye]

@@pfannkuchengesicht42 Cool thing about this approach here is that Deferred renderers don't really like translucency, so the thing not being transparent will go wroom wroom.

[@sameoldtunes7110]

I’ve definitely gotta try that someday

[@Monkeymario.]

Yeah

[@Pistolsatsean]

It looks a lot like "attempts at cloaking" rather than actual successful cloaking, which is super unique and cool

[@jonslaco9020]

6:56 the mask to make specific objects get data moshed is like the phenomenon with human vision/perception where you see something completely new and your brain hasnt figured out what it is yet

[@Voltar69]

I don't quite understand what you're referring to, does it have a name?

[@TeenyTony]

Masking the datamoshing to specific objects is a surreal effect. I genuinely cannot wait to see where this game goes.

[@Foenixcrafter]

Maybe to highlight quest items

[@spinefruit7212]

My immediate thought was some sort of horror game that is photorealistic save for a couple elements or maybe an enemy with the datamoshing effect, as if a digital virus has entered the real world, or maybe for something lovecraftian or a biblical angel perhaps

[@Ru-mk8lp]

​@@spinefruit7212 yesss, have you played soma? Object specific data moshing would have been sooo amazing there Need to play it again

[@flwdbydsgn666]

In the last year of my Photography BA, almost a decade ago, I discovered glitch art and became obsessed. Back then it was super tricky to get visually appealing data-moshing and information on how to do it was very well gate-kept... a bit too well infact which made it extruciatingly difficult not just to learn but to explain and justify to my traditionalist tutors. I really hope that somewhere out there is another kid trying to piece together his final project who comes across this video. I dropped photography for a 9-5 pretty much the moment I finished my degree and had all but forgotten about the world of Glitch Art until the KZbin algorithim blessed me with this video. Thank you for sharing your process so openly, I really hope it inspires a wealth of young digital artists.

[@crazyfrogmix]

gatekeeping is the precondition for real art. "democratization" of technique just leads to pollution. it happened in video games, it happened in movies. and now it will happen to everything because of AI. you will look back on the time things were hard and wish they returned.

[@flwdbydsgn666]

@@crazyfrogmix nuh uh

[@LLPTV]

@@crazyfrogmix nah man. gatekeeping stuff that's pretty straightforward to do is akin to cheap parlor tricks. real art isn't lessened by knowing the trick behind it.

[@krizh289]

@@crazyfrogmix bro ur an idiot...that's the equivalent of saying that we should gatekeep education because only then we can have smart people

[@pseudo3847]

⁠@@crazyfrogmixshit art will be everywhere that there is good art. that’s, like, the basic nature of quality. there were always shit movies and video games. you’re just blinded by nostalgia.

[@pladmitry]

7:20 "...like these objects can't be perceived" Hmm, might be a sick idea for a scary monster

[@Zack_Taylor]

An eldritch horror thing that can't be perceived. Exactly what I was thinking when he said that, too. So much potential

[@baitposter]

The Hiss in Control already incorporates the effect into its VFX, along with oily iridescent heat hazes, so at least one eldritch entity has made good use of it so far Still curious to see more ideas for how to use it in horror media

[@duncanurquhart5278]

not quite the same, but kind of reminds me of the "villain" of the movie the night house they only kind of show up as weird silhouettes formed by objects in the background, really trippy effect when it first happens

[@Numbabu]

I wanna see a creature that’s mostly datamosh, but with eyes that render normally :3

[@satibel]

they are invisible while standing still (with maybe a slight fresnel deformation), but they datamosh when moving.

[@GreenRadiantDude]

7:05 "every single object in the region has lost its ability keep a constant physical form, meaning a mile of grass can turn into 10 miles of swamp in the blink of an eye, and it does so constantly" - Pacific Drive

[@Mogswamp]

Would love to see a full game utilizing these effects. I feel like the plot explanations for why these things are happening could be really cool. Maybe a game where the main character is navigating corrupted digital memories to piece together their own story. Also those Bob Weisz videos are a crazy throwback for me. Watched those at least a decade ago haha. Also I can't believe you have that peepy plushie thing from those really surreal ads I get...

[@Ashketchup0912]

mogswamp why are you always in the comments section of stuff i watch wth

[@charlies-stuff]

@@Ashketchup0912 he's just as much of a nerd as you

[@zev4133]

It's not a game centered around it but Control has this effect coming from most enemies, iirc. It's a sort of SCP inspired game so they do have an explanation for the effects, kind of cool, highly recommend!

[@sylvoen]

if that's your kinda vibe you'd probably dig memory of a broken dimension a lot. even if it's just a demo and probably will never actually come out

[@dumaass]

i guess the ads worked. i actually hadn't ever considered the possibility of buying a peepy, but damn they're actually real so maybe i should

[@ristopaasivirta9770]

New wizard class unlocked: DATAMANCER

[@Pistolsatsean]

When you had the character ragdolling with the datamoshing effect, I immediately thought "that would look cool as a death screen"

[@communistberd1122]

It's very similar to enemy deaths in control

[@yert5679]

didnt they do something similar to this with scp:cb?

[@Apostate_ofmind]

13:40 this is why "ufo" videos are like that. This is why video going grainy when a certain objects gets in frame is absolutely terrifying.

[@klineaugust]

that green screen shot w the red lighting in the video game world is soooo cool

[@unconcernedsalad2]

YES that shot lives in my head

[@ChrisQuitsReality]

I used to glitch outside of maps in Halo 3 and this was the effect. Really cool to know what was happening and see it in action

[@OrangeC7]

I absolutely love the effect where specific things have a datamosh mask over them, like they have less than no texture. And I just love the whole idea of datamoshing representing something that can't be perceived, there's so much narrative potential there

[@gildedbear5355]

Oh yes, my mind immediately went to extra dimensional things that don't belong in our reality. Perhaps also tears in it reality, it portals to other realities. A patch of wall that looks almost normal until something passes in front of it.

[@Paraselene_Tao]

This channel has a profound appreciation for art, specifically game art. I can appreciate that. Thanks, and I've subbed.

[@FatterPidgeon]

I love how I started following you for your music years ago and you've become a Technomancer. What a ride!

[@Jam2go]

Thanks for sticking around!

[@TheEvelynMakesThings]

Technomancer?!?!?! Starfinder reference?!?!?!

[@RockySmithsen]

This was already the most perfect video and then you had to mention CONTROL ?!? I’m crying 😭 I had no idea how in love I was with this vibe and aesthetic until you captured and created it perfectly

[@Jane64826]

ikrrr, i was thinking of control the whole video, it could have even been a video inside of control lmaoo

[@Hambs23]

Really nice video showing this effect, it gets the brain heating up imagining how it would fit in different games. I also really like that reflection on "mistakes" in media. Personal opinion, but I like frame drops in games whenever there's a big impact, like a giant explosion or when there's too much stuff on the screen. It feels like whatever is going on is too intense for the machine to handle. It increases the "oomph" of those moments.

[@CloudPhase]

8:25 The video suddenly just became something I would expect to see on Posy's channel

[@inventerlender]

was gonna say this!

[@ClockworkMan13]

FYI Datamoshing is also the explaination behind "ghost" videos where somebody appears or disappears on crappy CCTV cameras. It usualy happens because the object is in a dark area or too far away for the low res camera to recognize until half-way through the object's movement.

[@internetuser8922]

Datamoshing, digital glitch effects, AND a Peepy?! This may be my new favorite channel.

[@montyvr6772]

Do I want to know what a peepy is?

[@pladmitry]

Paused the video to look for a comment that mentioned peepy

[@fatcatpoppy]

The song starting at 8:35 might actually be one of my favorite pieces of music ever made, gives this sense of being nostalgic for the future if that makes sense. I’m crushed that it’s unreleased, cannot wait to hear the whole thing eventually!

[@obsidian9998]

0:05 Low blood pressure moments.

[@ieatmicroplastics]

waking up with low sugar

[@moistenvelopes]

This comment just ruined my life

[@williamhiles9713]

Yep lol. Blacking out suuuuuckkkkkssssss

[@hazonku]

I've been hoping somebody would figure this out and it looks just as awesome as I expected it might. I really liked using the depth shader to inform the data moshing. That was super cool! Good to see the Bob Weisz video again.

[@JaquesBobe]

Closing out with that Brian Eno quote was perfection

[@sillycat005]

this is honestly really cool. i dont know a single thing about game development but this guy explains it in a way that makes it really easy to understand and makes me wanna start trying out making games

[@JayTheDevGuy]

Holy shit wake up babe your favorite game dev KZbinr's favorite game dev KZbinr posted

[@emilyyyylime-]

omg my favourite game dev KZbinr's favourite game dev KZbinr is also my favourite game dev KZbinr O:

[@bingonight1504]

so cute 🥰

[@Jam2go]

Thank you Jay!!!

[@alexathegator]

truly, the Chappel Roan of game developers

[@Jam2go]

@@alexathegator J A M T O G O

[@SmokeandSpirit]

I especially like when you got the glitches to happen in sync to the music. So cool.

[@reedrendered]

in regards to the ending of the video. It reminds me that you must first learn realism in drawing before stylization. All this emphasis on realism in gaming is just a stepping stone to making better stylized games

[@killsode4760]

I'm not sure I agree much there... You don't need to draw so well it's nigh identical to a photo to be able to draw well stylised. Videogames have already well gotten past that point.

[@dopaminecloud]

Yeah not quite right but its in the right direction. As you say, one must LEARN "realism" (what you actually need to learn from is just real life). But there is no need to produce realism. Learn the laws of perspective, anatomy and light yes, but you don't need to draw a hyperrealistic drawing to actually apply these elements. Videogames have always been concerned with emulating parts of real life and that's why incredible stylized games have been around for an easy 3 decades. The effort to replicate reality closer and closer with technology is not necessarily bringing us any closer to a better understanding of reality. That is to say, whether you simulate all light in real time or draw glare on a window into your pixel art, the principle of studying from real life is applied in either case. The latter has nothing to gain from the former existing.

[@Kenionatus]

Ray/path tracing​ looks pretty dope in a lot of stylized games, e.g. Minecraft. It's a technique to more accurately simulate light(ing). Whatever lighting magic Vallheim is doing looks great too, and it looks very realism based and fairly modern too. @@dopaminecloud

[@jem5636]

One essential thing we are still improving on is physics simulations, and pushes in video game technology for faster physics also helps the sciences, because light, water, and solid body physics have practical applications there. It's not always one-to-one, but they do benefit each other.

[@lev7509]

One example would be Lethal Company: it combines realistic volumetric lighting with intentional grit, downsampling, edge reinforcement, and of course, somewhat crude models. It is a highly recognizable feature of the game, and perfectly intensifies the horror and the comedy elements at the same time: The lack of visual fidelity allows the players' attention to linger on the dread of the dangerous, surreal, lovecraftian unknown. It amplifies the feelings of losing and finding oneself that the game often induces: the cones of light coming from lamps contrast perfectly against brightness-banded darkness with only one or two shades. Meanwhile, at the same time, the lack of visual fidelity also allows the player to detach and laugh at the absurdity of the crudely-but-lovingly-modeled creatures and items they have to deal with.

[@Dizzleman]

This video was awesome to watch man. Wicked visuals, a killer soundtrack & an insightful lesson about datamoshing. It's something I have to implement into my own work at some point, thank you for giving this in depth analysis of the subject!

[@SkinChangerDev]

I love the idea of creating an effect for something that gets just wiped from existence using data moshing instead of just a black void or dust. because when you turn it black, something is still there. but with data moshing, it's like a breakdown of your very senses, unable to perceive the lack of anything and everything.

[@supremebuffalo6322]

this is honestly incredible, I cannot WAIT to see this implemented in future. Theres probably millions of ways to use this

[@ExterminatorElite]

7:05 Definitely a great effect for a horror type game. Something getting moshed out of or into thin air is pretty spooky! I feel in much the same way as past generations who grew up with black-and-white television disproportionately dream in black-and-white, modern generations have digital media embedded in their imaginations, so effects like these can be strangely dream-like (or nightmarish).

[@276-]

this is so cool! i've been a fan of datamoshing for a while now and it's nice to see how it can be incorporated in other programs rather than video files itself too.

[@akuro2685]

This is so sick!! You and Acerola should make some weird shaders together, his real time pixelsorting vid is also super dope

[@Jam2go]

Acerola is so good!

[@alexhiatt3374]

haha I thought this was an Acerola video at first bc the profile pics are similar

[@ali.3d]

This entire video is so well done, I love seeing technical artists delve into these topics with amazing story-telling at the same time 👌🏽 Keep it up mate, it's so inspiring!

[@jameender]

This video is game dev in its most artful form, from the explanation of the effects to the extremely fitting music, what an experience.

[@chocladc4942]

The philosophical speech in prose over a guitar toward the end of the video had a FLCL vibe, and I mean that in the most complimentary way

[@ZechariahB]

I only heard of data moshing before playing this video because I often seen it paired with loud screaming memes to appear funnier.

[@gonderage]

like those vids of Peter griffin injuring his knee or eating a rice cake and absolutely spazzing out the video so funny

[@guappanese]

the most boomer way of explaining anything ever

[@Unethical.FandubsGames]

2:25 You are almost right. P-frames and B-frames don't just have motion data. They also record changes in blocks and can even be used as references, themselves. The motion data is recorded in P-frames and B-frames but done so using a variety of motion estimation methods. The result is that P-frames will record how a black pixel moved from pixel 0 to pixel 20 but also contains subpixel information and may even contain new chroma-luma data about a macroblock elsewhere that future frames can reference. They also store information about the pixels that aren't changing if it's relevant.

[@lejgaming7031]

YOUR MUSIC IS SO FUCKIN GOOD im a producer and i really care about quality stuff that the creator actually cares about, i dont see many creatives really challenge themselves and make momentus pieces of art its really inspiring seeing you succeed creatively in all these fields and reminds me to keep being a bit delusional about finishing projects. i will finish this album now. just know I truly think you are breaking ground. :)) you are the favorite artist's favorite artist

[@davidmc971]

Great work and explanation! I find it looks super inspiring and artful to play around with 😁

[@volgavis]

Just wanna say I love this series. I always find joy in listening to someone nerding out but they also want you to be included and have a good time. Also hearing Brian Eno's take on how some "shortcomings" of a medium carry the potential to inspire awe was so interesting. Just goes to show how creative we can be, turning glitches and artifacts into a message that anyone can understand.

[@Plaegu]

You are one of the very few creators on this platform that make me feel things only my soul understands.

[@1coopdog2]

I love how you went into this project not wanting to make a horror game and keep making cooler and cooler stuff that would be awesome in a horror game.

[@hehashivemind6111]

There is something truly beautiful, nostalgic, and deeply brain tingly about this video. It makes me nostalgic of all the super artsy nerds who do this kind of work, and just existing in that art space. I’m envious of artists like you.

[@SHINXANTA]

Datamoshing and Analog Feedback are some of the coolest glitch effects. This is one of the coolest breakdown videos I've seen. Clean music too, dude. You're an incredibly skilled creator.

[@Jam2go]

Thank you!

[@guacaprole]

Wow. I don't even know what else to say - I'm blown away by the beauty in this video. You've instantly earned a subscriber!

[@Ampm4d]

Accidentally made the best cloaking ever 6:32

[@Xunothegoat_]

this is beautiful, nice editing, nice music, and a cool implementation of effects. it's dope to feel your creativity

[@petarpetrov6385]

I LOVE YOU. As a a gamedev I've always wondered and dreamed of how datamoshing and effects similar to it could be achieved and used in video games! GOD, this has opened so many doors! THANK YOU.

[@Randomini]

All of these deep dive videos are fascinating, and I'm really glad that you're sharing this knowledge with everyone in such an engaging way!

[@1ups_15]

Your explanation of data moshing is really good! I knew what it was but you explained it in a way that made me really understand how it behaves

[@Jam2go]

Glad it was helpful!

[@rismosch]

Absolutely amazing. One of the coolest KZbin videos I've seen in a while!

[@user-mo3zy9mq3r]

Absolutely stunning work. Thank you! Glad you liked the plugin :)

[@Jam2go]

Thanks again!

[@Zyx3ds18]

this video isnt just good as an informative piece, but is incredibly entertaining and more than worthy of artistic merit. godspeed you renaissance man

[@SirBitesALot101]

8:42 This is adorable

[@quinn4160]

One of the coolest game dev videos I've ever seen! So well edited and scripted, and the actual datamosh shader is sick

[@thundernfm]

7:00 Imagine implementing an actual, true-to-vision lovecraftian creature. This idea is just begging to be put into a boss battle.

[@jeezuhskriste5759]

Bullet hell boss with datamoshed projectiles would be sick

[@interweb_loser]

1:18 i am so glad you mentioned the ok go video because wtf started playing in my head as soon as you started demonstrating the effect

[@Paul_Kessel]

So cool !! And was very pleasently surprised by the Brian Eno quote moment at the end of the video, it was perfect

[@SynFlood0]

This has crazy potential! Would love to see this in a full game. So much cool story telling you can do, so many mechanics than can utilize this, great work!

[@Banaanionmarja]

The real time datamoshing at 4:30 really reminds me of some of the effects in control the videogame! EDIT: damn you beat me to it

[@mikieswart]

damn both y’all beat me to it lol

[@saltysoyman6908]

Can I just say that the music was so on point? Made a super cool effect absolutely unreal.

[@SidneyM559]

theres a lot of really cool stuff in this video. I feel inspired to experiment with 3d environments and shaders again

[@Jam2go]

Yesss

[@Curly_Music]

The outro of this video has got to be one of the most abruptly artful pieces of educational game dev content I've ever experienced. geneuinely beautiful video making.

[@YonatanAvhar]

This is so cool. There is a pair of open-source programs, Sunshine and Moonlight, that are a server and client for NVIDIA's GameStream protocol, they can encode and decode video in real time with very low latency, even over a network. I imagine that one could hack on them (probably Moonlight, the client) to drop I-frames on purpose to create this effect for real

[@danielo7568]

the moment i saw the mosh locked to certain objects, first thing i think, an enemy that walks towards you so you cant percive it clearely....bam exactly that with some darknes to enhance it, absolutely terrifying, love how it works so well.

[@InCartersEyes]

That Brian Eno quote was a perfect end to this video. Thank you for sharing that.

[@TheNewJavaman]

This is art. Amazing work

[@famitory]

i love it, and i bet it would work even better combined with the JPEGification shader to introduce the macroblocking and DCT intraframe compression that usually goes along with the heavy inter-frame compression that get associated backin the day with codecs that tended to lose i-frames when played back. good old fashioned DIVX and .avi files of a pirated season of TV on a single-sided DVD-R

[@dejay100]

I always like games who actually go for interesting effects instead of just becoming more realistic.

[@XShrike0]

11:15 Why do techbros ruin everything in general? There is a reason the below resounds so well. "Sci-Fi Author: In my book I invented the Torment Nexus as a cautionary tale Tech Company: At long last, we have created the Torment Nexus from classic sci-fi novel Don't Create The Torment Nexus"

[@maxalon2479]

ngl this actually works pretty well for telling the difference between inventing and creating

[@Kaldrin]

I love it, it looks so cool and you used it in very creative ways damn. How you also find time to make music on top of this super cool game stuff is beyond me (love your music btw)

[@GemA2Gen]

these videos are so fascinating to watch, you're doing amazing stuff jam

[@Jam2go]

Thank you!

[@xPopzicle]

I absolutely love the tracks that you have created for this video, adding some of these to my playlist

[@Monkeymario.]

2:13 I'm not looking at you I'm looking at the cat

[@caseyogden7105]

we love data-moshed kitty

[@Bribge]

I am immediately going to mess about with the scene motion vector in a shader now, I think it could make a cool distress-feeling shader. Also, this was brilliantly put together

[@The_Dragon_Bi_dot_jpeg]

8:56 m a x w e l l

[@DevNojo]

3:01 The question of how those tiktok morph videos are made has eaten at me for like 2 years, but i never searched it. Thank you from the bottom of my heart for adding this in the video.

[@myrhadev]

Damn... I got mentioned at 4:50 :O Great video, truly an amazing effect

[@falxie_]

incredible video loved the quote at the end and seeing how conceptually easy the effect is too

[@ThylineTheGay]

9:39 now that could be some great _"reality collapsing"_ effects

[@cupofdirtfordinner]

you are out here making the coolest visual effects ive ever seen. acerola is close but your focus on y2k and camcorders and video-specific artifacts is really interesting to me. ty jam2go

[@TreytheMilkDrinker]

3:11 is what I see after my lobotomy

[@一四七企鹅]

that's sick. what a fantastic work. hope more in future!!

[@Aaylias]

6:55 I'm praying that Insomniac uses this for their next Spider-Man game for Miles' cloak effect, I just hate the current blue one.

[@crewrangergaming9582]

Dang, this video was a treat to watch, this channel is GOOD! Gives the Veritasium kinda feel, I think if you keep going like this you will produce high budget videos like him ! SUBSCRIBED!

[@lookapooka]

love the digital psych vibe, reminds me of the windows media player visualisations lol

[@Jam2go]

Yesss, I think a bunch of those are built off of feedback effects

[@lookapooka]

@@Jam2go makes sense! if youre ever stuck for ideas a video on reverse engineering them would be insanely cool

[@theseusswore]

such a weird little channel. graphics is incredible, its so interesting in all aspects. but im not that interested to know much about it, yet i still find myself watching your videos through to the end. its not just your incredible, catchy editing, the fluidity of your videos is so fun to watch!

[@InterPixelYoutube]

can I just say, 9:35 is a masterpiece on its own

[@pike_perch6397]

Thank you very much for showing how this effect works. In fact, for a very long time I tried to repeat this effect in my game, eventually I abandoned the project because I did not know how to make a datamosh. Enemies at 7 minutes is exactly what I wanted

[@Yahboykatra]

So glad I subscribed to you after your 3rd person video. I feel like we share a brain of abusing artifacts in a controlled way as effects!

[@blastermaniac]

Found this video at 2:34 AM while being unable to sleep this guy's unbelievably relaxed way to tell things made me able to fall back asleep after finishing the video

[@lerk.]

9:28 how about no

[@WockMonkey]

I was like 😮 so called out

[@kebman]

This took me right back to the demo scene of the '90s! Thank you!

[@jaybanzia]

illegal. amazing. terrifying. delish. 10/10

[@xinerayt]

HELL yes!! I have been attempting to create this effect from scratch myself for a long time but never got it just right. So cool to see you do a great job at recreating it, might get me to start developing my game again.