Mark Stead

Пікірлер

@MarkStead 17 күн бұрын

I've discovered that camera focal length (zoom) changes do not generate valid motion vectors. See the details in the video description, and a link to the Blender defect. This technique will fail badly if you animate the camera focal length.

@millthor Ай бұрын

Thanks a lot! I appreciate all the great work you have made!

@sujataacharya8261 Ай бұрын

❤❤❤❤🎉🎉🎉🎉

@Ruuubick Ай бұрын

Tried this method and unfortunately the group node didn't seem to do anything? Using 4.1 for reference. At least I got to get more familiar with EXRs and some new passes as a result still!

@Whalester 2 ай бұрын

I can't seem to get it to work. when there is still more noise in my scene than simply using a normal denoiser node

@Whalester 2 ай бұрын

I noticed when using the debugger, to get my motion colors to show at proper exposure I have to change the intensity down from 300 to 5. I don't know how to apply this to the non debugging denoising node.

@MarkStead 19 күн бұрын

The intent wasn't to do away with normal (spatial) denoising, instead to give it more samples to work with so that it can deliver a more accurate and hopefully temporally stable result. Of course if you're rendering with lots of samples anyway, then you may be able to eliminate spatial denoising - so long as you want some fine (or at least finer) grain in the render. Right now I'm working on an animation with fog, and specifically using this to denoise the volumetrics pass only. There's lots of noise in the volumetrics, and the spatial denoiser completely eliminates the noise, however when you watch the animation there's noticeable brightness changes - which are exacerbated by smoothing the volumetrics completely.

@MarkStead 19 күн бұрын

The visualisation is converting the distance into a luminance/colour value, where the larger the distance moved results in a brighter luminance. The intensity value you're referring to is to control the conversion of the movement distance (in pixels) to an luminance value - where you don't want it to be too dark or too bright. It only applies when using the debugger mode.

@Mioumi 2 ай бұрын

Thank you! That's some real good insight

@Essennz 3 ай бұрын

What app did you use?

@blenderheadxyz2418 4 ай бұрын

wow thanks a lot

@Prateekmunjal97 5 ай бұрын

Mf using ai from 14 years

@insertanynameyouwant5311 5 ай бұрын

a bit of dilemma, enabling vector pass only works when there`s no motion blur activated. But I need it also

@MarkStead 5 ай бұрын

I didn't know that. I just assumed it was possible. You could do something crazy like render out a sequence with one sample, no motion blur, and the vector pass. The problem you've got is that vector represents the position at a single point in time, and there's no way to get the range of movement for the visible blur. (The blur may not be linear.). Maybe when the movement is very low temporal denoising might still make sense, but then the denoising could be automatically disabled in the areas of the image with more movement and blur (and perhaps is less noticeable anyway).

@shanekarvin 5 ай бұрын

Thanks Mark!. this was very helpful

@unrealone1 7 ай бұрын

Reminds me of 911.

@SapereAude1490 7 ай бұрын

A few years back, I was tackling this same problem in Vray for 3ds Max. Vray had a tool back then, a standalone vdenoise.exe in which you could specify how many frames you want to consider before and after. I downloaded the old documentation, and found this description of what it takes into account when denoising, and it's quite a lot: Noise level (named noiseLevel) - The denoiser relies heavily on this render element to provide information used during the denoising operation. Defocus amount (named defocusAmount) World positions (named worldPositions or wpp) World normals with bump mapping (named worldNormals) Diffuse filter (named diffuseFilter or VRayDiffuseFilter) Reflection filter (named reflectionFilter or VRayReflectionFilter) Refraction filter (named refractionFilter or VRayRefractionFilter) I suspect that the devs at Vray tried (or did) model how all of these affect the denoising and are using some fitted equation with weights based on all of these channels + the temporal images. I was messing the other day with OpenImage Denoise (oidn) 2.1 and managed to make it running outside of Blender on my AMD GPU. The speed up was roughly 2x on my RX6950XT, however it only thakes in the noisy image, normal map and albedo to do the denoise, so I'm thinking Vray has a more sophisticated algorithm. But all of this had me thinking. Perhaps a crazy idea, but what if we render double the number of frames, apply the temporal denoising, and then throw away every second frame, to get the same FPS? Basically, "oversampling" in the time domain for the purpose of better estimating the changes from frame to frame, and better denoising the image?

@rami22958 7 ай бұрын

Now that I have finished creating the node, do I have to convert it to an image again, or can I convert it directly to a video? Please reply.

@MarkStead 7 ай бұрын

👍 You can output as a video file. Just going from memory, you would (1) connect the denoised image to the Composite node, and then configure the output settings in the normal place, or alternatively (2) use the File Output node and specify the output settings in the node properties (N panel). Output using FFmpeg Video with MPEG-4/AV1/etc.

@pablog.511 8 ай бұрын

This method works with PNG rendering method??? (I render the frames in PNG first, and then combine them in a video editor)

@MarkStead 8 ай бұрын

That's what I demonstrate in the Frame Blending part of the video. In the parts of the frames where there's movement there will be blurring. I guess you could say it's like an unsophisticated motion blur effect.

@user-tp3eq8zf1z 8 ай бұрын

Thanks, but how do I save the temporally denoised after compositing them?

@MarkStead 8 ай бұрын

Yeah sorry about that - all the screen captures just show the Viewer node. You need to add a Composite node, and connect Image input. Then set your Render Output settings (presumably now rendering out as H.264 using FFmpeg Video), then activate Render Animation (Ctrl+F12).

@djdog465 8 ай бұрын

wow you are such a pronumeral

@LiminalLo-fi 8 ай бұрын

Hey Mark it looks like you are looking for median denoising. kzbin.info/www/bejne/bmaUlHiBZbmUqNE at about 8:00 minutes in he briefly goes over it, so if you have any deeper knowledge on this guys set up I would love to know!

@MarkStead 8 ай бұрын

I did try using a median function, but didn't get better results. There's still a median node group implementation in the debug denoiser that you can hook up and try. I ended up focusing on what noisy pixels are like, where they might exhibit a different luminosity or a significant color shift. I tried a fancy (or dodgy) algorithm to apply a weighting to the hue, saturation and luminosity differences and exclude samples where the difference exceeds a threshold. I'd appreciate any feedback for where you see an improvement using the median function.

@LiminalLo-fi 8 ай бұрын

@@MarkStead will let you know if I come up with anything useful. I am also looking into Blender to Unreal Engine, for its rendering speed.

@LiminalLo-fi 8 ай бұрын

@@MarkStead So for my current project I am getting a perfect sequence with just a single pass denoise on each of the 3 frames ---- running "next" and "previous" into vextor displacemnt ------- running those 2 outputs and the output from the "current frame" into your median group then OUT. [(just the utility median blend group not any other parts from your package)] I will have to render it and see what it looks like in premier but it already looks cleaner than the averaged frame method I tried earlier. I mean it looks really good!

@LiminalLo-fi 8 ай бұрын

my scene is a pretty simple project and not a heavily detailed with minimal objects, so I'm not sure how much that plays into the final result others may have.

@МихаилВысоцкий-я5о 10 ай бұрын

Awesome work! You deserve more views!

@himanshukatariaartist 10 ай бұрын

How can i create such videos

@udbhavshrivastava 10 ай бұрын

This was such a thorough analysis ! appreciate the good work mate.

@aulerius 11 ай бұрын

Do you know if there is any way to minimize the occlusion masks including edges of objects, even when they are stationary? Does it have something to do with aliasing in the render? I am using your techniques for a different purpose (in projection-mapping textures on moving scenes, to distinguish occluded regions and inpaint them)

@MarkStead 11 ай бұрын

Have you looked at Cryptomatte? At one point I was trying to use the Cryptomatte node to distinguish between different objects. The problem is that it is designed to be used with a Matte selection - so then I tried to understand how the raw Cryptomatte render layer was structured - referring to this document raw.githubusercontent.com/Psyop/Cryptomatte/master/specification/IDmattes_poster.pdf However it was an impossible task for me - since there is no unique object ID for a given pixel position. Specifically the Cryptomatte data represents all the source objects that create the pixel (including reflections, anti-aliasing, transparency, motion blur) and a weighting for each. If you're able to make a Cryptomatte selection for the occluded region, then this should give you a mask with properly anti-aliased edges. However (not that I understand your project exactly), perhaps you could also be looking at the Shader nodes and rendering those faces with emission and everything else transparent (perhaps using material override for the whole scene). You might be able to use Geometry Nodes to calculate the angles to the projector to give you an X/Y coordinate. GN could also calculate the facing angle and therefore the level of illumination falloff (or whether a face is occluded completely).

@MrSofazocker 11 ай бұрын

How to get more "free" samples in blender, without blending different frames: Simply render the same frame at a different seed. combine those. You can most of the time, only render a third or a half the samples. which might even be faster than rendering the image once with full samples.

@MarkStead 11 ай бұрын

I'm not sure that really helps, though it might seem to. Rendering more samples is effectively giving more seed values because each sample has different random properties that result in light rays bouncing differently throughout the scene. In some cases a ray will randomly hit the diffuse colour, and in other cases it does a specular reflection (with a slightly different random bounce angle).

@MrSofazocker 11 ай бұрын

@@MarkStead Please try, combining 3 "Seed renders" with say 500 samples, will give you a better image than rendering it once with 1500 samples. If you get what i mean. (I use M4CHIN3 tools, and he has that built-in as an custom operator in the Render menu) When rendering, each sample uses the same seed. If you ever rendered an animation with a fixed seed, you will notice that the noise stays the same. Bringing that to the extreme and only render with say 20 samples. You will notice the same pixels are black (not sampled at all) in the first frame as well as in the second frame. Now, using the same logic on a still frame, and rendering it with only 20 samples, but a differnt seed, now other pixels are black (not rendered). Of course this difference gets lower and lower depending on how many samples you start out with, but since we are not rendering to infinite sample, it will improve the clarity for low samples. It's the same effect as rendering an image with 200% resolution and half the samples. after denoising and downsampling you get a better image, as you gathered more "spatial samples". As one pixel previously was now 4 pixels to sample.

@MrSofazocker 11 ай бұрын

This does get a little funky since Blender doesn't let you set the rays per pixel, but just an overall sample amount (Which is pretty dumb), regardless it still works.

@MarkStead 11 ай бұрын

Yeah, in an earlier version of Blender (I guess 2.93 and earlier) there was Branched Path Tracing. This allowed you to specify how many sub-samples for different rays (e.g. Diffuse, Glossy, Transmission etc). So the benefit is that you can increase the samples where it matters - e.g. Glossy or Transmission. Furthermore I guess I saw it as a way where you didn't need to recalculate the all light bounces from the camera every time. However in my testing way back then, I actually got better results using Branched Path Tracing, and setting the sub-samples to 1 only. Anyway, if you're getting good results by modifying the seed value - then go for it. This is an excellent technique if you render scene (particularly for a video) - then decide you should have used more samples. Just render again with a different seed - and merge the frames.

@BlaBla-sf8pj 11 ай бұрын

thx for your help

@c0nstantin86 Жыл бұрын

I need year and month stamps on each photo. I'm trying to figgure out my first memories before age 4 where they came from and in what order.

@MarkStead Жыл бұрын

Good suggestion. I've added timestamps to the subtitles. I hope it helps.

@c0nstantin86 Жыл бұрын

@@MarkSteadthank you... it helped a lot... so unlike my older brother, my earliest photo of me is when I was 1.2 years old, when my grandma tried to show my parents that my arm regenerated since birth and I had no remaining deffects... that's why I have no earlier memories of them... that's why they behave so badly with me... that's why they sent me to the mental hospital when I tried to become a monk... that's why they ware so concerned with keeping my mind busy with marriage and job... so I wouldn't stop to try to remember everything and figgure out their lies ... 😢

@traces2807 Жыл бұрын

These time lapsed video 'diaries' are so beautiful and emotive. Incredible. There is one called 'Portrait of Lotte age 0 to 20' that is worth watching. Lump in my throat every time. Our babies grow up far too fast.❤

@M_Lopez_3D_Artist Жыл бұрын

Hey ive been rendering EXR with blender and i don't see Vector or Noisy Image and i have that checked on my render passes is there something im missing?

@MarkStead Жыл бұрын

Check it's saved as a MultiLayer EXR.

@M_Lopez_3D_Artist Жыл бұрын

i will do that right now hope it works all keep u posted @@MarkStead

@M_Lopez_3D_Artist Жыл бұрын

i figured it out it has to be selected to layer setting instead of combinded, when i set it to layer it showed all the inputs that i was wanting awesome@@MarkStead

@M_Lopez_3D_Artist Жыл бұрын

it works but how do i use this for a 250 frame animation@@MarkStead

@MarkStead Жыл бұрын

When rendering you render out your animation as MultiLayer EXR, ending up with 250 separate EXR files. Then import all the EXR files into a compositor session - importing as an Image Sequence (what I do is click on the first file, then press A to select them all).

@matejivi Жыл бұрын

Thank you! A shadow pass would be nice indeed.

@dimigaming6476 Жыл бұрын

this video is much easier to digest at 1.75 speed

@MrKezives Жыл бұрын

That's what you have to say after such great content?

@dimigaming6476 Жыл бұрын

@@MrKezives You're coming in with a negative mindset. The content/Information is great. All i said is that it's easier to digest at a faster speed. Everyone has different methods of learning things. We're all on the same 3D journey here, you have no enemies brother.

@zonaeksperimen3449 9 ай бұрын

Thanks dude

@kriskauf3980 Жыл бұрын

I legit thought this was some high tech battery-less remote. Thanks!

@thesammyjenkinsexperience4996 Жыл бұрын

Exactly what I needed. Thank you sir!

@siufa23 Жыл бұрын

thanks Mark. This is great explantation. Do you think its possible to automate the denoise process with a python script commandline wihtout the need to enter blender?

@MarkStead Жыл бұрын

I personally haven't done that. Here's the command line doco, and you can certainly perform rendering, and run Python scripts. docs.blender.org/manual/en/latest/advanced/command_line/arguments.html If you have a Blender file configured for compositing then you could presumably just render that from the command line, with no Python scripting required. Perhaps what you could do from a Python script is substitute node parameters for the filenames or the number of frames. You should be able to fully integrate Python with pretty much anything in Blender including adding/manipulating compositing nodes. For example in Blender if I modify the frame offset in the compositor, I can see in the Scripting window it has executed this command: bpy.data.scenes["Scene"].node_tree.nodes["Image"].frame_offset = 1 Obviously you have a lot of extra complexity of setting up scripts and and all the command line parameters. However it makes sense when you're trying configure an automated rendering pipeline. Does that help?

@Szzachraj Жыл бұрын

Cool video, clear explenation helped me with decison.

@leonarddoublet1113 Жыл бұрын

Thanks for the video Mark - a lot of clear detailed work to explain the process and functions. I appreciate it.

@djdog465 Жыл бұрын

cool video dad

@stefyguereschi Жыл бұрын

CORAL PEONY, WHAT A BEAUTIFUL COLOR👏👏👏

@stefyguereschi Жыл бұрын

PONY FLOWERS SO.SEEET. BEAUTIFUL, 😊😊🎉🎉

@michaelfaith Жыл бұрын

Just what i needed. Thanks

@fcweddington Жыл бұрын

Very nice! Just purchased! Working well. However, How do I add vertices to that spline?

@MarkStead Жыл бұрын

When in edit mode you can extrude from the vertex on either end, alternatively you can subdivide one or more vertices.

@fcweddington Жыл бұрын

@@MarkStead Excellent! Got it! Man! This is an absolute genius of a product. Thank you again so much. Have you ever thought about making such tools for Unity 3D? Their asset store is incredible. However, I couldn't find anything with such bridge creation.