You are doing .NET logging wrong. Let's fix it

  Рет қаралды 174,710

Nick Chapsas

Nick Chapsas

Күн бұрын

Пікірлер: 325
@nickchapsas
@nickchapsas 2 жыл бұрын
For those wondering, LoggerMessage.Define was left out intentionally because it's its own video coming soon-ish.
@CallumPooleProgrammer
@CallumPooleProgrammer 2 жыл бұрын
What about [System.Diagnostics.Conditional] attribute? That will not compile functions if a define is not present.
@JonathanPeel
@JonathanPeel 2 жыл бұрын
@@CallumPooleProgrammer I THINK, [Conditional] will still compile the methods, it just won't execute them.
@protox4
@protox4 2 жыл бұрын
@@JonathanPeel Yes, the methods will still be compiled, but all calls to them will be stripped, including all calculations inside `()` at the call site if the symbol is not defined.
@robslaney3729
@robslaney3729 2 жыл бұрын
Good, because LoggerMessage.Define does what your adapter is doing, but eliminates the object[] allocation. Using an adapter is worse, as you need to much around with DI as well
@vinybas
@vinybas 2 жыл бұрын
Also talk about BeginScope :)
@emjones8092
@emjones8092 2 жыл бұрын
Nick! Hi. I just wanted to express some gratitude for your participation and contributions to the community. I find your videos very accessible. I think the content is rich, and that you're a pleasing person to learn from. Your approach seems to give lots of care to integrity. We need that. Thank you for your videos!
@alvtech
@alvtech 2 жыл бұрын
Im using Serilog since 2016, its great to know that im in the right path.
@MrXzxzxc
@MrXzxzxc 2 жыл бұрын
Log adapter is an interesting idea. I have two possible additions to this. 1. We can use extension methods instead of separate interface/class. This would give us same functionality, but with better performance. 2. We can dynamically create methods for this class using source code generator, that was introduced in net 5.
@vincentjacquet2927
@vincentjacquet2927 2 жыл бұрын
I though of it too but then I did the following math: ((4 overload) * (6 log level + 1 "Log" with log level parameter) * + 1 BeginScope) * (6 overload from 1 to 6 parameters) = (4 * (6 + 1) + 1) * = 174 methods to generate. Those methods will be in the intellisense every time you want to log anything. And this only to avoid a new object[] allocation that is probably infinitesimal compared to the execution of the method you are logging, and only in the cases when the log level is not enabled. Considering all the benefits of LoggerMessage.Define, is this worth the trouble?
@endmrx
@endmrx Жыл бұрын
What about such extensions: public static void LogInformationPlus(this ILogger logger, Func getMessage) { if (logger.IsEnabled(LogLevel.Information)) logger.LogInformation(getMessage()); } logger.LogInformationPlus(() => "Log it");
@endmrx
@endmrx Жыл бұрын
And with parameters this way: logger.LogInformationPlus(() => ("Value = {value}", 5));
@jasondryhurst-smith6893
@jasondryhurst-smith6893 Жыл бұрын
@@endmrx The closure will make an allocation I think, although it looks cool.
@KvapuJanjalia
@KvapuJanjalia 2 жыл бұрын
Going further, there is also: - LoggerMessage.Define method - LoggerMessageAttribute and corresponding source generator
@khellang
@khellang 2 жыл бұрын
And with InterpolatedStringHandler, you can get a lot better perf even with string interpolation. I'd love to see a video on that 😀
@RENAUDADAM
@RENAUDADAM 2 жыл бұрын
Hey Nick, really awesome video. I love seeing your perspective on these sort of things. This video got me thinking about other parts of my code that could potentially be performance pitfalls. I ended up creating some similar benchmarks for the MediatR package. It is actually pretty interesting how much memory allocation is going on when calling handlers! Just as an example, calling the handler with the mediator, vs directly yielded execution time that was 50x slower and created over 1.5 GB of allocation over 30 seconds of iteration. Much like your logging example!
@peterriesz69
@peterriesz69 2 жыл бұрын
Apart from the performance gain templates allows logging providers to implement semantic or structured logging. We use sentry to capture warnings and errors. It will create tags for each of the arguments. It also uses the message tempate without all the noise from the arguments to group the logs. It makes the logs much easier to navigate.
@ArbazAbid
@ArbazAbid 2 жыл бұрын
Before watching this video, I never really cared about memory leaks and garbage collection. You changed my mind. Thank you for your video.
@binarybang
@binarybang 2 жыл бұрын
Thanks for the video. There's another potential performance-related problem left unattended here when arguments themselves need to be calculated somehow. So if you hide the level check in a wrapping method it doesn't go away. The head-on solution would be to use Func or something like that, but I'm not sure where and when it becomes a viable/worthy option.
@luvincste
@luvincste 2 жыл бұрын
the solution would be removing conditionally the debug log with #if DEBUG, so to avoid even the branching code
@protox4
@protox4 2 жыл бұрын
Warning: the specific trick used here will not work with AOT (ahead-of-time) compilers (like Unity's IL2CPP) due to them being unable to resolve value types in generic virtual functions. If you need this behavior in an AOT environment, use a concrete Logger class instead of an interface.
@nickchapsas
@nickchapsas 2 жыл бұрын
In that case you can simply use the if check
@Shogoeu
@Shogoeu 2 жыл бұрын
"Imagine if in a game server, the server pauses and does nothing" 15:00 It happened - WoWD emulators were notorious for this "world freeze" Thanks for the content - it's cold. Also, this GC was the reason Discord changed languages.
@GammerAdam
@GammerAdam 2 жыл бұрын
Nick is my man! He gives me very strong arguments to tell my collegues why I will delete their log calls :D
@killers512
@killers512 2 жыл бұрын
Thank you for the video. I've never thought the built-in logger is so inefficient.
@GrimReaper160490
@GrimReaper160490 2 жыл бұрын
Great video Nick. I could imagine this exact senario happening to a lot of poeple who werent even aware of the hefty cost behind the scenes. Looking forward to more content from you.
@Petoj87
@Petoj87 2 жыл бұрын
Hefty might not be the right word, if you care about a few ns per request, then i don't think c# is the right language..
@GrimReaper160490
@GrimReaper160490 2 жыл бұрын
@@Petoj87 was more referring to the default logger where allocations are still made if you didnt know about the method call still happening even if you changed the logging level.
@Petoj87
@Petoj87 2 жыл бұрын
@@GrimReaper160490 while there is a cost its not hefty is almost not even noticeable, unless you call it many thousand times..
@nielshenriksen1043
@nielshenriksen1043 2 жыл бұрын
I have been a developer fro 25 years - and even before that as hobby on C64 :D - and still I learn something new :) Thank you Nick
@sai5371
@sai5371 2 жыл бұрын
Hey Nick, Just wanted to express gratitude for the videos you put out on various topics. learning so much from you.. Keeping sharing!!! love from India 🇮🇳
@shanehebert396
@shanehebert396 2 жыл бұрын
Most logging systems aren't really that good, particularly for multithreaded and/or always-on environments. At one company, we had a very robust logging system. We designed it to be able to turn on/off levels and such while the service was running and it output a fair amount of information. One simple thing... being able to load it into Excel or, worst case (if the log was huge) Access or SQL Server in order to filter/query it down was very heavily used. Granted, it was a bit overkill for a typical consumer app, I guess, but that logging system was really, really helpful at times.
@darianferrer
@darianferrer 2 жыл бұрын
Great video Nick, I remember reading about this in Andrew Lock's blog with a different solution to solve this problem. To be honest I would like to know what's the reason behind .NET not having this implemented.
@sergeybenzenko6629
@sergeybenzenko6629 2 жыл бұрын
"You're gonna be blinded in 3, 2, 1... now!" You made my day))))
@Copexify
@Copexify 2 жыл бұрын
Upvote for double blind Nick Chapsas! Long days in the office? Remember to take care of yourself!
@denys-p
@denys-p 2 жыл бұрын
Just want to add few things: 1. (By default) config will pick both Appsettings and Appsettings.Development configurations. The variables from configuration loaded later shadows variables from “earlier” configurations. It is pretty simple and powerful concept - there is no need to write ALL variables in environment (dev, qa, prod etc) configurations, only these are needed to be changed. Common settings will be picked up from default configuration. It helps to have more simple and concise configurations 2. I’d like to generalize idea of this video to “try to avoid logs in application hot paths in general”. Logs are really expensive, especially console logs (in Windows, at least). I spent lot of time trying to understand why performance is 10x lower than I expected and finally found that console logs were the reason
@nickchapsas
@nickchapsas 2 жыл бұрын
1. Yeah it's an override mechanism, which in itself can be configured differently btw. 2. You don't need to avoid logs in hot paths. You just need to use their optimized versions. .NET supports the LoggerMessage.Define approach which is a cached delegate that's really efficient and won't box anything and also the source generated version which also uses the LoggerMessage.Define. No one is (should be) doing console logging in production, you would only do batched logging in something like Elasticsearch, Datadog and so on in the background. That's how Serilog sinks work. What you do need to be careful with however is overlogging. I usually won't log anything below a warning in production and if something causes an error or a warning I will retroactively log any information log in that execution so I can see the full story.
@andreasgkizis2135
@andreasgkizis2135 Жыл бұрын
Amazing explanation, even I as a noob feel i got the gist of it Thanks a ton again, cheers
@geertdoornbos
@geertdoornbos 2 жыл бұрын
GC is not always blocking your application. But good tips Nick
@dgschrei
@dgschrei 2 жыл бұрын
If you want to get rid of the performance penalty for having the additional method call, it might be doable by just adding the MethodImplAttribute with AgressiveInlining. I'd assume with the generics in the methods the JIT doesn't inline the calls by default so encouraging it to do so, might help (and since it's just an attribute you don't have much to loose putting it over the log methods).
@jamesbarrow
@jamesbarrow 2 жыл бұрын
Thanks for sharing that one, nice suggestion. I was thinking along a similar train of thought, considering something like AOP with Postsharp to add in logging code, but then I was also thinking more in terms of something like trace logging, which it most likely wouldn't be a good candidate for in the case of logging parameterized strings anywhere in the codebase.
@phizc
@phizc 2 жыл бұрын
You also have to call the methods on the concrete class, not the interface. The interface method is virtual and can't be inlined. In any case, when you're writing the adapter yourself that's not a problem. Edit: I wasn't 100% sure about inlining of the method if called on an interface, but now I've tested it. It won't.
@AnsisPlepis
@AnsisPlepis Жыл бұрын
9:40 favorite part. Great video :)
@CodewithSaar
@CodewithSaar 2 жыл бұрын
Nice video. It was great that you showed how to profile the app so that we can do it on our own. 👍
@samuelmontambault4518
@samuelmontambault4518 2 жыл бұрын
Great video! I would love to see a video about Patch endpoint in API. Always wondered how to implement it in .NET
@michawhite7613
@michawhite7613 2 жыл бұрын
Nick seems like the kind of person who would really really like Rust
@ayoubdkhissi
@ayoubdkhissi 2 жыл бұрын
This is very important, specially in production!! thank you!
@mojizze
@mojizze 2 жыл бұрын
Awesome video. Thank God for Serilog for making this easier to use.
@ernestmfakudze
@ernestmfakudze 2 жыл бұрын
Thanks, Nick, I learned so much from this video. For one terrifying moment I thought you might talk about something related to log4shell when I saw the title of the video🤣
@ygoe
@ygoe 10 ай бұрын
Sorry if this has been asked before but here are way too many comments to find anything in them. If the additional method call outside the if condition causes some extra runtime in the benchmark, I'd suggest adding an attribute to do aggressive inlining to it. Have you considered that? If it's picked up by the compiler, it would increase the compiled code size a bit but should avoid the extra runtime cost, making it compile- and runtime-equivalent to manually coding the if condition, but without the typing work and with the increased readability.
@Krzysztof20031997
@Krzysztof20031997 2 жыл бұрын
Great video, I haven't thought before about this aspect! Btw. Nick are you going to make a course about async, multithreading, etc.? I know that there are some videos about this topic on your channel, but I think that there may be still a place for a "From zero to hero" way :)
@nickchapsas
@nickchapsas 2 жыл бұрын
Thanks! I think I'm gonna start a separate series of courses that are a but smaller and focus on a single topic, like async or multithreading and might make them part of a subscription. I'm still working on the pricing and the plan, but more things are coming in 2022.
@Krzysztof20031997
@Krzysztof20031997 2 жыл бұрын
It sounds like an amazing opportunity to extend knowledge. I can't wait for it :)
@lost-prototype
@lost-prototype 2 жыл бұрын
As always, great videos Nick.
@novak-peter
@novak-peter 2 жыл бұрын
When using DI, how do you register the logger adapter? Would it be: - coped/transient - in this case if it is injected into another scoped one (e.g. a controller), wouldn't it be an overhead itself creating the extra object? - singleton - will a config change of the log level during runtime will applied in the singleton? (I really don't know about that, I should check how the runtime reload of the config works...) I would be curious about another benchmark: you would probably want to generate the random numbers outside of logging - because you "want" to use the value for something else - and only the boxing would happen ; how does that would compare for enabled and disabled log levels?) Actually, why not creating a PR in Microsoft.Logging.Abstractions to handle the boxings cases? Ok I guess that would not be that trivial, for all the dependent implementations...
@nexaroth
@nexaroth 2 жыл бұрын
You are pointing out a very interesting thing here. If you got any answers to the questions related to DI and generating random numbers outside of logging , I'd be happy to hear them.
@brooklyndev
@brooklyndev 2 жыл бұрын
Hey Nick, great video. Just wondering why you chose to do this using adapters, as opposed to just creating extension methods on ILogger?
@nickchapsas
@nickchapsas 2 жыл бұрын
Extension methods generally are harder to unit test and the default logger is basically impossible to unit test as it is anyways due to falling internal classes so adapters solve that problem plus the memory one
@vincentjacquet2927
@vincentjacquet2927 2 жыл бұрын
If you are testing your extension method, you simply have to ensure ILogger.Log method is called when it should and then that all you parameters are taken into account. In this case, mocking Ilogger seems pretty trivial (less than 20 LoC). formatter(state, exception) returns a string. So it is simple to test, whatever the type of TState is.
@nickchapsas
@nickchapsas 2 жыл бұрын
@@vincentjacquet2927 With the adapter I need 1 line of code. 20 is 19 lines too complicated
@edwardferron
@edwardferron 2 жыл бұрын
Dude this is a master class!
@wiepcorbier
@wiepcorbier 2 жыл бұрын
It must be great to know everything better.
@theanachronism5919
@theanachronism5919 2 жыл бұрын
One question I have for Serilog, is that in many samples for dependency injection for Serilog the Microsoft ILogger gets injected. If now the LogInformation Method from that logger is used we get the same problem again. So just inject the Serilog ILogger or use the static Log class?
@nickchapsas
@nickchapsas 2 жыл бұрын
Inject the Serilog ILogger. Don't use the static class
@jamesbennett5421
@jamesbennett5421 2 жыл бұрын
“Let me add two random numbers.. “ - Ohh, let me guess… :)
@daveB133
@daveB133 2 жыл бұрын
Hey Nick, really appreciate your work. Doing some reading and StackOverflow tells me that string interpolation turns into string.Format() at run time, therefore shouldn't performance be the same between the two? Thanks.
@zxph
@zxph Жыл бұрын
Very helpful video. Thanks Nick!
@shuvo9131
@shuvo9131 2 жыл бұрын
A great one Nick. Thanks for sharing
@hamedsalameh8155
@hamedsalameh8155 2 жыл бұрын
Wow Nick! what a great video!! Thanks a lot for sharing the knowledge.
@wasmannia2084
@wasmannia2084 2 жыл бұрын
Thanks! This is great stuff. Also, I kind of like your choice of numbers..
@aleksandrpiskunov7124
@aleksandrpiskunov7124 2 жыл бұрын
They introduced InterpolatedStringHandler in .NET6. I suppose, there will not be a problem to use string interpolation in logging soon.
@nickchapsas
@nickchapsas 2 жыл бұрын
That wouldn't fix the fact that you are destroying structured logging by doing that. You should never use string interpolation in logs because you are losing the parameter generated by the log. The log message is a template and needs to have the parameters passed as arguements
@Palladin007
@Palladin007 2 жыл бұрын
​@@nickchapsas You can use the InterpolatedStringHandler and the new CallerArgumentExpression (in the Append-Methods of the handler) to access these parameter names respectively expressions. However, in some cases, the expression would not be as readable in a structured log as a specially defined name. For these cases, you need a new variable.
@Mr767267
@Mr767267 2 жыл бұрын
Great video as always! Nick please try to make something for Centralized Logging using whichever open source tool you prefer (Kibana etc.)
@byrondelgado8165
@byrondelgado8165 3 ай бұрын
great video Nick!
@rickvelde7967
@rickvelde7967 2 жыл бұрын
It seems you are really missing out on a key feature here, the System.Diagnostics.Conditional attribute. You won't need to pepper your code with the boiler plate if statements, and you can completely remove the logging cost from your release build, as the log function will not actually be included in the build, but will syntactically still work as if it were there. It is as simple as: [System.Diagnostics.Conditional("DEBUG")] internal static void Log(params object[] list){ /*logging code here...*/ } Then it won't really matter if you are using string interpolation or whatever, because everything you do in those arguments will only happen when you are debugging.
@nickchapsas
@nickchapsas 2 жыл бұрын
Right, and how do I do that for Trace logs or Information logs during runtime with my application having different minimum log levels depending on the environment they are deployed at? Compile time conditionals are terrible for this usecase. There are better ways to do this that are coming on Thursday's video.
@rickvelde7967
@rickvelde7967 2 жыл бұрын
@@nickchapsas I hope you have a "have your cake and eat it too" strategy for your next video. Those if statements are ugly. At times like these I miss C++ preprocessor macros.
@nickchapsas
@nickchapsas 2 жыл бұрын
@@rickvelde7967 I do
@Xorgye
@Xorgye 2 жыл бұрын
@@rickvelde7967 In production environments you don't want to predefine log levels at build time. You want them in your code all the time. So you can switch (parts of it) on in production while an error is still present. At least on code that runs on servers. With client apps running on users own systems this is generally less of a concern.
@keithrobertson7579
@keithrobertson7579 2 жыл бұрын
Nick, very interesting choice for your two favorite numbers! 🤣
@andre.unsal.13
@andre.unsal.13 Жыл бұрын
It would be great if you specified the decision developers need to make when implementing logging on an API, vs. a Server sln, vs. a Wasm sln etc.
@jamesbarrow
@jamesbarrow 2 жыл бұрын
Thanks for the video. I think there's even another option if you really want to get that performance out, and also maybe improve having to put the if's everywhere, and that's using something like Postsharp to do AOP. The specific use case as well would be more along the lines of doing a kind of method trace logging. I remember when starting my software career, learning about Spring and AspectJ, where we did this kind of pattern in the one aspect, and then could apply tracing anywhere in the solution by just configuring some conventions. Not sure if it would always add the logging code for us, or if there was an option to not weave in the logging code based on a configured log level. But yeah, if you really want to you could build a solution to weave in all these logging statements with the if checks for a "Debug" build, and then for the "Release" configuration you don't even pay the penalty of the if statement because it's not even there ;) Though, I guess that comes with the downside of not being able to turn on the debugging levels at runtime without doing another release, but if you really have to, its another option I think :) (Also, just to note, I had a better experience with Java Spring and AspectJ, than with C# and Postsharp, so it's not that I'm recommending it, just mentioning it :B)
@Thornik2012
@Thornik2012 2 жыл бұрын
It's not about logging AT ALL, but saving a few bytes while using string interpolation. If you use it at all.
@nickchapsas
@nickchapsas 2 жыл бұрын
You totally missed the point. It is 100% about logging. String interpolation only gets a minor mention. You shouldn’t be using it in logging anyway. It is about the MS logging method boxing value types and allocating parameters
@user-v2u-c2j
@user-v2u-c2j 2 жыл бұрын
Great video as always!
@flksdajhfkadhnskldvha
@flksdajhfkadhnskldvha 2 жыл бұрын
You can just lower down resolution of your monitor to make everything looks good on video while recording, so you don't have to scale anything.
@mihaimyh
@mihaimyh 2 жыл бұрын
Hi Nick, can you make a video about CPU & memory usage debugging in .NET? I would love to learn how to do it, I've developed an app which consumes quite some memory and I am not sure how to check it.
@vmakharashvili
@vmakharashvili 2 жыл бұрын
Thanks for this video! Very helpful!
@anthony8090
@anthony8090 2 жыл бұрын
I think a follow up to how you use serilog would be interesting, as I am a serilog fan
@pfili9306
@pfili9306 2 жыл бұрын
11:11 - "Which is probably the first time we're using an actual random number" 😂
@Ziplock9000
@Ziplock9000 2 жыл бұрын
I use compile time conditional statements around debug logging if Im worried about performance
@maxbradley9534
@maxbradley9534 2 жыл бұрын
Interesting video. However I'm not sure I understood your point about using the generic arguments vs the params array. In these two cases both loggers had an if enabled check around them and the params one took 4ns and the generics one took 9ns. You said that this time difference does not matter (sure its tiny) and that the fact the generics one did not use memory makes up for this. However the params one did not use memory either. So as the params one was faster, why is it not preferred?
@khalednabilcs
@khalednabilcs 2 жыл бұрын
Thanks Nick 👍
@omarem81
@omarem81 2 жыл бұрын
Awesome information, thanks for sharing 👍🏻
@ram62836
@ram62836 2 жыл бұрын
Thanks Nick.
@noelfrancisco5778
@noelfrancisco5778 2 жыл бұрын
Great info, I learned something new again :). Thanks
@Spirch
@Spirch 2 жыл бұрын
start using random number 42 too :-P good video!
@watchchat
@watchchat 2 жыл бұрын
I always learn something new, thanks Nick! LOL the vars….up and down…I can’t unsee 69 & 420 and resort to 10 yo humor
@DummyFace123
@DummyFace123 Жыл бұрын
I think string interpulation works differently now, I’ve seen it turned into numbered templates as well as an object array
@NirWeber
@NirWeber 2 жыл бұрын
Nick, when using serilog, do you it with ILogger or with their static singleton Log class? Anyway an episode about ILoggerbor Serilog would be great 🙏 Thanks!
@nickchapsas
@nickchapsas 2 жыл бұрын
I tend to go with the singleton approach
@thehuggz-i9k
@thehuggz-i9k 7 ай бұрын
"Lets have a couple random things here...": 69, 420 Me: "yea... totally random" 😂
@arkord76
@arkord76 2 жыл бұрын
Thank you for the very interesting video, Nick! In a current project I am using the Microsoft.Logging.Abstractions as the adapter, and Serilog as the engine. As I understood you the benefits of Serilog would have no effect here, because the boxing still take place. Am I right? Sould I use the Serilog ILogger interface instead?
@nickchapsas
@nickchapsas 2 жыл бұрын
Yes you are correct
@arkord76
@arkord76 2 жыл бұрын
@@nickchapsas Thank you! Than I have a lot of work ahead of me 😂
@JustinAdler
@JustinAdler 2 жыл бұрын
@@nickchapsas This is my biggest issue :( Reusable libraries (aka nuget libraries) should be logging-framework agnostic, IMO. Which usually means they pass around an ILogger from Microsft.Logging.Abstractions. And the host application can then determine which logging framework to use: like Serilog! It's like a win-win scenario! But now ... we're getting the boxing/allocations problem :( So it's like MS should needs to update their adaptor to have the IsEnabled there .. and then we'll all be winning! Does this make sense?
@Denominus
@Denominus 2 жыл бұрын
@@JustinAdler I don't bother with the logging abstractions. Microsft.Logging.Abstractions isn't the first attempt at creating a logging abstraction for .NET but they always end up being leaky or limited. Performance issues aside, it's a pain to do logging from static methods with the MS logger. I just use the Serilog singleton in a static field (Log.ForContext....) and avoid the whole mess.
@alex22932
@alex22932 Жыл бұрын
​@@nickchapsas If we use the Serilog ILogger interface, do we give up the ability to use BeginScope to add properties to a scope?
@alexandernava9275
@alexandernava9275 Жыл бұрын
I am using the Roslyn Analyzer to just insert the if statements around my log methods. So I don't have to have an adapter, and so stack traces are cleaner.
@kuba54
@kuba54 2 жыл бұрын
out of infinte possibilities of numbers in the spectrum he chooses 69 and 420, you got my respect @NickChapsas
@Iron_Maniac
@Iron_Maniac 2 жыл бұрын
Well this might explain why I had a really bad memory leak/allocation when using log4net. After I switched to Serilog my memory usage went waaaaay down.
@commissarsydian4125
@commissarsydian4125 2 жыл бұрын
Just want to say thank you for being that collage professor i missed out on. Your videos are always enlightening, even if i am knowledge in some of the contents hinted in your titles i feel there is always something to take away when you start breaking the topic down.
@clearlyunwell
@clearlyunwell 2 жыл бұрын
Priceless! 👍🏽
@pfili9306
@pfili9306 2 жыл бұрын
Awesome video Nick. The dotMemory part especially. Do you think it's worth its separate video? It's great how you show various approaches to measure the difference in performance. Also on the part of string interpolation. Do you think the new InterpolatedStringHandler from C#10 can make interpolation to be a valid method of logging?
@nickchapsas
@nickchapsas 2 жыл бұрын
I might make a video on dotMemory at some point. No you should never use string interpolation for logging.
@georgefragkos2298
@georgefragkos2298 2 жыл бұрын
As always great video 💪
@garywongcorner
@garywongcorner 2 жыл бұрын
Thanks nick! it seems your video answered the issue of memory leak that I face last year. Do you have course for advanced topic like this?
@АндрійВишняков-о3й
@АндрійВишняков-о3й 2 жыл бұрын
A lot thanks for showing it.
@sebastianrafalko1330
@sebastianrafalko1330 2 жыл бұрын
Dziękujemy.
@tomwob1642
@tomwob1642 2 жыл бұрын
Great stuff Nick. But why is this not already build-in in the .NET Logger Class??? 🧐
@nickchapsas
@nickchapsas 2 жыл бұрын
Because it would be a breaking change so they couldn’t introduce it without breaking existing code of people using it
@bartomiejciurla8472
@bartomiejciurla8472 2 жыл бұрын
Great video. Thanks!
@arnorhjaltason6467
@arnorhjaltason6467 2 жыл бұрын
One problem with your demonstration here, you don't account for optimization. If you build a for-loop that only has if false in it, it will simply get optimized away, this is why you some things like 100000 faster execution with the if. This is a situation that is almost impossible to encounter since when would you log a variable that is created in the logger call. To fix this assign the variable before you do the check for the log level, this would simulate your original case from the Controller. But other than that a very good video, was very surprised moving from Serilog to Log4net that this was not implemented. Good usage of dotTrace as well.
@nickchapsas
@nickchapsas 2 жыл бұрын
Such an if check as shown in the video won’t be optimised away because it’s a runtime check. BenchmarkDotnet runs the jitted code. If false will only get optimised if it’s a compile time if false
@evarlast
@evarlast 2 жыл бұрын
Which logging library is this? Seems like a good reason to use a better logging library with better method overloads which pass without that dynamic array, at least for majority use cases.
@nickchapsas
@nickchapsas 2 жыл бұрын
It's the build in Microsoft one
@harag9
@harag9 2 жыл бұрын
Excellent video, thanks Nick. I've taken over looking after an OLD .net 4.6 frame work project that uses Log4net, but in the code I see a lot of log.debug("...") lines withOUT the if statement (or adapter) would you recommend this is also just as bad as your video was all to do with .net core 6 and not 3rd party old loggers.
@nickchapsas
@nickchapsas 2 жыл бұрын
.NET Framework is generally slower so I would expect it to be worse
@Palladin007
@Palladin007 2 жыл бұрын
The problem shown is a common one, regardless of which runtime you use. Therefore it is clear: you should address this problem. But with extension methods (I don't share Nick's opinion that extension methods are worse to test) you just need to create those extension methods and most code would use them right away - just make sure they are in the same namespace as the logger interface. As for performance, I share Nick's guess that the impact would be even greater in the old .NET.
@sagarchowdhury2493
@sagarchowdhury2493 2 жыл бұрын
Hi Nick it's a great video. Do you have any source code where you broadly used Serilog. I want to implement Serilog in my learning project.
@sulton-max
@sulton-max Жыл бұрын
Great video!
@JonathanPeel
@JonathanPeel 2 жыл бұрын
This video was great, thank you so much 👍🏻👍🏻👍🏻👍🏻 I am going to start using these `if`s Currently, I use extension methods to do logging, so I can add the if to the extension method. Do you know, if there is any Aspect or Fody that would replace the if statement? a Higher-order function might work, but the aspect would be neater. Thank you again for the video.
@nickchapsas
@nickchapsas 2 жыл бұрын
Not a fan of the Aspect/Fody approach but you can use source generated logging to get around it
@MarianoGomezBidondo
@MarianoGomezBidondo 2 жыл бұрын
Excelent Video!
@andrewalexopoulos921
@andrewalexopoulos921 2 жыл бұрын
Great video as always! Do you know if the "Serilog way" applies to other popular libraries such as NLog as well?
@nickchapsas
@nickchapsas 2 жыл бұрын
I have never used NLog so I wouldn't know
@j.s.9204
@j.s.9204 2 жыл бұрын
Nlog solves it the same way like Serilog.
@jemakrol
@jemakrol 2 жыл бұрын
Really interesting! My first thought is why logging is made so bad by default. Why not have a built in "if" in the log call to begin with, sort of? About string interpolation - I love it cause it's so neat to work with when coding - but am aware of it's performance penalty. The performance impact is not a surprise but that's not the only reason to skip it: localization is really not a good thing to combine with string interpolation. You don't wanna have expressions and variables as part of exported strings to the localization data. It's just... no. A random thought... This is not the first video you've made that makes me wonder why there's so much overhead that can be missed by the me as a user of the language. You've touched the subject about what the compiler does and many features in C# is actually syntactic sugar. I cannot see why features like string interpolation or logging with a built in if- wouldn't benefit from this too, minimising the risk of unwanted/unkown overhead.
@Dekon58
@Dekon58 2 жыл бұрын
You do not benefit from built in "if" while still using "params". Memory already will be allocated when you pass parameters to the method.
@Petoj87
@Petoj87 2 жыл бұрын
While I think this is a great topic, it's seems a bit overblown... sure doing a logging in a tight loop might be a bad idea and could get some use from a if... but unless its a tight loop or a extreme performance api I would not do this nano (not even micro) second optimization that would make the readability worse... 99% of applications don't need this and you should be a bit more clear about it.. Add a database/write/read file call and you wouldn't even notice the difference of logging or not logging... There is a saying "micro optimization is the root of all evil" and it is sadly true for a lot of your videos (example the enum video), i wish you be more forthcoming about that this is not needed in most projects and should only be done when all big optimizations are done.. I could do this trick or optimize a db query what would yield the biggest perfomrance impact? Any new programmer could be tricked and apply the optimizations you suggest where they aren't needed at all or where they could actually make other changes that would make a real difference. Sorry if I'm negative here but it rubbs me the wrong way when you say that you should be doing this to save a few ns per request..
@Er1807lp
@Er1807lp 2 жыл бұрын
Can only 100% agree with this. It's so small benifits for pretty much no gain. 2sec in 52sec gc is nothing. And that application did nothing basically
@BrokoIis
@BrokoIis 2 жыл бұрын
He is talking about high performance applications, not some internal management software which will have at most 5 people logged in at the same time. Think of hundreds and thousands of users using your application at the same time - the effect of logging things for each request could be compared to running logging in a loop on a single thread. Or, think about some "real-time" applications, like exchanges or as Nick said himself, video game servers. A few hiccups every minute could really slow down such programs. Also, it's not like his solution makes the code less readable or over-optimized. Adding a simple if doesn't really add much complexity, and Nick even showed how you can benefit from the added if, without making your code less readable, by creating a very simple LoggerAdapter, or using a library such as Serilog.
@Petoj87
@Petoj87 2 жыл бұрын
@@BrokoIis he never said its only high performance, but i would say this is something you only do in extreme cases where every ns matters, but if you're counting ns then i don't think c# is the way to go.. Also this should be about the last thing you optimize as there must be other changes you can make that would yield more performance improvements.. I mean we are talking about ns its not even ms..
@Er1807lp
@Er1807lp 2 жыл бұрын
@@BrokoIis You shouldn't write Realtime applications in managed languages. And all of his videos are designed for the avarage programmer. I think less than 5% of programmers are only that category of micro optimisation. Just querying a database generates way more data that's needs to be garbage collected anyways later. Furthermore servers mostly log into things like ES so there is even network communication involved. Cleaning up business logic is for that more intresting. Further more code should always be handled in a simple way. Because you or anyone else in 3 years will have no idea what you did there. Maybe not with this logging but some of the other remondations go in that direction.
@Petoj87
@Petoj87 2 жыл бұрын
@@mg00 what a friendly response, while i agree that all developers that have a few years of experience will know this without being told, but this is going to be viewed by those that don't.. If you don't care about new developers thats fine but i do.. What is the harm in being clear upfront instead of using sensational titles...
@ibnfpv
@ibnfpv 2 жыл бұрын
Great video and topic , Q: dose using the serilog but using the Ilogger abstraction is still benefit the Serilog level check ? Request: a memory leak diagnostic video. With dot net memory or other tool will be a great subject to overview by your side.
@nickchapsas
@nickchapsas 2 жыл бұрын
No if you’re using Serilog through the Microsoft ILogger you still suffer from the same issue
@11r3start11
@11r3start11 2 жыл бұрын
This checks should be done via source generation!
@nickchapsas
@nickchapsas 2 жыл бұрын
Source generators can't edit existing code
@Stanniemania
@Stanniemania 2 жыл бұрын
Did you consider using overloads for the log functions that take an IFormattable message? You can pass an "interpolated string" to it, but the string is only "rendered" when you ToString it. Even the expressions that are interpolated are only evaluated at that time (hmm this is not the case in my test but there should be I read it somewhere... 🤔). Yes, if you log the same thing in a loop it will still allocate a string multiple times, but all other problems discussed here should be resolved.
@nickchapsas
@nickchapsas 2 жыл бұрын
It's not a good solution it's just more overhead
@RawCoding
@RawCoding 2 жыл бұрын
What's the selecty / highlighty thing you're using?
@nickchapsas
@nickchapsas 2 жыл бұрын
It’s called ZoomIt
@RawCoding
@RawCoding 2 жыл бұрын
@@nickchapsas Thank you
@derrickc2823
@derrickc2823 2 жыл бұрын
Great video as usual! does it make a difference if you put the code inside 'using'
@nickchapsas
@nickchapsas 2 жыл бұрын
No
@DavidvanDeijk
@DavidvanDeijk 2 жыл бұрын
I am not doing logging wrong, .NET is doing it wrong. Going back to my log4j :P
@Micke2nd
@Micke2nd 2 жыл бұрын
interesting, thank you. And yes, I didnt use it well 🙂
High-performance logging in .NET, the proper way
15:56
Nick Chapsas
Рет қаралды 74 М.
That's NOT How Async And Await Works in .NET!
12:25
Codewrinkles
Рет қаралды 26 М.
СКОЛЬКО ПАЛЬЦЕВ ТУТ?
00:16
Masomka
Рет қаралды 3,5 МЛН
Farmer narrowly escapes tiger attack
00:20
CTV News
Рет қаралды 12 МЛН
Don't throw exceptions in C#. Do this instead
18:13
Nick Chapsas
Рет қаралды 262 М.
What is Span in C# and why you should be using it
15:15
Nick Chapsas
Рет қаралды 260 М.
The Fix For Your Database Performance Issues in .NET
9:12
Nick Chapsas
Рет қаралды 43 М.
C# Logging with Serilog and Seq - Structured Logging Made Easy
1:07:56
Writing C# without allocating ANY memory
19:36
Nick Chapsas
Рет қаралды 152 М.
.NET and C# are in trouble. Here is what I'd do.
10:57
Ed Andersen
Рет қаралды 107 М.
Brutally honest advice for new .NET Web Developers
7:19
Ed Andersen
Рет қаралды 262 М.
Don't Use Polly in .NET Directly. Use this instead!
14:58
Nick Chapsas
Рет қаралды 71 М.
CoPilot Review: My Thoughts After 6 Months
9:45
ThePrimeagen
Рет қаралды 556 М.
СКОЛЬКО ПАЛЬЦЕВ ТУТ?
00:16
Masomka
Рет қаралды 3,5 МЛН