Logging into Elasticsearch using Serilog and viewing logs in Kibana | .NET Core Tutorial
Вставка
- Опубліковано 24 сер 2020
- Become a Patreon and get source code access: / nickchapsas
Check out my courses: dometrain.com
Hello everybody I'm Nick and in this video I will show you how you can very easily get started with logging into Elasticsearch in your .NET core application. We won't go in depth on how Elasticsearch works and why it is a good fit for a log sink but instead I am going to show you how you can quickly use Serilog to replace Microsoft's built in logging mechanism and start pushing logs into Elasticsearch, which you can then use Kibana to view and analyse. There will be a second video coming showing some of the cool stuff that you can do in Kibana with those logs.
Don't forget to comment, like and subscribe :)
Social Media:
Follow me on GitHub: bit.ly/ChapsasGitHub
Follow me on Twitter: bit.ly/ChapsasTwitter
Connect on LinkedIn: bit.ly/ChapsasLinkedIn
#dotnet #elasticsearch #logging #kibana
I really appreciate the way you explain things, keep up the good work. thanks
Very nice. Excited for the full elastic search video
Thank you - I have been trying to get started with elasticsearch logging for a while without success. This was the video where I finally got it :) Great video, and just the right level of detail to your explanations.
Hello, first of all congratulations for your videos, they are simple and very clear and always touch on very interesting topics, also I really like your way of explaining, you can see that you love what you do and that you do it well Today I saw this video, and it would be nice if you made one on elastic stack and how would you structure your logs (real cases) in case of using filebeat. Great, keep it up
Thanks and great job. waiting for your next Elastic search video
These videos are great! I am learning so much!
Nick, you can also add serilog as a default logging provider into Microsoft extensions logging. So you won’t have to change from the ms implementation of Ilogger into serilog logger and continue to record your logs in the serilog format.
where can i get an example ?
@@infotips2475
Here is a minimal example in dotnet 6 Minimal API
using Serilog;
var builder = WebApplication.CreateBuilder(args);
builder.Host.UseSerilog((context, config) =>
{
config.WriteTo.Console();
});
var app = builder.Build();
app.MapGet("/", (ILogger _logger) =>
{
_logger.LogWarning("TEST");
return "Hello World!";
}
);
app.Run();
You must install Serilog.AspNetCore nuget package for this to work.
Awesome! Thanks!. Waiting for the Elasticsearch tuto. I have a question for you.
Does this logging to elasticsearch have a retry in case the service is down or in case of error trying to log?
Excellent explanation. Thank you Nick.
This is really great, thank you for all the videos you make - please never stop making videos and remember: keep coding :)
Nick, another perfect video
Thank you so much!
You're the guy!
Thank you for this video.
TIP: you can search trough commands history in terminal emulator with CTRL+R and then typing, way faster that up/down arrows.
Nick, you are simply awesome, i don't it is coincident or what, your all videos are linked to my current work like. Net core, serilog, reflections, redis cache, elastic search, system. Text.Json, logger etc etc... Thanks a lot for helping in directely us to building a Product
log templates with custom properties are working when using ILogger interface as well
Awesome video, thanks for sharing.
Thanks a lot. Really useful knowledge 👍
So useful! Thanks 👍🏻
super cool. Thanks for it.
Thank you! Very useful
very nice. Thanks for sharing.
This is great - thank you.
I'm really interested in trying it out myself, but I came unstuck with the docker/yaml stuff. I can't get hold of your repo as there seems to be a problem with the invite system. Can you help?
Hi Nick, thanks for the video. Are you still planning on doing a video on ElasticSearch only (or maybe OpenSearch)? That'd be awesome:)
really useful video!!!!!
amazing man
Great content. Is it possible to configure a retention policy of the logs in elastic search? So like if you want to keep only the last 2 months of logs.
Awesome !!
Would be great if you would cover the NEST library as well
Thanks for another great video. Really learning a lot from you.
First it's freaking awesome that you can have all that functionality with so little code, awesome.
I would like to have Serilog to log to different devices dependent on the environment the program are running in.
localmachine to console, TEST, QA and PROD to Elastic.
What would be the best approach?
instablaster.
This is great tool, is it possible to replace with this tool the logging from SQL (through SQL trigger, during create, update, and delete transaction)? TIA :)
Hi Nick, As you said you are going to create a video on Elastisearch, when you are planning to upload that?
Nick Please do a tutorial on MS Search integration.
nice and practical tutorial. However, I'm not seeing my index pattern in Kibana. I followed the exact steps, bus used the official E-L-K docker containers
thanks
you omitted logstash, how would you refactor the code to support logstash? Thanks for the tutorial.
Can you use that with the Serlilogs Log.Error also?
We're already doing this in all of our applications internally :D
is it free please? Do you need to pay for any of the elastic search or Kibana?
@@sunnyokoro it’s completely free
I tried to follow the steps but finding difficulty because elasticsearch version 8 has introduced major changes perhaps. Kindly post a video complying new version to use Serilog with elasticsearch
Logging not working when i publish it to IIS, but work normally locally, there is no restriction in network, how can i solve it? maybe i missed some config for production?
Ha. I just started getting familiar with ELK stack. While I generally loathe Java, there's a lot of good tools built with Java
Have you tried elmah.io? How does it compare?
What are the nuigets that you used?
Hi. Why when using method logger.information("very bad request") or logger.error("something bad") does not display my message in kibana? I got message "request finished http 1.1 post... "
MessageTemplate {HostingRequestFinished:l}
in case someone faces the issue with elastic service run - add "discovery.type=single-node" to the elastic service's environment
How can we use Elasticsearch/Serilog when API is hosted on Azure?
We do AppInsights/Serilog with stuff hosted in kubernets/azure, so definitely
my elastic server is remotely hosted and need username and password to authenticate, where do i specify these credentials in my .net core application?
Personally I reckon having the configuration all coming from appsettings is a better approach
It's definitely a more convenient approach but it is also definitely not a secure one
one container, elasticsearch doesn't work for me for some reason. It starts and runs for a bit but then stops with "ERROR: Elasticsearch exited unexpectedly".
Nick, do you have the sourcecode available somewhere perhaps? (Although I'm pretty sure I copied correctly.)
Nevermind, I had a "too low max virtual memory" issue. To fix, run:
> wsl -d docker-desktop
> sysctl -w vm.max_map_count=262144
> exit (to exit the wsl)
Nice video. I have one question. How Kibana accessing Elastic search DB. where you have configured it
That is part of the docker-compose that I'm using
What does this have over just using Serilog and Seq? What did Elastic and Kibana get over this?
I've seen Seq at scale and it just doesn't play nicely.
Thanks for video, but I find the Index Pattern tab
Nick I am still waiting the elasticsearch video XD.
Well, shit 😂
Not a bad idea, keep it in mind for the future, keep doing such an excellent work, a hello from a fan from Cuba
how to add authentication