English isn't my main language, so first apologize if you said it in video. Does this works as a tail? Does it keep reading the file and "auto" refresh data on kibana? Thanks dude!
Sorry for my late answer, I hope you find a solution. Yes it tailing the whole file line by line if you not provide something else like a separator, then sends it to elasticsearch and Kibana displays it. If new lines comes to the file it immediately reads them and update elasticsearch in real time which is visible by Kibana.
Meanwhile you can check my other elasticsearch videos here ua-cam.com/play/PLdfz8oqJWYYKMVaX7pM_tgNAfudCDwMsG.html I think, that they will answer to many of your questions. :))
In most cases it’s a decision of the developers of the application in internet you can find many examples of a log files. Logstash takes logs line by line or multiline depending on filebeat configuration and then filter what you need from the events if you provide filtering criteria to the logstash configuration.
@@nbglink the reason I asked it is that filebeat does not pick my log files. I thought maybe the format was incorrect but I suspect something else is wrong
@@nbglink unfortunately filebeat is still not working for me. Is there a way to send an manual even over http to logstash to see if the pipeline operates correctly?
No I'm on Windows but it doesn't work for me. I can't see my logs at the end on kibana index Management... For example "logstash nano pipelines.yml" doesn't work on Windows cmd I don't have logstash.service - what is the "sudo system status/start logstash.service" command, Imean what does it do ? Is that the same with ./logstash.bat ? Why do you work on port 5050 instead of 5044 ?
@@oulaoula349 try this video, everything is described step by step ua-cam.com/video/11PWoDIc10I/v-deo.html and yes the commands don't work because this is Linux commands for running editor and start the logstash service. In the video above you have ready to use virtual machine and you need just to install VirtualBox.
![[ ElasticSearch 15 ] Elastic Stack | Running Filebeat in a container](http://i.ytimg.com/vi/kIkpR8bxey0/mqdefault.jpg)
![How to analyse log files using Elasticsearch FileBeat [7.x] | FileBeat tutorial for beginners](/img/n.gif)
pipeline, then the agent, okay
English isn't my main language, so first apologize if you said it in video.
Does this works as a tail? Does it keep reading the file and "auto" refresh data on kibana?
Thanks dude!
Sorry for my late answer, I hope you find a solution. Yes it tailing the whole file line by line if you not provide something else like a separator, then sends it to elasticsearch and Kibana displays it. If new lines comes to the file it immediately reads them and update elasticsearch in real time which is visible by Kibana.
Very well explained..Can you please guide me for writing logstash filter which actually maps timestamp along with tomcat logs..
Maybe, if you give me some more details.
Thanks, when will You upload video with filter fields?
Soon
Can you please demonstrate how we can configure the same in Azure portal
I think that this is possible, stay tuned! And don't forget to like, subscribe, and share. ;)
Meanwhile you can check my other elasticsearch videos here ua-cam.com/play/PLdfz8oqJWYYKMVaX7pM_tgNAfudCDwMsG.html I think, that they will answer to many of your questions. :))
Hey the video for installation process on Azure is here - ua-cam.com/video/DRoKEa2SH7w/v-deo.html ;)
Thanks for this informative video.....can you tell how we can split the message field received at last into different fields?
Yes, soon I will provide a video on this topic. So stay tuned :)
If you can’t wait just reach me in one of my social channels and I will try to help.
@@nbglink thanks I will try to reach you on your Facebook page
what format should the log file have? Is there a template for that?
In most cases it’s a decision of the developers of the application in internet you can find many examples of a log files. Logstash takes logs line by line or multiline depending on filebeat configuration and then filter what you need from the events if you provide filtering criteria to the logstash configuration.
@@nbglink the reason I asked it is that filebeat does not pick my log files. I thought maybe the format was incorrect but I suspect something else is wrong
at least one thing was not correct: enabled was false in my filebeat.yml
@@TheVincent0268 yes this is a common mistake. I am happy that you figured it out. Cheers!
@@nbglink unfortunately filebeat is still not working for me. Is there a way to send an manual even over http to logstash to see if the pipeline operates correctly?
Can you do the same video without virtual machine please
Why you need it? If your OS is Linux Ubuntu the things are the same.
No I'm on Windows but it doesn't work for me. I can't see my logs at the end on kibana index Management...
For example "logstash nano pipelines.yml" doesn't work on Windows cmd
I don't have logstash.service - what is the "sudo system status/start logstash.service" command, Imean what does it do ? Is that the same with ./logstash.bat ?
Why do you work on port 5050 instead of 5044 ?
@@oulaoula349 try this video, everything is described step by step ua-cam.com/video/11PWoDIc10I/v-deo.html
and yes the commands don't work because this is Linux commands for running editor and start the logstash service. In the video above you have ready to use virtual machine and you need just to install VirtualBox.
Cool video Hristo, it answered a lot of my questions! Nice work =)
Thank you, buddy, you are welcome!
i know I'm kinda randomly asking but does anybody know a good place to watch new tv shows online ?
@Soren Erik ehh I watch on flixportal. Just search on google for it:P -kendrick
@Kendrick Maurice Thank you, signed up and it seems like a nice service :D I really appreciate it!
@Soren Erik happy to help xD