ELK ( EFK ) with Kubernetes Cluster - Mithun Technologies - 99809232226

[@InspiringOrigins]

I saw so many lectures regarding EFK but they stopped with installation but here i learnt how to search the logs and how to customize the searches. Thank you sir

[@MithunTechnologiesDevOps]

Glad it helped!

[@Fayaz-Rehman]

The best ever video on kubernetes monitoring - thank you

[@MithunTechnologiesDevOps]

Glad it was helpful!

[@bhagwatkushwaha4458]

very helpful and understandble step by step setup... thank you

[@kumaranil181]

The F in EFK stands for Fluentd but this one is with Beat.. so am confused wrt EFK definition. Could you please elaborate ?

[@selvathalapathys]

Thanks Balaji Sir. I was waiting for this video.

[@MithunTechnologiesDevOps]

Always welcome

[@venkatramana4397]

thanks for this video. by seeing this video i have done implementation in my compeny

[@fz-ssaravanan2036]

Your videos was very awesome.. here we are seeing our kubernetes log to visualize using kibana it's fine.. but imagine we have custom logs which wrote by developer in some path. How will we mentioned that path in filebeat and how to see in kibana??? Can you show that or give some idea.. thanks I'm advance... And finally very big salute for your videos.. it's very easily understandable thank you so mach I learned lot mostly from your videos only...

[@mithuntechnologies6082]

FileBeat will ship the container logs from /var/log/containers/*.log. These contains STDOUT & STDERROR what is written to console. If developer is using console appenders in Log framework. All these will be part or your container logs . If developer is writing to file (File Appender). We can give log files path to FileBeat. FileBeat will use config map. We can update the config map to mention the log file paths.
If you want to update.
1) Get FileBeat helm chart values file.
helm show values elastic/filebeat >> filebeat.values
2) Update values file
# Default settings
# Allows you to add any config files in /usr/share/filebeat
# such as filebeat.yml
filebeatConfig:
filebeat.yml: |
filebeat.inputs:
- type: container
paths:
- /var/log/containers/*.log
processors:
- add_kubernetes_metadata:
host: ${NODE_NAME}
matchers:
- logs_path:
logs_path: "/var/log/containers/"
You can update filePaths
# Allows you to add any config files in /usr/share/filebeat
# such as filebeat.yml
filebeatConfig:
filebeat.yml: |
filebeat.inputs:
- type: container
paths:
- /var/log/containers/*.log
- /usr/local/*.log # Custom Path
processors:
- add_kubernetes_metadata:
host: ${NODE_NAME}
matchers:
- logs_path:
logs_path: "/var/log/containers/"
3) Install FileBeat with Updated values file.
helm install filebeat elastic/filebeat -f filebeat.values -n efk

[@fz-ssaravanan2036]

@@mithuntechnologies6082 thank you so much

[@dNid87]

@@mithuntechnologies6082 Hello. I am with this scenario here. I have apps writing logs in /opt/data/logs/ (containerized) in the same k8s cluster where filebeat is running. But adding custom path in filebeat values.yaml
paths:
- /var/log/containers/*.log
- /opt/data/logs/* # Custom Path
It is not gathering the logs simple ignoring the custom log path. Any idea please?

[@rameshragula3775]

is this videos covers total kubernetes topic?

[@roshansagar4944]

If we want to install logstach is this the command correct ( helm install logstach elastic/logstach -n efk )

[@Agunu]

Thanks for sharing much love

[@MithunTechnologiesDevOps]

You are so welcome

[@George-mk7lp]

any chance you have this document shared somewhere? can u provide link. thank you for the video

[@dharmagouda9018]

Hi, I have single node cluster and after a restart of the node, having status red to yellow.. any help without adding another node to the cluster?

[@jinkahari]

Ty sir, can you please make a video on EKS cluster setup

[@Gaurav1Tripthi]

ua-cam.com/video/e8MJQwzl-A0/v-deo.html

[@nenunaachannel7764]

Tq very much sir

[@MithunTechnologiesDevOps]

Welcome

[@sri4sg3]

Just awesome

[@srijibpathak8564]

can you share me the link of this configuration

[@bayapareddy7862]

👌👌🤝🤝

[@sangatiupendrareddy6796]

hi sir could you upload the video on ECS as well as ECR

[@George-mk7lp]

if you have issue with kibana pod resource (pending) change cpu/memory limit:
resources:
requests:
cpu: "256m"
memory: "1Gi"
limits:
cpu: "512m"
memory: "1Gi"

[@amitkumarmandrupkar4192]

can please share git repo for kubernetes file

[@revanthchowdary7072]

Please share git repo it will helpfull

[@gomkar8181]

ok sir

[@MithunTechnologiesDevOps]

Ok good

[@Sai-nt4jk]

can you pls share the yaml files of kuberenetes-elk pls sir

[@demotest-vr4uh]

github.com/DeekshithSN/kubernetes/tree/master/monitoring/kubernetes-elk