Thanks for the video! I just started working with Databricks, and used Ganglia a bit. Now I am walking into some out of memory issues, I should definitely use it more.
Belated new year wishes Simon !! Great to see you back and sharing incredible detailed insights into Advanced Performance tuning with Spark. More power to you for doing the good work :)
Ganglia is nice but in databricks it really should be replaced by some databricks native solution as it is quite "funny" to include smth where most tabs are not working and include png screenshots of previous states
We don't see any updates to Ganglia, but it remains baked into the Spark UI, so it's worth understanding how it works if you don't want to sync your logs to another store and build your own dashboards!
Thanks for the video! I just started working with Databricks, and used Ganglia a bit. Now I am walking into some out of memory issues, I should definitely use it more.
Belated new year wishes Simon !! Great to see you back and sharing incredible detailed insights into Advanced Performance tuning with Spark. More power to you for doing the good work :)
I appreciated this video. Thanks!
Very nicely explained. Can you add how we can get data from ganglia to generate alerts
Is there a way to hit some ganglia endpoint to collect the metrics without consulting the frontend page? Great video btw!!
Very informative
Ganglia is nice but in databricks it really should be replaced by some databricks native solution as it is quite "funny" to include smth where most tabs are not working and include png screenshots of previous states
just a question from 2024, is this Ganglia still in use??
Anything about gpu monitoring?
I thought Ganglia was no longer maintained in favor of other tools like grafana or Prometheus
We don't see any updates to Ganglia, but it remains baked into the Spark UI, so it's worth understanding how it works if you don't want to sync your logs to another store and build your own dashboards!
this guys is so very irritating
'
Hah, I aim to please 😅
@@AdvancingAnalytics Don't take a random internet comment to heart, you did a very well job of explaining it in an easy to follow and entertaining way