Hey Andy, Many thanks for the enlighting video! I am thinking of using Multus on RKE2 HA cluster with 3 dedicated nodes for Longhorn storage, as I have been experiencing performance issues when using Longhorn shored with worker nodes due to replication and snapshots plus other funky back of house management with Longhorn. Am I barking up the wrong tree? Ir should I simply use NFS? Keep up the fabulous knowledge sharing, it's very much appreciated! Cheers
Honestly I would not use multus unless there is a specific reason. For my customers is to be able to use multicast for data ingress. What version of Longhorn are you using? 1.6.1 has the new V2 engine. It is better than the older versions. What kind of apps are you using with Longhorn? The reason I ask is that we like to tier Longhorn as just one piece of a storage solution. Tier 1 is the ephemeral storage of the pod. Tier 2 is Longhorn - Great for stateful apps. Tier 3 NFS/Iscsi/EFS and the likes for HIGH IOPS applications. Think large databases. That being said you can tune Longhorn per cluster or volume to only have 1 replica. Also where are you running the cluster? The backing storage/disks and networking can dictate performance. Feel free to email me at clemenko@gmail.c0m. :D
@@clemenko For the past 8+ months I've been using K8s v1.28.1 cluster with Longhorn v1.5.1. The purpose for Kubernetes cluster is to support clients with Spring Boot Apps & Websites with Postgres, Redis & Kafka and all are Stateful. So have abandoned this cluster and built new RKE2 cluster with the kind assistance of you videos. So looks like I could be using NFS for Postgres & Redis?
@@paulfx5019 Maybe. It depends on the NFS device and the network speed. Check out Longhorn v1.6.1. Let me know if you want to look at your current deployments/cluster?
@@clemenko Thanks for the feedback. Have spent another day trying to deploy what I think is the best RKE2/Longhorn cluster, 3 master nodes, 3 worker node & 3 longhorn nodes. Am happy with RKE2 so far, I eventually worked out how to deploy longhorn on worker & longhorn nodes. Is there a way to deploy stateful pods on worker nodes only and using PVC's on longhorn nodes? Or am I simply dreaming....
Hey Andy, Many thanks for the enlighting video! I am thinking of using Multus on RKE2 HA cluster with 3 dedicated nodes for Longhorn storage, as I have been experiencing performance issues when using Longhorn shored with worker nodes due to replication and snapshots plus other funky back of house management with Longhorn. Am I barking up the wrong tree? Ir should I simply use NFS? Keep up the fabulous knowledge sharing, it's very much appreciated! Cheers
Honestly I would not use multus unless there is a specific reason. For my customers is to be able to use multicast for data ingress. What version of Longhorn are you using? 1.6.1 has the new V2 engine. It is better than the older versions.
What kind of apps are you using with Longhorn? The reason I ask is that we like to tier Longhorn as just one piece of a storage solution. Tier 1 is the ephemeral storage of the pod. Tier 2 is Longhorn - Great for stateful apps. Tier 3 NFS/Iscsi/EFS and the likes for HIGH IOPS applications. Think large databases.
That being said you can tune Longhorn per cluster or volume to only have 1 replica. Also where are you running the cluster? The backing storage/disks and networking can dictate performance. Feel free to email me at clemenko@gmail.c0m. :D
@@clemenko For the past 8+ months I've been using K8s v1.28.1 cluster with Longhorn v1.5.1. The purpose for Kubernetes cluster is to support clients with Spring Boot Apps & Websites with Postgres, Redis & Kafka and all are Stateful. So have abandoned this cluster and built new RKE2 cluster with the kind assistance of you videos. So looks like I could be using NFS for Postgres & Redis?
@@paulfx5019 Maybe. It depends on the NFS device and the network speed. Check out Longhorn v1.6.1. Let me know if you want to look at your current deployments/cluster?
@@clemenko Thanks for the feedback. Have spent another day trying to deploy what I think is the best RKE2/Longhorn cluster, 3 master nodes, 3 worker node & 3 longhorn nodes. Am happy with RKE2 so far, I eventually worked out how to deploy longhorn on worker & longhorn nodes. Is there a way to deploy stateful pods on worker nodes only and using PVC's on longhorn nodes? Or am I simply dreaming....
Just answered own question...added noschedule taint to longhorn nodes... My NFS network is on Cisco Nexus vPC 10G bonded LACP.