This content is amazing! You're so good at explaining and demo'ing. This helped me understand so much I did not fully grasp before. We need more in-depth content like this
Thanks a lotttt sir! I was struggling since 2 weeks for this code, tried multiple GPT tools as well, but couldnt help. Your video and code is a One Stop solution for all my StatefulSets and Mongodb issues. Thank you thank you thank you very much!!!
@@PavanElthepu Hey small doubt hope you could reply to this, how do we connect to the mongo compass from this replicaset, i tried the same method as the deployment, but it didnt work, hoping you could clarify this? Thanks
The explanation was very clear but I have a little problem, can you help me please? The first pod is created successfully, but at athe second pod I get the following message: Warning FailedScheduling 3m35s default-scheduler 0/1 nodes are available: pod has unbound immediate PersistentVolumeClaims. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod.. Normal NotTriggerScaleUp 2m46s cluster-autoscaler pod didn't trigger scale-up:
Thanks a mil Pavan. A quick question. How to automate the manual efforts that are involved, like adding the replicas details to the primary pod always when the pod re-schedules or enabling the secondary pod to allow read operations when ever the pods are scaled ?
Thanks a mil Pavan. Just a quick question. do we have to always manually configure the secondary nodes to accept read requests when we scale up the pods ? or adding replica details manually to the primary pod if the pod rescheduled? what is the other way to get these manual process automated ?
Hello Pavan, Many thanks for sharing your knowledge. :) I just have a question, how can I connect to my mongo db cluster outside of the Kubernetes? Using a Mongo GUI like Compass. Can you help? Thank you.
Superb k8s series Pavan. Simple, crisp and clear with the content. I am following your series with handson. and all are working as you explained in videos. I shared your videos with my friends. I wish you to make more such videos and become popular in youtube with good growth. May i know your plan for the next series.? God bless you !!!
Thanks for the love Raghu Vardhan. These words really motivates me to create so much of content. Yeah, plan Git, GitOps, ArgoCD, Terraform, General Software Development/Design concepts, Kafka, Redis, SpringBoot, and many more. This would be a FullStack channel, not just DevOps!
@@PavanElthepu Superb Pavan. thanks for the headsup. i have subscribed your channel. by the way when i execute the comman "k exec -it mongo-0 -- mongo ". I am getting below error. OCI runtime exec failed: exec failed: unable to start container process: exec: "mongo": executable file not found in $PATH: unknown How to resolve this error. Can you please tell me Pavan. GOD BLESS YOU !!!
very good video, most helpful one. Now can you please tell me how can I connect via mongodb compass to the mongodb database that has this statefulset setup in GKE
Hi Pavan, In non-Statefulsets Mongo pod with 4 replication factor. While user fetching the query in mongo db, how the services select which pod to select the data to the user. How it select which pod to select? Could you please explain it briefly. Thank You.
@@PavanElthepu yes i'm justing completing the playlist, since tomorrow there is an interview just referring all your video thank you so much for your clear explanation of concepts
hello, first thank you very much for this simple tutorial is clear. I have a question, and I hope you can help me with this problem. when i deploy mongodb with statefulsets , and i have deploy my server side , express js with deploy . in this case i have a primitive and secondary db. how i can conect mongodb your express so i can write in primitive and read from secondary db . in this pon where i am blocked, can you help me please
Suppose we are creating a DB using StatefulSet object and we have masterNode-0 and slaveNode-1/2. If masterNode-0 goes down, will any slaveNode become master node or the whole service will stop responding to incoming request until masterNode comes-up?
If the Master Node goes down an election is held between the secondary nodes and new Primary node is elected. Also if the failed primary node recreates and comes back it becomes a secondary node.
Hi This video is really awesome which made our lives easy...when try to deploy the statefulset with above scripts, we getting below error here.. We have used the same files in the repo for secrets,sc,pv,pvc and config.. default-scheduler 0/1 nodes are available: pod has unbound immediate PersistentVolumeClaims. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod.. Normal Scheduled 98s default-scheduler Successfully assigned default/mongo-0 to minikube Warning FailedMount 66s (x7 over 98s) kubelet MountVolume.SetUp failed for volume "mongodb-config" : configmap "mongodb-config" not found Normal Pulling 33s kubelet Pulling image "mongo:4.0.8".. I any information will be helpful..
Hi Pavan.. Thanks for your time. can we create a mongodb instance with single replicaset .will that serves our purpose for read & write operations...How we need to do the replica setup for single pod..?
1 Question : You said replication of data is not enabled by default . so if I scale the statefulset to one more pod , do I need to run the rs.initiate{} command again in the master pods with the dns of the new pod ??
@@PavanElthepu Follow-up question. The fact that you need to exec specifically into a pod to run some commands and initiate the "replication/synchronization". Does that mean that things need to be redone (exec + scripts) every time when some pods go down and reboots (because the IP will change and all that)? This would defeat this auto-repair property of Kubernetes.
Yes, you can use a Deployment instead of a StatefulSet to deploy a single replica of MongoDB. However, there are some important differences between the two that you should consider before making a decision. A StatefulSet is typically used when you need to manage stateful applications that require stable, unique network identities and persistent storage. MongoDB is a stateful application, and using a StatefulSet ensures that each replica has a unique identity and that data is stored persistently. On the other hand, a Deployment is typically used for stateless applications that can be scaled horizontally. MongoDB can also be deployed in a stateless manner, with a single replica running in a container, and a Deployment can be used for this purpose. Using a StatefulSet for a single MongoDB replica provides some benefits, such as: Unique network identity: Each replica will have a unique hostname that can be used to communicate with it, even if the replica is restarted. Persistent storage: Each replica will have its own persistent volume, which ensures that data is retained even if the replica is restarted or moved to a different node. Ordered startup and shutdown: StatefulSets ensure that replicas are started and stopped in a specific order, which can be important for stateful applications. However, if you only need a single MongoDB replica and do not require these benefits, a Deployment can be used instead. It is simpler to set up and manage, and can still be scaled horizontally if needed in the future.
Hello Pavan, getting error after statefulsets deployed with mango-0 "exec failed: container_linux.go:380: starting container process caused: exec: \"mongo\": executable file not found in $PATH"" - can you help to throw some light.
@@PavanElthepu Thank you for quick reply Pavan. I'm good with image:4.0.8 no issues as you mentioned in your yaml file, where as if I use latest image, can you do post for latest image
Hi @PavanElthepu, Your videos are amazing they are very simple to understand. I have a question with the example you have shared in the statefulset.yaml file in the GitHub repo. If I have to mount mongodb.conf file under same /data/db under mongo-volume volumemount how do I do it.
Great explanation pavan.. i tried the demo but i am unable to create replication. I am getting below error: rs.initiate( { _id: "rs0", members: [ { _id: 0, host: "mongo-0.mongo.default.svc.cluster.local:27017" }, { _id: 1, host: "mongo-1.mongo.default.svc.cluster.local:27017" }, { _id: 2, host: "mongo-2.mongo.default.svc.cluster.local:27017" } ] } ) { "operationTime" : Timestamp(0, 0), "ok" : 0, "errmsg" : "No host described in new configuration 1 for replica set rs0 maps to this node", "code" : 93, "codeName" : "InvalidReplicaSetConfig", "$clusterTime" : { "clusterTime" : Timestamp(0, 0), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } } } could you please check and let me know what might be the issue ? Thanks !!!
now 2023: i meet issue about init primary node and secondary node "errmsg" : "replSetInitiate quorum check failed because not all proposed set members responded affirmatively: mongo-1.mongo.mongodb.svc.cluster.local:27017 failed with Couldn't get a connection within the time limit", "code" : 74, "codeName" : "NodeNotFound", i need help
no one can give better explanation than this. kudos to you pavan
Mannn this is the best series on kubernetes. I'm binging all of it for Google Associate Cloud Engineer exam, thanks
Nice !Duration is short but every aspect of stateful set has been covered.
This video clears all my doubts about statefulsets .Why this video not went viral.
I have seen instructors having millions subscribers but they are way behind what and how concept is explained in this video.
Hands down to teaching skills.
Brilliant series on k8s! I also watched the helm video which was super concise and super informative.
Ultimate level of teaching 🙏🙏🙏
Thank You so much for this vedio. It clears all my doubts on Statefulset.
This content is amazing! You're so good at explaining and demo'ing. This helped me understand so much I did not fully grasp before. We need more in-depth content like this
Thank you so much Cheslyn. Please subscribe and share with your friends and colleagues
@@PavanElthepuI could get you a tutoring job. For about 6 hours a week. Please get in touch
Thanks a lotttt sir!
I was struggling since 2 weeks for this code, tried multiple GPT tools as well, but couldnt help.
Your video and code is a One Stop solution for all my StatefulSets and Mongodb issues.
Thank you thank you thank you very much!!!
Why would you run db in kubernetes, when you have managed dbs so cheap
Best video on STS
This is so helpful. Concept and practicals in single video from end to end is amazing. Thank you so so much
Love to hear that😊
Your presentation is clear and yet comprehensive. Thanks! I just subscribed to your channel to watch more on K8.
Thank you so much. Please share with your friends and colleagues🙏
Your channel has best kubernetes tutorials. Thanks a lot for this
Thank you so much Ayush. Please subscribe and share with your friends and colleagues
please create videos on helm charts if possible
Your videos are GOLD!! 🎉
Thank you so much🙂. Please share with your friends and colleagues
Good video, it explains the intricacies of stateful sets and headless services very well.
Thank you so much. Please share with your friends and colleagues
very well explained video
Again appreciated bro!! You have explained everything in detail. I wish I could have come on this channel earlier.
Please connect with me on LinkedIn
was searching for this kind of video, thanks man, crystal clear from point to point, amazing, keep posting this content.
Thank you so much HarshaVardhan. Please subscribe and share with your friends and colleagues
@@PavanElthepu Hey small doubt hope you could reply to this, how do we connect to the mongo compass from this replicaset, i tried the same method as the deployment, but it didnt work, hoping you could clarify this?
Thanks
Wonderful presentation. Thank you!
Really sir....no words for you 🙏🙏 I already have share your most the videos because all should know you and your channel and that helps them most 🙏🙏🙏
Thank you so much Jalandhar for your love🙏
Hey Pavan,
Nice Explanation!!!
I need to implement this using postgres.
Yes, you can use same concept with PostgreSQL
You kept it simple. Very helpful. Thank you.
Thank you Vishal. Please share it with your friends and colleagues
Amazing amazing amazing!! Most helpful K8S video so far! Thank you so much
Thank you so much. Please subscribe and share with your friends and colleagues
more than gold
thank you so much
Thank you this video helped me a lot, in fact you're all videos are great to understand easily.
Thank you so much. Please subscribe and share with your friends and colleagues
The explanation was very clear but I have a little problem, can you help me please? The first pod is created successfully, but at athe second pod I get the following message:
Warning FailedScheduling 3m35s default-scheduler 0/1 nodes are available: pod has unbound immediate PersistentVolumeClaims. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod..
Normal NotTriggerScaleUp 2m46s cluster-autoscaler pod didn't trigger scale-up:
requesting you to Please make videos on kubernetes troubleshooting means errors and their solutions
Sire Siva Krishna
Awesome bro 🔥
You made it easy to understand, was really helpful. Keep up!!!!
Glad that it helped you Krushna. Please share with your friends and colleagues
9 mins and straight searched the subscribe button!
Means a lot. Please share with all your friends and colleagues
Thanks a mil Pavan. A quick question. How to automate the manual efforts that are involved, like adding the replicas details to the primary pod always when the pod re-schedules or enabling the secondary pod to allow read operations when ever the pods are scaled ?
Thanks Pavan. it's really helpful. if I need to restart the mongoDB password then what should I do.
How we create storageclass : demo-storage. Is this local disk?
Great tutorial 💯
Thanks a mil Pavan. Just a quick question. do we have to always manually configure the secondary nodes to accept read requests when we scale up the pods ? or adding replica details manually to the primary pod if the pod rescheduled? what is the other way to get these manual process automated ?
Hi Pavan, what is the point in having slave pods in statefulset when all the requests are directed to master pod only?
Hello Pavan,
Many thanks for sharing your knowledge. :)
I just have a question, how can I connect to my mongo db cluster outside of the Kubernetes? Using a Mongo GUI like Compass.
Can you help?
Thank you.
Can you please make a tutorial on k8s certificates?? Why, how and when of those certificates?
Great tutorial
Nice explanation 👌🏻 Waiting for you to upload more videos
Thanks you Taizun. Please share it with your colleagues and friends
@@PavanElthepu sure..
Superb k8s series Pavan. Simple, crisp and clear with the content. I am following your series with handson. and all are working as you explained in videos. I shared your videos with my friends.
I wish you to make more such videos and become popular in youtube with good growth.
May i know your plan for the next series.? God bless you !!!
Thanks for the love Raghu Vardhan. These words really motivates me to create so much of content. Yeah, plan Git, GitOps, ArgoCD, Terraform, General Software Development/Design concepts, Kafka, Redis, SpringBoot, and many more.
This would be a FullStack channel, not just DevOps!
@@PavanElthepu Superb Pavan. thanks for the headsup. i have subscribed your channel. by the way when i execute the comman "k exec -it mongo-0 -- mongo
". I am getting below error.
OCI runtime exec failed: exec failed: unable to start container process: exec: "mongo": executable file not found in $PATH: unknown
How to resolve this error. Can you please tell me Pavan.
GOD BLESS YOU !!!
Hey buddy I have been into devops for quite some time now. This video is a gateway for many who make it hard to understand statefulset.. Way to go..
can you do the same on postgress databases please it may help most of students please please please consider
very good video, most helpful one. Now can you please tell me how can I connect via mongodb compass to the mongodb database that has this statefulset setup in GKE
Nice explanation wid figure 👍
Thank you Navya. Please subscribe and share with your friends and colleagues
Hi Pavan,
In non-Statefulsets Mongo pod with 4 replication factor. While user fetching the query in mongo db, how the services select which pod to select the data to the user. How it select which pod to select? Could you please explain it briefly.
Thank You.
great video thanks pavan :)
Looks like you are watching all my videos today🙂. I have received your comments on many videos
@@PavanElthepu yes i'm justing completing the playlist, since tomorrow there is an interview just referring all your video thank you so much for your clear explanation of concepts
Thank you for the video, How can we configure master and slave in Mysql Database
😭😭😭😭😭😭😭😭😭 You're the Best bro
Ha ha🙂. Thank you so much. Please subscribe and share with your friends and colleagues
@@PavanElthepu Done
Thanks for the simplified explanation.
I want to know is there any other condition apart from authentication which can make an application stateful?
Doesn't matter, anything that you store for future usage makes an application Stateful. Examples: Redis, all DBs, all message brokers, etc..
Its very helpful, thank you!!
Can you please share the link of manifest files?
Updated the description with manifest link Swapnil. Glad that it helped you, kindly share the video with your colleagues and friends.
how do we configure the mongocompass to access the replicaset from internet
Thanks
Thank you so much for the support @aliasgar
amazing!
How to take backup of DB deployed using Statefulsets in K8s CLuster??
Nice sir
Thank you Mahesh. Please subscribe and share with your friends and colleagues
superb
Thank you Abhinav. Please share with your friends and colleagues
loved it
Really amazing, thanks a lot!
Thank you so much, please subscribe and share with your friends and colleagues
Any video on mysql data replication please help and share any link please
Hi Sir,
Can the replication algorithm mentioned in the video be applied for mysql pods?
what do you suggest deployment or statefulset ?
I depends on your application. If you’re storing any state, the go for statefulset. If there is no state needed, go with deployment
hello,
first thank you very much for this simple tutorial is clear.
I have a question, and I hope you can help me with this problem.
when i deploy mongodb with statefulsets , and i have deploy my server side , express js with deploy .
in this case i have a primitive and secondary db.
how i can conect mongodb your express so i can write in primitive and read from secondary db .
in this pon where i am blocked, can you help me please
Hi Najib, you can give read preference in connection string or in your code while doing database operations.
how to expose this for mongodb compass?
how can i connect with mongo compass?
Suppose we are creating a DB using StatefulSet object and we have masterNode-0 and slaveNode-1/2. If masterNode-0 goes down, will any slaveNode become master node or the whole service will stop responding to incoming request until masterNode comes-up?
Have you got the answer, because I too am searching for the same
If the Master Node goes down an election is held between the secondary nodes and new Primary node is elected. Also if the failed primary node recreates and comes back it becomes a secondary node.
Good evening, access to mongodb is occurring without a password. mongodb is not asking for username and password.
Hi This video is really awesome which made our lives easy...when try to deploy the statefulset with above scripts, we getting below error here.. We have used the same files in the repo for secrets,sc,pv,pvc and config..
default-scheduler 0/1 nodes are available: pod has unbound immediate PersistentVolumeClaims. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod..
Normal Scheduled 98s default-scheduler Successfully assigned default/mongo-0 to minikube
Warning FailedMount 66s (x7 over 98s) kubelet MountVolume.SetUp failed for volume "mongodb-config" : configmap "mongodb-config" not found
Normal Pulling 33s kubelet Pulling image "mongo:4.0.8".. I
any information will be helpful..
Thank you Sri Rama Krishna. It’s saying that configmap not found
@@PavanElthepu Thanks Pavan..
Hi Pavan.. Thanks for your time. can we create a mongodb instance with single replicaset .will that serves our purpose for read & write operations...How we need to do the replica setup for single pod..?
how do you replication automatically
if you have enabled HPA?
There are multiple ways of doing this like using Operator, adding a sidecar container, etc..
What happen is primary goes down
1 Question : You said replication of data is not enabled by default . so if I scale the statefulset to one more pod , do I need to run the rs.initiate{} command again in the master pods with the dns of the new pod ??
Yes. There are multiple ways of doing this like using Operator, adding a sidecar container, etc..
@@PavanElthepu thanks for the prompt response . The video is really very informative
Thank you Jitender. Please subscribe and share with your friends and colleagues
@@PavanElthepu Follow-up question. The fact that you need to exec specifically into a pod to run some commands and initiate the "replication/synchronization". Does that mean that things need to be redone (exec + scripts) every time when some pods go down and reboots (because the IP will change and all that)? This would defeat this auto-repair property of Kubernetes.
It doesn't, as that script execution is automated on every pod creation
So, If 1 replica of mongodb is enough then the kind of Deployment is enough right?
Yes, you can use a Deployment instead of a StatefulSet to deploy a single replica of MongoDB. However, there are some important differences between the two that you should consider before making a decision.
A StatefulSet is typically used when you need to manage stateful applications that require stable, unique network identities and persistent storage. MongoDB is a stateful application, and using a StatefulSet ensures that each replica has a unique identity and that data is stored persistently.
On the other hand, a Deployment is typically used for stateless applications that can be scaled horizontally. MongoDB can also be deployed in a stateless manner, with a single replica running in a container, and a Deployment can be used for this purpose.
Using a StatefulSet for a single MongoDB replica provides some benefits, such as:
Unique network identity: Each replica will have a unique hostname that can be used to communicate with it, even if the replica is restarted.
Persistent storage: Each replica will have its own persistent volume, which ensures that data is retained even if the replica is restarted or moved to a different node.
Ordered startup and shutdown: StatefulSets ensure that replicas are started and stopped in a specific order, which can be important for stateful applications.
However, if you only need a single MongoDB replica and do not require these benefits, a Deployment can be used instead. It is simpler to set up and manage, and can still be scaled horizontally if needed in the future.
Not working. And how to access from external?
@pavan: How to self host typesense on K8 cluster using deployment.yaml
Typesense should be deployed using Statefulset as it’s a stateful application.
Hello Pavan, getting error after statefulsets deployed with mango-0 "exec failed: container_linux.go:380: starting container process caused: exec: \"mongo\": executable file not found in $PATH"" - can you help to throw some light.
Did you use same manifest?
@@PavanElthepu Thank you for quick reply Pavan. I'm good with image:4.0.8 no issues as you mentioned in your yaml file, where as if I use latest image, can you do post for latest image
@@subbareddyjangalapalli6310 sure, I'll try
Hi, can anyone guide me to connect this statefulset replicaset to the mongo compass. Thank you
Hi Harsha, you mean you want to connect to statefulset from Mongo compass?
@@PavanElthepu yes
Watch my jobs and cronjobs video. There I gave the connection uri. You may use it from Mongo Compass
Hi @PavanElthepu,
Your videos are amazing they are very simple to understand. I have a question with the example you have shared in the statefulset.yaml file in the GitHub repo.
If I have to mount mongodb.conf file under same /data/db under mongo-volume volumemount how do I do it.
Great explanation pavan.. i tried the demo but i am unable to create replication. I am getting below error:
rs.initiate(
{
_id: "rs0",
members: [
{ _id: 0, host: "mongo-0.mongo.default.svc.cluster.local:27017" },
{ _id: 1, host: "mongo-1.mongo.default.svc.cluster.local:27017" },
{ _id: 2, host: "mongo-2.mongo.default.svc.cluster.local:27017" }
]
}
)
{
"operationTime" : Timestamp(0, 0),
"ok" : 0,
"errmsg" : "No host described in new configuration 1 for replica set rs0 maps to this node",
"code" : 93,
"codeName" : "InvalidReplicaSetConfig",
"$clusterTime" : {
"clusterTime" : Timestamp(0, 0),
"signature" : {
"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
"keyId" : NumberLong(0)
}
}
}
could you please check and let me know what might be the issue ?
Thanks !!!
now 2023: i meet issue about init primary node and secondary node
"errmsg" : "replSetInitiate quorum check failed because not all proposed set members responded affirmatively: mongo-1.mongo.mongodb.svc.cluster.local:27017 failed with Couldn't get a connection within
the time limit",
"code" : 74,
"codeName" : "NodeNotFound",
i need help