The Costly Typo in IAM ARN Policy by Nitin Yadav [English]

Event Name: Heat Ops: Beat it with Cool Fixes
Event Date: May 18, 2024
Location: Devtron Inc, Gurugram
Speaker: Nitin Yadav
Speaker Description:
As the CTO and co-founder of SquareOps, he brings a wealth of experience in DevOps and cloud infrastructure management. His focus areas include scalability, disaster recovery, and cloud cost optimization. At SquareOps, they prioritize cloud innovation, empowering team members to lead in their domains while providing innovative strategies to clients. His leadership philosophy revolves around continuous growth, fostering efficiency, and cost-effectiveness as they navigate the evolving landscape of DevOps and cloud technologies.
Session Description:
A simple typo in an IAM ARN policy once led to a catastrophic spike in operational costs within his team. Intended for pushing mimir metrics to S3 buckets, the error caused API calls to repeatedly fail, triggering relentless retries by mimir. The financial impact was severe, with S3 API costs escalating to $1,000 per day. Thankfully, their proactive daily Slack alerts enabled them to contain the situation quickly, though it still resulted in a substantial unintended expense of over $3,000 over three days. This incident underscores the importance of meticulous attention to detail in configuration management and the value of real-time monitoring systems in mitigating potential disasters. Managing cloud costs effectively is both an art and a science, yet it need not be daunting. Over the years, he has developed and implemented various straightforward strategies that significantly curb expenses without compromising on performance. From setting up budget alerts and engaging in commitment-based savings plans to leveraging spot instances and automating the start-stop of resources, these methods are practical and can be easily integrated. In his talk, he would share these insights, providing a toolkit for efficient cloud cost management that could benefit companies of all sizes.
Follow Nitin Yadav on Social Media:
LinkedIn: www.linkedin.c...
Follow CNCG New Delhi on Social Media:
Homepage: community.cncf...
LinkedIn: www.linkedin.c...
Twitter: cn...
WhatsApp Community: chat.whatsapp....
#cncgnewdelhi #cncf #aws #kubernetes #devtron