How Canva Saved Millions in AWS S3 Costs
Вставка
- Опубліковано 9 вер 2024
- In this video we will explore how Canva managed to save million of dollars from their AWS bills.
References:
Canva Article: www.canva.dev/...
Videos:
- Video by Pressmaster from Pexels: www.pexels.com...
- Video by Produtora Midtrack from Pexels: www.pexels.com...
Music:
- ♪ [non copyright music] Lofi Type Beat - Saturday Morning | aesthetic lofi music / Lofiru Link : [
Hello!! 👋 Wanted to share how Canva managed to save millions of dollars 💵💵 from their AWS S3 bills.
Hope you get to learn something new today!
That line after the zeros at 4:25 to make it easier to compare is such a beautiful idea. Appreciate the attention to detail
Lmao the captions at 1:11. "Just don‘t tell Bezos you want to leave."
LOOOL you found my hidden joke!!
And now their CEO can buy twice as much Lamborghinis per year. Nice one DevOps team ❤
Animations be smoother each time. Great video!
Thank you for tuning in as always! 😉
@@kikisbytes what software you use to create this animations?
@@FitraRahimCanva
@@rickastley-729 fr? dang i thought i was good at making canva presentations
@@FitraRahim I use motion canvas to make these animations
Those opptimal calculation though then again kudos on aws team that making the lifecycle feature and it works like a charm
Super cool to see how companies manage their cloud infrastructure to serve this much data. Those hyper scalers get expensive quickly!
Thanks for the vid, great job!
i love how you gave credits to free pexel creators . surprised to see after this great video ,you have only this much of views and subscriber .all the best . loved this video
Thank you I really appreciate that!! Yeah, I give credits to all videos I use online since they worked hard for it :)
High quality video and great animations! learned a lot from this video. Thanks.
That's awesome! I'm so happy you were able to learn something from this video.
This video was great never knew data storage was that expensive for large companies!
broo you should have millions of views
Awhh thank you, that means a lot!! 😊
bro saved millions in youtube views
@@astenium0have me dying 😂
@@astenium0lmao
@@astenium0😂😂😂😂😂😂😂
absolute banger content, keep it up bro
Thank you so much!
Hey Kiki. I have just discovered your channel and this is my first video. It is awesome, and I am sure I will be binging your catalog for quite some time.
Awesome and thank you for stopping by! The pinterest video is a good watch :)
good vid. one day it’s gonna resurface on my homepage with 10M views 💪💪
Alternative title: how canva burned millions to AWS for years
Ouuuu that’s actually sooo goood!!!
This is how CFOs look at things constantly. You know, because the CFO would have deployed properly with all future considerations perfectly handled of course.
You should’ve included on site self storage, which is a fraction of the cost AWS has. When you get very large, it makes sense to have your own data center.
Datacenter engineer here: Not for a globally consumed application. It would take a minimum of 30 or so datacenters to store the same data in the same geographical regions. A single 1PB storage server at this tier is about $800k before support contracts, and you’re kidding yourself if you think they only need one. Let’s pretend there’s no maintenance or staff needed for each DC, as soon as it starts to pay for itself the hardware reaches end of support, and you have to purchase all new hardware and migrate, which also costs millions.
Now please explain to your boss that they need to deal alllll that instead of typing “terraform apply”.
@@TheOfficialOriginalChad thanks for the reply. tough argument but when your as large as Netflix or Spotify it make sense to go on premise, it a lot of work but money saving make companies take on hard task!
@@TheOfficialOriginalChad why do you need multiple servers for something that takes a couple seconds to load anyway? No user will tell the difference between their project taking 1 second to load or 1.5s because it has to go all the way from Australia to the US or something.
@@theairaccumulator7144network costs also add up over distance.
@@briangman3 i think you might be right or close to right. Netflix and Spotify would save money on STORAGE on-premise. Though storage is not their highest cost; data transfer is. I can’t estimate their data transfer numbers, but I can say with reasonable confidence it’s much cheaper through cloud providers.
wow this is info and value packed, insane how only 10k subs! going through rest of vids
Thank you!! Hope you enjoy some of my other system design videos :)
I was even thinking about backing up my NAS to AWS Glacier for extra safety. The pricing is just so tempting
This is incredibly well made, keep making more videos!!
Thank you for watching!
new to your channel. thank you for the dense value provided about to binge the rest of your content 🙏
I use to build out big DC's & Nwks. Your data is 100% on target. We called AWS/GCP/Azure the "Hotel California" Model. You can go there, but you can Never Leave. :-) Big DC's get huge discounts on hardware, but managing it is costly.
They are big enough to maintain their own cloud/datacenter, which would save them much, much more money. Stay away from vendor lock in kids, even when the cloud makes sense.
Yes that true, show the log of the buckets which object is accessed nearly over 1 year ago then should be placed to s3 glacier
Thanks for putting together the video. Been sharing it internally within Canva :)
That's awesome thank you for sharing!
I was trying to take a rest from studying for my god damn radiology physics just to be tricked into more math in this video, no thank you I will pass, maybe return to it again later
hahaha thank you for stopping by anyways and good luck on with your study!
And here I am trying to dynamically adjust storage tiers for files on my 3 MAU app. People are really out here just going with the flow huh.
This is high quality stuff!
This video is great! The only fault I can find is your mic quality, but a really well made and interesting video!
Thank you!! Yeah I should really upgrade my mic soon, I'm using a $30 one to record all my videos.
Damn.. AWS is GOATed
You have to wonder how much of that 100 PB of content has been abandoned by users. If I was Canva, I would create my own offline storage solution. I estimate you could create an on-prem 130 PB storage array for about $1.2-$1.3 million USD. Perhaps cheaper. I would institute a policy that basically anything not touched for ~24 months will be moved to offline archival, and could be restored with a 3-5 day SLA. You don't even need to keep all of that array powered up at all times to save on electrical costs. Why pay Amazon all of this S3 storage fee for something that may never be accessed again?
until you realize it its best you just abandon the whole on prem storage idea entirely and give in to s3 glacier deep archive ( which is a 12 hour retrieval vs that 3-5 day SLA ) which is only 1/4th of the cost of s3 glacier instant retrieval and 23 times less expensive than s3 standard, while having better reliability, uptime and security canva could ever dream of. lose-lose with on-prem offline storage. even with (possibly) never again accessed content being 10-20 petabytes (which is probably not even close), the cost of still having your customers data in s3 glacier deep archive pales in comparison to having your own on-prem data center.
The drives themselves would be ~1$ million and that's not even counting the servers. I would just automatically delete data that hasn't been accessed for more than a year instead of archiving it. A large part of Canva users are kids in school and they're rarely using the same account twice much less accessing old projects.
@@theairaccumulator7144 Deleting data is unacceptable, greetings from r/datahoarder
This idea is so bad I can't even bother to rebuke it given it will result in a massive wall of text
@@AQHackAQcan you do a TLDR on why this is a bad idea?
I was thinking that was a video about how to stop using AWS, most more useful. For that money per month the can create a new company just serve the content with less security issues than S3...
Same here. I thought they moved to data centre. But that also comes with a ton of headaches. 😅
Great video gives me some idea of the scale.
Thank you for taking the time to watch!
Awesome
These insights are really valuable! You did great research. Great Video
Thank you! But have to give the credits to the Canva team for their amazing article.
great content
Great and insightful video! 👍 At 2:20, I am curious as to why you changed "207 PB (90% of 230 PB)" to "270 PB (90% of 300 PB)" during the transition. An oversight, perhaps? The math checks out either way.
bleh I originally had it as 270 but during editing I noticed it was wrong and changed it to 203. Guess I didn't cover the whole thing on Davinci Resolve :p. But man good eyes!!!
Wow! The quality of your videos are awesome.
Did they consider tar'ing up a bunch of the small objects to pass the minimum size overhead?
Clear and concise, loved it!
you are going to become famous guaranteed along as you stay consistent and relevant. You explained this topic so well that it makes me want to steall all of canvas data so I can work out how to solve this storage problem.
Hahaha thank you so much!
Hey Kiki’s bytes, I love the format of how you explain things, my ADHD brain managed to sit through the entire thing and stay engaged, can I request that you teach programming in a similar format?
Thank you! I'm so glad that this format was helpful.
What kind of programming format are you thinking? Algo / data structure or general programming? I do want to make programming videos but also don't want to just share my screen and do tutorials since there are so many videos out there already. I usually find that using animations and visuals really help when I'm trying to learn something new.
I would consider doing some higher level topics. So let me know what you have in mind!
@@kikisbytes not to sound too greedy, algo and data structures yes please! Even going through the languages like python, c, ruby will be super useful, at least for me. Hahaha. Thank you for taking the time to make these videos that impact others positively.
Awesome video! Judging by fluidity, was this video created in Canva?
hahaha only use Canvas for thumbnail!
Great video! Definitely sharing this!
This is an amazing video. I am sure this channel will blow up in popularity soon. Subscribed!
That means so much thank you!!!
So S3 standard for the win 😮
haha yeah for smaller object size
Till AWS will reconfigure it 😂
The biggest benefit could probably be with migrating off the cloud at this point
How did canva redirect their savings? What would AWS have done with those gains instead? Where was the increase in quality and on which side of this transaction?
You can buy a petabyte storage solution for every month you're running your aws services, just saying
The fun thing is. These policies exists in Azure, AWS and pretty much every cloud provider and are part of basic training. And yet people get layed off because of 'lack of experience'. Yeah sure m8.
straight to point nice loved it ❤
What do you use to edit your videos? They're great
Thank you for another interesting video!
Thank you Too
Thank you! I'm glad you liked it! 😊😊
Amazing video, subbed !
Thank you so much!!
Moral of the story: don't use AWS, they're expensive as hell.
Expensive? Yes, but also can easily save money in running and maintaining an on prem data center
Expensive compared to what? Building your own data center? If you have the money to pay for humongous upfront costs and considerable running costs, sure. Other data centers generally don't offer much better pricing than aws
@@vinylSummer no competitor can offer everything AWS does, but many data centers can charge less for some services. You're right in the sense that it depends on your use case. I've had costly experiences with AWS, and found better prices elsewhere.
For example, I still left some servers in AWS, and this year they decided to charge more for IPv4 addresses to "stimulate adoption" of IPv6. We allocated IPv6 addresses, but most software is not ready to use them, so it's pointless, we can't stop using IPv4, that means our costs went up for no reason, and there's not much we can do about it. We could try to leave AWS, but would have to perform costly address changes for many thousands of clients, so we just accept this arbitrary cost.
@@vinylSummer I answered you, but it got removed. no competitor can offer everything AWS does, but many data centers can charge less for some services. You're right in the sense that it depends on your use case. I've had costly experiences with AWS, and found better prices elsewhere.
What are you going to use then Einstein
Nice animation! Subscribed
Thank you!
Loved the video. Thank you!
Thank you!
Keep it up! I don’t think I can allow myself to not watch more of these 😂
Wow thank you!! That means a lot! Working on a new video right now, hopefully you’ll tune in later :)
I'm guessing from the fact it wasn't addressed that data retrieval fees on Glacier IA were a negligible factor?
Think if would still cost quite a bit, but these data typically won't be requested too often when they are there.
I just discovered this channel, the quality is insane for 10k subscribers
Wow I really appreciate that!!! Thank you for being part of the 10k subs.
Why don't they just switch to R2? You only considered the storage pricing. The egress costs most likely make up a major portion of their storage and delivery budget. In the grand scheme of things and the scale at which Canva is operating, recurring revenue of >$2B/yr, saving $3.6Mn/yr is a drop in the bucket.
Instead of investing so much time to save this money, they could have saved possibly 10s of millions if they moved off of S3 to something like R2 or built their own custom CDN.
I don't know why people still use S3 when it is one of the most expensive storage services out there. I'm just talking about storage here, egress is another beast.
Cloudflare doesn't make new features into R2 currently (I'm assuming) because not a lot of people are using it. AWS has a lot of clients using their storage products. If cloudlfare gets 10-20% of those clients, it would do them wonders and they would start building features of S3, R2 currently doesn't support versioning, they are not investing a lot of money in it because it isn't a big enough revenue driver for them currently.
Amazing piece of content! What do you use to edit videos?
Ty!! I use Motion Canvas!
So I'll summarise this vid, basically they left the server on
Great great great work on this video. Been using canva for work for years now thanks to my s.o but I never thought about if they use AWS 😧 seems everyone is these days
Great video as always! Keep it upp bro. I wanna see more videos from you. Thank you for making such masterpiece
Thank you and stay tune for the next video!
Didn't mention Storj/IPFS. Which is cheaper: Storj or AWS S3 Glacier?
Amazing video, I learned a lot! Subbed!
Thank you! I'm glad you were able to learn something, stay tune for the next video!
Great video! Thanks a ton!
I like how it's made too, the animations and smooth and satisfying, may I ask how it's made?
Wow, Great Analysis! Kiki I think you are a High Scalability site Fan Just like me right?!? ;)
ahhaha of course! Are you the author?
@@kikisbytes Hehe, no of course!
But I still very vividly remember when back in 2009 read the story of this Mega Chad that created the Plenty of Fish site with millions of users!
One-man band!
You can read his story in All Time Favorites Architectures - it is Worth it! :)
This was great! Very interesting thank you
Appreciate you taking the time to watch this video!
I’m wondering how much they paid those developers for this huge save on monthly costs
why then they did Not lowed the cost for Users??!!
Maybe they could have gone with a hybrid model or manage there own storage setup like base camp
hahaha yeah they probably just want to focus on their own things instead of having to worry about storage.
all whilst the engineers get to keep their salary with no bonus
can you tell more about your company or website which you said that cost $30k per month
Clicked they made their own server or implemented some client side processing stuff. Disappointed. Good video though
Today, maybe just start with Intelligent Tiering for S3. Does this all for you.
If you're Canva and it's the before times and IT isnt available yet, sure do some analysis and curate the storage tier individually. But for everyone else in 2024 use Intelligent Tiering as your _default_ storage class.
Thank you for mentioning this! I should've of taken the time to briefly mention this in the video.
Kiki uploads.
I view.
I learn.
I like (and would subsribe again, but I am already subscribed 😥)
THANK YOU!!! I'm actually going to screenshot this and hang it on my wall :)
Storage costs are much higher than I would have guessed.
I thought so as well originally and had to look up how much Canva was actually worth.
so in short we can say they applied lifecycle rule mgmt for their buckets to save costs. Am i missing something here?
@@rohanrustagi7857 the lifecycle rule isn’t the bit saving money, it’s the storage classes. Infrequent access (and similar) are charged cheaper rates. But yeah, that was their way to save costs, you got it! 👏
That’s exactly it, thank you this!
To add to this, it’s about them figuring out their data usage pattern and aws releasing a new s3 class that just happened to fit their exact use case with cheaper storage cost.
@@oSpam thank you 🙏
@@kikisbytes thank you 🙏
@@rohanrustagi7857 no probs. Glad you’re learning 😄
Have you noticed that their image quality is not as good as Adobe? I use Adobe express and once I export it, it can go to 2 MB or more depending on the assets in there. But in Canva it's less than that and once you upload it on social media, you can clearly see it by the ppi. Adobe has better ppi so the post on Instagram is better using Adobe. I am wondering if it is because they are saving cost?
I love your content. It's amazing
Thank you really appreciate!
If it is expensive to move many files cant they just put many files together and move them as one file?
This is some quality content.
Canva is still unwise; at a certain stage, it is better to run your whole infrastructure locally or build your own cloud or local server.
dope
great content!! subscribed 💯
Thank you for subbing!!! ❤️
Interesting video. Btw, which aws service do you think would be the best to host an open source ai model? I mean could i do that on S3?
hmm maybe something like SageMaker?
@@kikisbytes Thanks
i feel like cloud solutions are intentionally made to be difficult to uderstand cost-wise
Such a nice case study
woah so underrated!! awesome and educational vid
Thank you for watching!
They could just use Cloudflare R2, much cheaper
If you’re moving the object from standard to glacial, how do you maintain the object link?
i Imagine the public facing links would not be the internal s3 object link. Otherwise it precludes you from making any storage layer changes without breaking stuff at user level.
Congratulations on your millions subscriber journey
by the way , can you tell us what software you used to create this buttery smooth animations ?
Appreciate it! I use motion canvas to make these animations.
Hi how do you make these videos? Like the format and would love to get started with this format to make some math education videos
You should check out Motion Canvas! It's amazing for making math videos, they also have latex component!
@@kikisbytes thank you so much. God bless you
@@abhardwaj02 absolutely! Please let me know if you ever end up making the video. I would love to tune in :)
Or use a alternative provider like Wasabi and you can Safe much more.
First time hearing about Wasabi, are their apis developer friendly?
@@kikisbytes We have switched from AWS S3 and Azure Blob storage to Wasabi and to IONOS. The APIs do not change as the storage is S3 compatible. Also fully compatible with AWS IAM.
We also switched all servers from AWS and Azure to IONOS. The cost saving per year, for server and S3 is about 62%. But the Server move was of course much more complex.
Nerrrrrd! 🤓🤓🤓
LOOL
Nice video but I just wonder with that talent and price tag why they wouldn't consider moving to on prem
I'm guessing resources and complexity issues
Great video! How do you create your animations? They are awesome
Thank you! I use motion canvas
Should just host their own data