- 87
- 3 887 643
Fly․io
United States
Приєднався 3 сер 2022
Run web, AI, & app servers close to your users on CPUs and GPUs. Deploy and scale your app in minutes at fly.io/speedrun.
We did something *weird* with our CLI.
Fly.io does some CRAZY STUFF to allow you to connect to your Machines, and you'd never know it. SSH-ing into an app instance seems simple enough, until you put that instance on a virtual private network. In this video, I share the weird steps we took to make SSH-ing into your app's Machine's a one-command ordeal.
wireguard-go library
git.zx2c4.com/wireguard-go
gVisor's user space TCP/IP stack:
pkg.go.dev/inet.af/netstack
Fly CLI (`flyctl`):
fly.io/docs/flyctl/
wireguard-go library
git.zx2c4.com/wireguard-go
gVisor's user space TCP/IP stack:
pkg.go.dev/inet.af/netstack
Fly CLI (`flyctl`):
fly.io/docs/flyctl/
Переглядів: 6 239
Відео
Trash talking the cloud w/ Fly.io CEO Kurt Mackey
Переглядів 61 тис.День тому
Kurt Mackey and I chat about why public clouds generally suck. There's also a lot of (unwarranted?) hate on PaaS's built on top of these clouds. Kurt Mackey and I chat about why clouds aren't really built for developers.
We don't use containers, and here's why.
Переглядів 1,1 млн14 днів тому
Fly.io runs your applications in light-weight micro-VMs called Fly Machines instead of containers, but why is this? The short answer: Isolation. In this video, we'll explore a few different categories of isolation and what kind of security they provide. An Intro to Fly Machines: fly.io/docs/machines/overview/ Machines API: fly.io/docs/machines/api/ Fly Kubernetes: fly.io/docs/kubernetes/
Globally Distributed Postgres on Fly.io | Single leader replication + fly-replay
Переглядів 2,2 тис.Місяць тому
Deploying your app to multiple regions is great - until you have to make long-distant calls to your ONE database that lives halfway across the world. In this video I'll show you a simple technique that makes it easy to deploy a globally distributed Postgres cluster using a really cool feature on Fly.io called "fly-replay". Fly-Replay Header: fly.io/docs/networking/dynamic-request-routing/ Bluep...
How Fly.io does routing at the edge | BGP + Anycast
Переглядів 1,2 тис.Місяць тому
Learn how Fly.io serves your app close to your users by routing on the edge with BGP (border gateway protocol) and Anycast. Learn about Fly Domains: ua-cam.com/video/vU9xcRCX7-U/v-deo.html Learn about networking on Fly.io: fly.io/docs/networking/
Fresh Produce | July 2024
Переглядів 410Місяць тому
A quick overview and demonstration of features introduced on fly.io in the month of July. Community Forum: community.fly.io flyctl Features - python scanner improvements: community.fly.io/t/even-more-python-support/20764 - meteor 3: community.fly.io/t/fly-launch-now-with-more-meteor/20837 - github actions: community.fly.io/t/automatic-github-push-to-deploy/20671 - into flag: github.com/superfly...
Learning AI Deployments
Переглядів 212Місяць тому
I've been learning how to deploy and augment LLM models using Fly.io's GPUs. If you are building AI apps, here are five things I've learned as I get more familiar with everything: 1. Every LLM model should be its own application 2. Don't allow the public to access your models. 3. Don't redownload your base models on every run. 4. Don't wipe your database. 5. Stop idle GPUs. If you want to learn...
Deploying an LLM-Powered Django App | Ollama + Fly GPUs
Переглядів 821Місяць тому
Learn how to run LLMs locally, integrate with your Python/Django apps, self-host Ollama with one file and finally deploy an LLM-Powered Django app using self-hosted Ollama running on Fly GPUs. Source code: github.com/katiayn/django-fridge Ollama demo app: github.com/katiayn/fly-katia-ollama Related videos: - Fly.io networking: ua-cam.com/video/vU9xcRCX7-U/v-deo.html Related links: - Ollama webs...
Scaling your GPU app in anger
Переглядів 579Місяць тому
Jack into your private network with WireGuard: ua-cam.com/video/4NcvlIlIlso/v-deo.html Praise my GitHub Profile: praise-me.fly.dev Source code: github.com/Xe/praise-me Link to some free fly.io credits to get you started with GPU apps: fly.io/hello/xe?
Compose Apps with flyctl
Переглядів 462Місяць тому
Apps rarely exist in a vacuum. When you develop for a domain, you will have a lot of parts that you can compose together into a greater whole. We're introducing a new feature to flyctl that will help with this workflow. Node Dictaphone: github.com/fly-apps/node-dictaphone Cog Whisper: github.com/rubys/cog-whisper/?tab=readme-ov-file#whisper-on-fly-gpus Community Forum: community.fly.io/
Stream Responses from an LLM | Ollama, React, Astro on Fly.io
Переглядів 807Місяць тому
Stream Responses from an LLM | Ollama, React, Astro on Fly.io
Deploying an App using a Self-Hosted LLM | Fly GPUs + Ollama + Remix
Переглядів 3902 місяці тому
Deploying an App using a Self-Hosted LLM | Fly GPUs Ollama Remix
Scaling a social network on a whiteboard by Xe Iaso | DevOpsDays MSP
Переглядів 1,9 тис.2 місяці тому
Scaling a social network on a whiteboard by Xe Iaso | DevOpsDays MSP
Fly Domains Explained | .fly.dev, .internal, .flycast
Переглядів 2,7 тис.2 місяці тому
Fly Domains Explained | .fly.dev, .internal, .flycast
Build your Personal Language Assistant with an LLM | Fly.io GPUs + Ollama
Переглядів 5242 місяці тому
Build your Personal Language Assistant with an LLM | Fly.io GPUs Ollama
How to Self-Host an LLM | Fly GPUs + Ollama
Переглядів 1,8 тис.2 місяці тому
How to Self-Host an LLM | Fly GPUs Ollama
Globally-distributed Object Storage (no CDN required) | Tigris Data + Fly.io
Переглядів 2 тис.2 місяці тому
Globally-distributed Object Storage (no CDN required) | Tigris Data Fly.io
Boost Your App with Self-Hosted LLMs on Fly.io - Step-by-Step Guide
Переглядів 2,7 тис.2 місяці тому
Boost Your App with Self-Hosted LLMs on Fly.io - Step-by-Step Guide
Auto configuring Node (and Bun!) apps for Tigris
Переглядів 5672 місяці тому
Auto configuring Node (and Bun!) apps for Tigris
How Fly.io uses Docker (without Docker)
Переглядів 39 тис.2 місяці тому
How Fly.io uses Docker (without Docker)
Bounce traffic between Apps and Machines with fly-replay HTTP header
Переглядів 6222 місяці тому
Bounce traffic between Apps and Machines with fly-replay HTTP header
Using AI to Boost Accessibility and SEO - Fly.io blog
Переглядів 1173 місяці тому
Using AI to Boost Accessibility and SEO - Fly.io blog
Fly.io Devrel Podcast #1 | Fly Kubernetes (FKS)
Переглядів 2873 місяці тому
Fly.io Devrel Podcast #1 | Fly Kubernetes (FKS)
On-premises is better than any cloud
This is why the visor project, which we started at Google in 2014, works the way it does -- very lightweight VM.
When I clicked on the video I thought you were going to try to convince me to throw away my Tupperware.
This really has 1 million views??? O_o
Considering containers for security is same considering VMs for flexibility and performance.
I don't really understand how cloudflare proxying and cloudflare reverse proxies work then. Why do you need a VPN but neither of those do? All these things proxy traffic.
So it means we have more latency when writing right?
Is she reading a script or one of those who implement the technical part of this or both?
I've checked. My closest Taco Bells is 780km away and going there would likely get me into troubles with the NATO Allied Air Command. But I've heard NATO is providing a great service for there customers too.
All code should be in jail.
LXCs > Docker. Configure with Ansible. I like this model much better than containers. But TBH you really can't beat reproducibility with containers. You just can't
Please, do not use «firecracker» word. You should use «KVM» word. Four and a half minutes of bullshit.
Nearly every single comment contradicts the point of this video, so as an aspiring dev… not gonna keep watching!
Tjroooottt
You kinda just reinvented the wheel. You can have (and most do) both containers and virtualization. Make clusters based on trust level and deploy apps according to level of trust. The platform runs on VMs, the apps run on containers. Haven't seen a PaaS run on bare metal for more than 6 years now.
This is super sensible. Network stacks in a safe language in userspace, without legacy bloat, are a big step up.
Very interesting. Thanks for the explanation.
Interesting approach! My first instinct was to tunnel the SSH connection through websockets via the fly proxy. There seems to be a project called huproxy doing exactly this. That way you wouldn’t have to ship an entirely separate TCP/IP stack. Would genuinely be interested if you have considered this and why you didn’t do it that way.
This exactly! : DD
As a senior SRE, I disagree with the concerns you’ve raised about containers. In a well-architected Kubernetes environment, it’s possible to achieve everything you’ve mentioned using containers, and this can be done without the overhead of VMs.
Do you really understand containers? 😂😂😂
Imma let you finish but I need to subscribe first because this is another top tier video ma'am.
Cloud Run..in other words
I am split between and awe and slight worry. Awe because it is impressive to which lengths you went to make user experience smooth. Worry because there is some little voice telling me that things could start going wrong if each app implements its own tcp stack. I enjoy your videos. keep making them, please.
Go apps "implement their own TCP stack" by default anyways, so it doesn't matter that way anyways.
@@oserodal2702 really. do they? I kind of doubt it, but I am open to be proved wrong.
its overengineered. OpenSSH already has the concept of jump hosts????
Docker is a VM. Just because they try to hide it from you and don't let you control it doesn't mean their product isn't total horseshit.
Dang, that's really cool.
Oh yay, a whole 'nother network stack that receives security patching separately from the kernel. Sounds like a security nightmare TBH, no thank you
Kernel networking stacks are also a pain to get working with a process in user space, that's why we see a lot of programs depend on openssl. However, depending on openssl brings its own set of tradeoffs. Nevermind the fact that Linking C and Go is the most unenjoyable experience. The one good thing about doing networking with Go lang is that it's (probably) just as battle tested on networking and security as the Linux kernel, with less pitfalls and footguns.
Super!
These videos are so good.
ngl I thought this was that one game
I was wondering why I don’t need WireGuard anymore! That’s awesome!
and that is... a lot of annoying comments that makes me vomit and dont want to use it
amazing content like always
And that, is developer experience done right!
Nice video! You can update link to netstack, it's 1.23 already "This repo is no longer maintained. As of Go 1.17 and its lazy module loading we no longer need it, so we now just use upstream gVisor directly."
commercial over commercial on top of commercial to promote some more commercials.
and that is... killer marketing 🔥🔥🔥
I love your content. Keep it up!
These are such cool videos!
This is so cool! Thanks for making easy to use features like this.
And that is customer service
THANK YOU KENT
Kernel space TCP/IP stack also means enhanced performance. How does it compare to a userspace stack where you still eventually need to reach out to kernel to send bytes?
My uninformed guess is that it will be slightly slower, but this is for admin access so high performance is not a high priority.
Equally uninformed guess: or it might be that they can jettison legacy features, and maybe even skip some negotiation because they already know who they are calling and what kind of message they are sending
sounds like bastion server on demand
Sort of, except your computer is the bastion! :)
Without the cortisol 😂 nice touch, everytime I need to think about anything kubernetes I think my brain goes "ok, cortisol time!"
This is crazy and it can be used for other applications and use cases
Yo keep up the great content.
Good
I actualy tried to play with kata on k3s with fc to test it but I couldnt get it to work, but this video inspired me to try it again, BTW you are probably runing fc on k8s BTS for scaling, am I right?
Great but I hope you make similar thing for Django app too