Fly․io
Fly․io
  • 87
  • 3 887 643
We did something *weird* with our CLI.
Fly.io does some CRAZY STUFF to allow you to connect to your Machines, and you'd never know it. SSH-ing into an app instance seems simple enough, until you put that instance on a virtual private network. In this video, I share the weird steps we took to make SSH-ing into your app's Machine's a one-command ordeal.
wireguard-go library
git.zx2c4.com/wireguard-go
gVisor's user space TCP/IP stack:
pkg.go.dev/inet.af/netstack
Fly CLI (`flyctl`):
fly.io/docs/flyctl/
Переглядів: 6 239

Відео

Trash talking the cloud w/ Fly.io CEO Kurt Mackey
Переглядів 61 тис.День тому
Kurt Mackey and I chat about why public clouds generally suck. There's also a lot of (unwarranted?) hate on PaaS's built on top of these clouds. Kurt Mackey and I chat about why clouds aren't really built for developers.
We don't use containers, and here's why.
Переглядів 1,1 млн14 днів тому
Fly.io runs your applications in light-weight micro-VMs called Fly Machines instead of containers, but why is this? The short answer: Isolation. In this video, we'll explore a few different categories of isolation and what kind of security they provide. An Intro to Fly Machines: fly.io/docs/machines/overview/ Machines API: fly.io/docs/machines/api/ Fly Kubernetes: fly.io/docs/kubernetes/
Globally Distributed Postgres on Fly.io | Single leader replication + fly-replay
Переглядів 2,2 тис.Місяць тому
Deploying your app to multiple regions is great - until you have to make long-distant calls to your ONE database that lives halfway across the world. In this video I'll show you a simple technique that makes it easy to deploy a globally distributed Postgres cluster using a really cool feature on Fly.io called "fly-replay". Fly-Replay Header: fly.io/docs/networking/dynamic-request-routing/ Bluep...
How Fly.io does routing at the edge | BGP + Anycast
Переглядів 1,2 тис.Місяць тому
Learn how Fly.io serves your app close to your users by routing on the edge with BGP (border gateway protocol) and Anycast. Learn about Fly Domains: ua-cam.com/video/vU9xcRCX7-U/v-deo.html Learn about networking on Fly.io: fly.io/docs/networking/
Fresh Produce | July 2024
Переглядів 410Місяць тому
A quick overview and demonstration of features introduced on fly.io in the month of July. Community Forum: community.fly.io flyctl Features - python scanner improvements: community.fly.io/t/even-more-python-support/20764 - meteor 3: community.fly.io/t/fly-launch-now-with-more-meteor/20837 - github actions: community.fly.io/t/automatic-github-push-to-deploy/20671 - into flag: github.com/superfly...
Learning AI Deployments
Переглядів 212Місяць тому
I've been learning how to deploy and augment LLM models using Fly.io's GPUs. If you are building AI apps, here are five things I've learned as I get more familiar with everything: 1. Every LLM model should be its own application 2. Don't allow the public to access your models. 3. Don't redownload your base models on every run. 4. Don't wipe your database. 5. Stop idle GPUs. If you want to learn...
Deploying an LLM-Powered Django App | Ollama + Fly GPUs
Переглядів 821Місяць тому
Learn how to run LLMs locally, integrate with your Python/Django apps, self-host Ollama with one file and finally deploy an LLM-Powered Django app using self-hosted Ollama running on Fly GPUs. Source code: github.com/katiayn/django-fridge Ollama demo app: github.com/katiayn/fly-katia-ollama Related videos: - Fly.io networking: ua-cam.com/video/vU9xcRCX7-U/v-deo.html Related links: - Ollama webs...
Scaling your GPU app in anger
Переглядів 579Місяць тому
Jack into your private network with WireGuard: ua-cam.com/video/4NcvlIlIlso/v-deo.html Praise my GitHub Profile: praise-me.fly.dev Source code: github.com/Xe/praise-me Link to some free fly.io credits to get you started with GPU apps: fly.io/hello/xe?
Compose Apps with flyctl
Переглядів 462Місяць тому
Apps rarely exist in a vacuum. When you develop for a domain, you will have a lot of parts that you can compose together into a greater whole. We're introducing a new feature to flyctl that will help with this workflow. Node Dictaphone: github.com/fly-apps/node-dictaphone Cog Whisper: github.com/rubys/cog-whisper/?tab=readme-ov-file#whisper-on-fly-gpus Community Forum: community.fly.io/
Supercharge your Laravel app with AI
Переглядів 741Місяць тому
Supercharge your Laravel app with AI
Adding your own models to Ollama
Переглядів 697Місяць тому
Adding your own models to Ollama
Stream Responses from an LLM | Ollama, React, Astro on Fly.io
Переглядів 807Місяць тому
Stream Responses from an LLM | Ollama, React, Astro on Fly.io
Deploying an App using a Self-Hosted LLM | Fly GPUs + Ollama + Remix
Переглядів 3902 місяці тому
Deploying an App using a Self-Hosted LLM | Fly GPUs Ollama Remix
Scaling a social network on a whiteboard by Xe Iaso | DevOpsDays MSP
Переглядів 1,9 тис.2 місяці тому
Scaling a social network on a whiteboard by Xe Iaso | DevOpsDays MSP
Fly Domains Explained | .fly.dev, .internal, .flycast
Переглядів 2,7 тис.2 місяці тому
Fly Domains Explained | .fly.dev, .internal, .flycast
Build your Personal Language Assistant with an LLM | Fly.io GPUs + Ollama
Переглядів 5242 місяці тому
Build your Personal Language Assistant with an LLM | Fly.io GPUs Ollama
How to Self-Host an LLM | Fly GPUs + Ollama
Переглядів 1,8 тис.2 місяці тому
How to Self-Host an LLM | Fly GPUs Ollama
Globally-distributed Object Storage (no CDN required) | Tigris Data + Fly.io
Переглядів 2 тис.2 місяці тому
Globally-distributed Object Storage (no CDN required) | Tigris Data Fly.io
Boost Your App with Self-Hosted LLMs on Fly.io - Step-by-Step Guide
Переглядів 2,7 тис.2 місяці тому
Boost Your App with Self-Hosted LLMs on Fly.io - Step-by-Step Guide
Auto configuring Node (and Bun!) apps for Tigris
Переглядів 5672 місяці тому
Auto configuring Node (and Bun!) apps for Tigris
How Fly.io uses Docker (without Docker)
Переглядів 39 тис.2 місяці тому
How Fly.io uses Docker (without Docker)
Bounce traffic between Apps and Machines with fly-replay HTTP header
Переглядів 6222 місяці тому
Bounce traffic between Apps and Machines with fly-replay HTTP header
AWS Without Access Keys
Переглядів 1,6 тис.3 місяці тому
AWS Without Access Keys
Using AI to Boost Accessibility and SEO - Fly.io blog
Переглядів 1173 місяці тому
Using AI to Boost Accessibility and SEO - Fly.io blog
Chesstreaming: Game Ideas (Part 2)
Переглядів 1433 місяці тому
Chesstreaming: Game Ideas (Part 2)
Chesstreaming: A Game (Part 1)
Переглядів 773 місяці тому
Chesstreaming: A Game (Part 1)
Chesstreaming: Intro (Part 0)
Переглядів 1163 місяці тому
Chesstreaming: Intro (Part 0)
Get llama3 running on Fly.io fast
Переглядів 1883 місяці тому
Get llama3 running on Fly.io fast
Fly.io Devrel Podcast #1 | Fly Kubernetes (FKS)
Переглядів 2873 місяці тому
Fly.io Devrel Podcast #1 | Fly Kubernetes (FKS)

КОМЕНТАРІ

  • @mohamedmonem2645
    @mohamedmonem2645 3 години тому

    On-premises is better than any cloud

  • @ronminnich
    @ronminnich 14 годин тому

    This is why the visor project, which we started at Google in 2014, works the way it does -- very lightweight VM.

  • @rperlberg
    @rperlberg День тому

    When I clicked on the video I thought you were going to try to convince me to throw away my Tupperware.

  • @banwa_non
    @banwa_non День тому

    This really has 1 million views??? O_o

  • @warthog123
    @warthog123 День тому

    Considering containers for security is same considering VMs for flexibility and performance.

  • @Dogo.R
    @Dogo.R 2 дні тому

    I don't really understand how cloudflare proxying and cloudflare reverse proxies work then. Why do you need a VPN but neither of those do? All these things proxy traffic.

  • @JonMartins
    @JonMartins 2 дні тому

    So it means we have more latency when writing right?

  • @jardelainen8278
    @jardelainen8278 2 дні тому

    Is she reading a script or one of those who implement the technical part of this or both?

  • @digitaleswerken
    @digitaleswerken 2 дні тому

    I've checked. My closest Taco Bells is 780km away and going there would likely get me into troubles with the NATO Allied Air Command. But I've heard NATO is providing a great service for there customers too.

  • @wt4csm
    @wt4csm 2 дні тому

    All code should be in jail.

  • @lordmushroom723
    @lordmushroom723 2 дні тому

    LXCs > Docker. Configure with Ansible. I like this model much better than containers. But TBH you really can't beat reproducibility with containers. You just can't

  • @Scorry
    @Scorry 2 дні тому

    Please, do not use «firecracker» word. You should use «KVM» word. Four and a half minutes of bullshit.

  • @usernamehandle
    @usernamehandle 2 дні тому

    Nearly every single comment contradicts the point of this video, so as an aspiring dev… not gonna keep watching!

  • @DKLHensen
    @DKLHensen 3 дні тому

    Tjroooottt

  • @_vindicator_
    @_vindicator_ 3 дні тому

    You kinda just reinvented the wheel. You can have (and most do) both containers and virtualization. Make clusters based on trust level and deploy apps according to level of trust. The platform runs on VMs, the apps run on containers. Haven't seen a PaaS run on bare metal for more than 6 years now.

  • @capability-snob
    @capability-snob 3 дні тому

    This is super sensible. Network stacks in a safe language in userspace, without legacy bloat, are a big step up.

  • @Perspectologist
    @Perspectologist 3 дні тому

    Very interesting. Thanks for the explanation.

  • @luispflamminger
    @luispflamminger 3 дні тому

    Interesting approach! My first instinct was to tunnel the SSH connection through websockets via the fly proxy. There seems to be a project called huproxy doing exactly this. That way you wouldn’t have to ship an entirely separate TCP/IP stack. Would genuinely be interested if you have considered this and why you didn’t do it that way.

  • @kognitiva
    @kognitiva 3 дні тому

    This exactly! : DD

  • @sorrowseal
    @sorrowseal 3 дні тому

    As a senior SRE, I disagree with the concerns you’ve raised about containers. In a well-architected Kubernetes environment, it’s possible to achieve everything you’ve mentioned using containers, and this can be done without the overhead of VMs.

  • @sherman1989
    @sherman1989 4 дні тому

    Do you really understand containers? 😂😂😂

  • @roodood
    @roodood 4 дні тому

    Imma let you finish but I need to subscribe first because this is another top tier video ma'am.

  • @Gringohuevon
    @Gringohuevon 4 дні тому

    Cloud Run..in other words

  • @davorinrusevljan6440
    @davorinrusevljan6440 5 днів тому

    I am split between and awe and slight worry. Awe because it is impressive to which lengths you went to make user experience smooth. Worry because there is some little voice telling me that things could start going wrong if each app implements its own tcp stack. I enjoy your videos. keep making them, please.

    • @oserodal2702
      @oserodal2702 День тому

      Go apps "implement their own TCP stack" by default anyways, so it doesn't matter that way anyways.

    • @davorinrusevljan6440
      @davorinrusevljan6440 День тому

      @@oserodal2702 really. do they? I kind of doubt it, but I am open to be proved wrong.

  • @rusus767
    @rusus767 5 днів тому

    its overengineered. OpenSSH already has the concept of jump hosts????

  • @HerbieBancock
    @HerbieBancock 5 днів тому

    Docker is a VM. Just because they try to hide it from you and don't let you control it doesn't mean their product isn't total horseshit.

  • @hypergraphic
    @hypergraphic 5 днів тому

    Dang, that's really cool.

  • @deejay4am
    @deejay4am 5 днів тому

    Oh yay, a whole 'nother network stack that receives security patching separately from the kernel. Sounds like a security nightmare TBH, no thank you

    • @oserodal2702
      @oserodal2702 День тому

      Kernel networking stacks are also a pain to get working with a process in user space, that's why we see a lot of programs depend on openssl. However, depending on openssl brings its own set of tradeoffs. Nevermind the fact that Linking C and Go is the most unenjoyable experience. The one good thing about doing networking with Go lang is that it's (probably) just as battle tested on networking and security as the Linux kernel, with less pitfalls and footguns.

  • @martg0
    @martg0 5 днів тому

    Super!

  • @qodesmith520
    @qodesmith520 5 днів тому

    These videos are so good.

  • @subject-9313
    @subject-9313 5 днів тому

    ngl I thought this was that one game

  • @andrelandgraf1398
    @andrelandgraf1398 5 днів тому

    I was wondering why I don’t need WireGuard anymore! That’s awesome!

  • @user-yf1ml8jt3i
    @user-yf1ml8jt3i 5 днів тому

    and that is... a lot of annoying comments that makes me vomit and dont want to use it

  • @y.m.o6171
    @y.m.o6171 5 днів тому

    amazing content like always

  • @CharlesOdili
    @CharlesOdili 5 днів тому

    And that, is developer experience done right!

  • @edbond
    @edbond 5 днів тому

    Nice video! You can update link to netstack, it's 1.23 already "This repo is no longer maintained. As of Go 1.17 and its lazy module loading we no longer need it, so we now just use upstream gVisor directly."

  • @eugenkeller
    @eugenkeller 5 днів тому

    commercial over commercial on top of commercial to promote some more commercials.

  • @pierbover
    @pierbover 5 днів тому

    and that is... killer marketing 🔥🔥🔥

  • @nemzyxt
    @nemzyxt 5 днів тому

    I love your content. Keep it up!

  • @stuartallen2001
    @stuartallen2001 5 днів тому

    These are such cool videos!

  • @tristanbob
    @tristanbob 5 днів тому

    This is so cool! Thanks for making easy to use features like this.

  • @KentCDodds-vids
    @KentCDodds-vids 5 днів тому

    And that is customer service

  • @qizott6442
    @qizott6442 5 днів тому

    Kernel space TCP/IP stack also means enhanced performance. How does it compare to a userspace stack where you still eventually need to reach out to kernel to send bytes?

    • @tristanbob
      @tristanbob 5 днів тому

      My uninformed guess is that it will be slightly slower, but this is for admin access so high performance is not a high priority.

    • @neilknet
      @neilknet 5 днів тому

      Equally uninformed guess: or it might be that they can jettison legacy features, and maybe even skip some negotiation because they already know who they are calling and what kind of message they are sending

  • @martg0
    @martg0 5 днів тому

    sounds like bastion server on demand

    • @tristanbob
      @tristanbob 5 днів тому

      Sort of, except your computer is the bastion! :)

  • @saiskanda
    @saiskanda 5 днів тому

    Without the cortisol 😂 nice touch, everytime I need to think about anything kubernetes I think my brain goes "ok, cortisol time!"

  • @sebirocs
    @sebirocs 5 днів тому

    This is crazy and it can be used for other applications and use cases

  • @chris-malek
    @chris-malek 5 днів тому

    Yo keep up the great content.

  • @snehanshuphukon728
    @snehanshuphukon728 5 днів тому

    Good

  • @elihatamov634
    @elihatamov634 6 днів тому

    I actualy tried to play with kata on k3s with fc to test it but I couldnt get it to work, but this video inspired me to try it again, BTW you are probably runing fc on k8s BTS for scaling, am I right?

  • @alycheikhouldsmail7576
    @alycheikhouldsmail7576 6 днів тому

    Great but I hope you make similar thing for Django app too