Boost Your App with Self-Hosted LLMs on Fly.io - Step-by-Step Guide

Поділитися
Вставка
  • Опубліковано 29 лис 2024

КОМЕНТАРІ • 7

  • @kelvinconnor8869
    @kelvinconnor8869 4 місяці тому +5

    Excellent video, certainly the most succinct tutorial I’ve seen on getting a hosted LLM up and running. Well done.

  • @notnullbit
    @notnullbit 4 місяці тому +5

    I was going to look into this exact thing this week and woke up to this video. Awesome stuff. Great videos overall love the platform

  • @y.m.o6171
    @y.m.o6171 4 місяці тому +3

    Hey there. Amazing video. unfortunately you spiked over the part on how you did the wire guard tunnelling. Would you pray share how you did this pretty please ?

    • @flydotio
      @flydotio  4 місяці тому +2

      tldr; `$ fly wg create personal iad my-org-tunnel`. You can replace `iad` with the region closest to you, as reported by fly.io/debug . Then copy paste the stdout to the Wireguard app installed from the app store. We have a step by step video ua-cam.com/video/4NcvlIlIlso/v-deo.html

  • @ebm_gamer
    @ebm_gamer 4 місяці тому +1

    Chris is the GOAT 🐐

  • @claude4074
    @claude4074 4 місяці тому +1

    How do we find the costs to run this?

    • @flydotio
      @flydotio  4 місяці тому

      fly.io/gpus should be a good place to start