How to Deploy ML Models in Production with BentoML

Поділитися
Вставка
  • Опубліковано 11 жов 2024

КОМЕНТАРІ • 33

  • @nguyenthehoang9148
    @nguyenthehoang9148 Рік тому

    Thank you for your time and effort in making this video!
    May I have some comments:
    1) The good:
    - The content is great
    - About the video itself, everything is great (e.g., light, speech, clarity of explanation, .. and so on)
    2) The not really good:
    - People, looking for solutions for our showcase projects, don't see what we are looking for in the video and probably go back to some tutorials about using Flask to serve our models. Here's why: we probably want to make a web app or a mobile app (e.g., using react native) and include the link to the resume. Your content isn't finished, so it isn't convincing enough.

  • @TridomML
    @TridomML Рік тому +3

    Would love to see an update to this video, perhaps with a more complex model framework such as PyTorch or Huggingface!
    BentoML has updated some of its infrastructure to handle custom objects, which can store the tokenizer for these models, but there's a gap in resources that demonstrate how to utilize that tokenizer in the `predict()` service function definition.

  • @ThomasFackrell
    @ThomasFackrell 7 місяців тому

    This is super cool! I can't wait to share it with my team.

  • @crackintosh
    @crackintosh 7 місяців тому

    Best video on bentoml!

  • @chadzulu4328
    @chadzulu4328 Рік тому

    Great explanation, thank you!

  • @dongxiaxing7767
    @dongxiaxing7767 Рік тому

    Thank you for sharing

  • @JaydeepSamanta
    @JaydeepSamanta Рік тому

    Thank you for the tutorial, I have a question, in my project I have multiple edge devices, can I use BentoML's runner instance to run on multiple nodes?

  • @4sci
    @4sci 10 місяців тому

    Thanks 👍👍

  • @Raulvic
    @Raulvic 2 роки тому

    thank you for sharing!

  • @manhpham5772
    @manhpham5772 2 роки тому +2

    Dear sir, can I ask why should we use BentoML, while there're loads of robust serving frameworks? Or in other words, can you compare BentoML with others... Thank you!

  • @aibdarija5856
    @aibdarija5856 2 роки тому

    Can you do the blind source separation

  • @marinamaayah6899
    @marinamaayah6899 Рік тому

    I had this error How can I chck the server log to know what exactly the error
    rediction: "An error has occurred in BentoML user code when handling this request, find the error details in server logs"

  • @iva1389
    @iva1389 Рік тому +1

    I'm stuck: from mldeployment import training
    ImportError: cannot import name 'training' from 'mldeployment' (unknown location)

  • @jawadmansoor6064
    @jawadmansoor6064 2 роки тому +1

    How do you deploy voice recognition system (as in your previous videos) on bentos?
    Here at 13:39 on line 16 input and output is numpyNDarray, what would it be for audio data?

    • @ValerioVelardoTheSoundofAI
      @ValerioVelardoTheSoundofAI  2 роки тому

      It depends on the type of audio representation you use as input (e.g., spectrograms, waveform). In most cases, it would be NumpyNDarray. For the output, again, it depends. Most likely you'll have one-hot encoding as in the example of this video. For that, you can use NumpyNDarray. Hope this helps!

    • @jawadmansoor6064
      @jawadmansoor6064 2 роки тому +1

      @@ValerioVelardoTheSoundofAI Thank you I will try this

  • @shadyizloo
    @shadyizloo 2 роки тому

    hey i need to know how does python work when you have two separate train and test files. like we train on one file and then test on another csv file. please guide if you know how does that work

  • @Diego0wnz
    @Diego0wnz 2 роки тому

    Why did you make a json file of the input?

  • @sarthak7413
    @sarthak7413 Рік тому

    I am not able to containerize using bentoml..

  • @haoshoku8496
    @haoshoku8496 2 роки тому

    Hello I I have a question I want to make a project on removing stutter from a speech signal what data structures or tools do I need in order to make this?

    • @jawadmansoor6064
      @jawadmansoor6064 2 роки тому +1

      What is stutter in speech? If a person, (child or old) stutters I think it would be impossible to clear it.

    • @haoshoku8496
      @haoshoku8496 2 роки тому

      @@jawadmansoor6064 thank u for the reply!
      I myself am a stutterer so I just thought of making this. Impossible? Can't we filter out the redundant signals or something like that?

    • @jawadmansoor6064
      @jawadmansoor6064 2 роки тому +1

      @@haoshoku8496 Not through DSP, though we might be able to train an AI model that can filter or even generate a new voice.
      Do you speak English by the way? I am interested in this project.

    • @haoshoku8496
      @haoshoku8496 2 роки тому

      @@jawadmansoor6064 I think there is a dataset for this but I don't know machine learning yet so I decided that if I could do that by DSP and if DSP will not work here so machine learning is maybe the only solution and Yes i do speak English!

    • @jawadmansoor6064
      @jawadmansoor6064 2 роки тому +1

      @@haoshoku8496 Thank you. I will look for it now.

  • @shubhamtalks9718
    @shubhamtalks9718 4 місяці тому

    To be very honest, BentoML doesn't seem to be adding any value! Why would anyone switch from FastAPI to this?

    • @lolikpof
      @lolikpof 2 місяці тому

      Same question

  • @alixmortimer5143
    @alixmortimer5143 2 роки тому

    ƤRO𝓂O𝕤ᗰ

  • @Raulvic
    @Raulvic 2 роки тому

    Thank you for sharing