Advancing AI - Fine Tuning LLMs with Azure OpenAI

With all the excitement around large language models, one question has been repeatedly asked throughout - "How do I make my own?". There are plenty of techniques to pass additional context and reference material into a generic, pre-trained model, but if you want a model that is super fast and already understands your context, you need to fine-tune a model.
We recently saw announcements from Microsoft that the Azure Open AI service now supports both training a fine-tuned model, but also hosting that model at the click of a button!
In this video, Simon and Gavi take a look at the concept of Fine Tuning LLMs, then review a super quick demo of how we pass some data to the gpt3.5 turbo model, which is what powers the public ChatGPT service!
For more details around the recent announcements, check out: techcommunity.microsoft.com/t...
And as always, if you need an accelerator behind your large language model aspirations, get in touch with Advancing Analytics!

[@drummerboi4eva]

Thanks for sharing Simon and Gavita !! Great video

[@rahulcn1314]

when our model is fine tunned then new endpoint is created?
If yes then how can we use that endpoint for our use case outside azure environment ?
btw great video 👍

[@hasanabbas1555]

intro was nice

[@rushankpatil]

How to convert json foramt into jsonl format with pyspark?

[@victorheineken7363]

I have a question, is it possible to build it with python?

[@restashoremusic]

You should tell us how to use the fine tuned model via API

[@shalinigoel13]

very superficial explanation. Just giving out the steps. Please also explain what is happening to the parameters of the base LLM with these 20 lines of training data?

[@DollyBastard]

Interesting, but no concrete answers to your questions.