Hands-on: Spring AI with Ollama and Microsoft Phi-3 🚀 🦙 | Run LLMs locally and connect from Java
Вставка
- Опубліковано 2 жов 2024
- This video covers how to run LLMs locally using Ollama and Spring AI with hands on example in Spring Boot and Ollama libraries.
Join this channel by contributing to the community:
/ @techprimers
📌 Related Playlist
================
🔗 AI Primer Playlist - • AI Primer
🔗Spring Boot Primer - • Spring Boot Primer
🔗Spring Cloud Primer - • Spring Cloud Primer
🔗Spring Microservices Primer - • Spring Microservices P...
🔗Spring JPA Primer - • Spring JPA Primer
🔗Java 8 Streams - • Java 8 Streams
🔗Spring Security Primer - • Spring Security Primer
💪 Join TechPrimers Slack Community: bit.ly/JoinTec...
📟 Telegram: t.me/TechPrimers
🧮 TechPrimer HindSight (Blog): / techprimers
☁️ Website: techprimers.com
💪 Slack Community: techprimers.sl...
🐦 Twitter: / techprimers
📱 Facebook: TechPrimers
💻 GitHub: github.com/Tec... or techprimers.gi...
🎬 Video Editing: FCP
---------------------------------------------------------------
🔥 Disclaimer/Policy:
The content/views/opinions posted here are solely mine and the code samples created by me are open sourced.
You are free to use the code samples in Github after forking and you can modify it for your own use.
All the videos posted here are copyrighted. You cannot re-distribute videos on this channel in other channels or platforms.
#SpringAI #Ollama #TechPrimers
You are a key contributor in the java space, pls continuing doing awesome work. Requesting you to extend this video with some sample trained data. Data that could be fed to this llm eg we can store in our repository like top destination as per the time of the year / events/ weather etc,
Thanks for the kind words Mudassarh. Yes sure i will make those soon like i showed in the RAG architecture
Informative as usual, I think python & its framework would be more suitable for AI content at least for quick PoC. Definitely this video will help Java fans😊
Ya shiv, will do python soon
Thank you , I am looking forward to learning more from your channel, much appreciated, keep going, we java lovers are with you :)
Awesome, thank you!
pls create video using open ai
Thanks for the video, few things are unclear from the demo, does the Spring AI talk to your local ollama ? What happens if ollama is not installed or running that model at that point of time ?
Hi manoj, yes it connects to the local ollama. You will receive connection refused error or 404 error if ollama is down
Thanks for the another great video as usual. Yes if possible please make video on azure openAI which is one of trending AI interface.
Sure janakiram
Good one , but imagine my backend is supporting a application, and my offline running ai model is as connected to my backend springboot, now how can I train the offline running ai model about the application and create a chat bot which gives response to the request only about the trained data i.e the application
Great question. Take a look at my video on RAG architecture on how it can solve the dynamic data source updates in the LLM model. I will make a video on that soon with handson
@@TechPrimers waiting for it and if possible try creating a scenario which I explained
Gr8 info buddy for beginners. I want to use microsoft azure openai with custom data and rag too. Also need a custom chatbotot (own). Can you help me with desing?
How to build my app in python, call 3rd party api, how to use RAG, how to expose API to custom chatbot etc ?
👍👍
thank you Ajay. you made my day.. one query, is it possible to upload a resume file and get the required details like, name, contact, skills etc..
I haven’t tried that yet Raj. Will try it out. Thank you
@@TechPrimers thank you so much.. I too trying the same..
Please let us know if you done with it.
Thank you
😅
Lets Go!