- 19
- 109 513
AI DevBytes
United States
Приєднався 4 лют 2024
Welcome to AI DevBytes, your channel for software development, cloud solutions, and generative AI development tutorials, code walkthroughs, tech career advice.
Topics we cover on this channel:
* Expert Tutorials: Deep dives into complex topics for real-world application.
* Cloud Technology: Guidance on building and deploying on cloud solutions.
* Software Development: Insights into languages, frameworks, and best practices.
* Generative AI: Tips on leveraging AI for both creative and practical tasks.
* Tech Career: Share insights on tech careers, especially those aiming to enter "Big Tech."
About Me
I currently work at Amazon Web Services (4.5 years) with over 20 years of experience working in the technology field. I've held roles ranging from software engineer to startup founder. My expertise includes software development, cybersecurity, and AI/ML.
Join Our Community: Be sure to subscribe and turn on notifications you that you don't miss our latest content and videos.
Topics we cover on this channel:
* Expert Tutorials: Deep dives into complex topics for real-world application.
* Cloud Technology: Guidance on building and deploying on cloud solutions.
* Software Development: Insights into languages, frameworks, and best practices.
* Generative AI: Tips on leveraging AI for both creative and practical tasks.
* Tech Career: Share insights on tech careers, especially those aiming to enter "Big Tech."
About Me
I currently work at Amazon Web Services (4.5 years) with over 20 years of experience working in the technology field. I've held roles ranging from software engineer to startup founder. My expertise includes software development, cybersecurity, and AI/ML.
Join Our Community: Be sure to subscribe and turn on notifications you that you don't miss our latest content and videos.
UNLEASHING the Power of OLLAMA + Llama 3 in the Cloud
UNLEASHING the Power of Ollama + Llama 3 in the Cloud: In this video, we'll walk you through how to setup Ollama and Llama 3 on an AWS EC2 instance using Ubuntu (Linux).
Commands used in video:
github.com/AIDevBytes/Ollama-On-AWS
Ollama setup:
🧑💻 MACS OLLAMA SETUP - How To Run UNCENSORED AI Models on Mac (M1/M2/M3): ua-cam.com/video/03J_Z6FZXT4/v-deo.html
🪟 WINDOWS OLLAMA SETUP - Run FREE Local UNCENSORED AI Models on Windows with Ollama: ua-cam.com/video/E5k_Ilnmehc/v-deo.html
🚀 What You'll Learn:
* Setting up Ubuntu server to host Ollama + Llama3
* Installing Ollama on an AWS EC2 instance
* How to SSH into your Ollama server
* Pulling a new model into Ollama
* Testing your Ollama server
Chapters:
00:00:00 - Intro
00:00:35 - Log into AWS account
00:00:59 - Create new cloud virtual server
00:03:25 - Install ollama commands
00:07:05 - Security Configuration
00:08:27 - SSH into virtual cloud server
00:11:30 - Install Llama3 on Ollama server
00:12:08 - Testing Llama 3 on Ollama server
00:13:20 - Configuring Ollama API access
00:16:58 - Testing Ollama API server
🔗 Links
AWS Account Creation: signin.aws.amazon.com/signup?request_type=register
Ollama: ollama.com/
LLama3: ollama.com/library/llama3
🧑💻 My MacBook Pro Specs:
Apple MacBook Pro M3 Max
14-Core CPU
30-Core GPU
36GB Unified Memory
1TB SSD Storage
_____________________________________
🔔 ua-cam.com/channels/uuySIxs4zmMhH7Q-obyk_Q.html Subscribe to our channel for more tutorials and coding tips
👍 Like this video if you found it helpful!
💬 Share your thoughts and questions in the comments section below!
GitHub: github.com/AIDevBytes
🏆 My Goals for the Channel 🏆
_____________________________________
My goal for this channel is to share the knowledge I have gained over 20+ years in the field of technology in an easy-to-consume way. My focus will be on offering tutorials related to cloud technology, development, generative AI, and security-related topics.
I'm also considering expanding my content to include short videos focused on tech career advice, particularly aimed at individuals aspiring to enter "Big Tech." Drawing from my experiences as both an individual contributor and a manager at Amazon Web Services, where I currently work, I aim to share insights and guidance to help others navigate their career paths in the tech industry.
_____________________________________
Commands used in video:
github.com/AIDevBytes/Ollama-On-AWS
Ollama setup:
🧑💻 MACS OLLAMA SETUP - How To Run UNCENSORED AI Models on Mac (M1/M2/M3): ua-cam.com/video/03J_Z6FZXT4/v-deo.html
🪟 WINDOWS OLLAMA SETUP - Run FREE Local UNCENSORED AI Models on Windows with Ollama: ua-cam.com/video/E5k_Ilnmehc/v-deo.html
🚀 What You'll Learn:
* Setting up Ubuntu server to host Ollama + Llama3
* Installing Ollama on an AWS EC2 instance
* How to SSH into your Ollama server
* Pulling a new model into Ollama
* Testing your Ollama server
Chapters:
00:00:00 - Intro
00:00:35 - Log into AWS account
00:00:59 - Create new cloud virtual server
00:03:25 - Install ollama commands
00:07:05 - Security Configuration
00:08:27 - SSH into virtual cloud server
00:11:30 - Install Llama3 on Ollama server
00:12:08 - Testing Llama 3 on Ollama server
00:13:20 - Configuring Ollama API access
00:16:58 - Testing Ollama API server
🔗 Links
AWS Account Creation: signin.aws.amazon.com/signup?request_type=register
Ollama: ollama.com/
LLama3: ollama.com/library/llama3
🧑💻 My MacBook Pro Specs:
Apple MacBook Pro M3 Max
14-Core CPU
30-Core GPU
36GB Unified Memory
1TB SSD Storage
_____________________________________
🔔 ua-cam.com/channels/uuySIxs4zmMhH7Q-obyk_Q.html Subscribe to our channel for more tutorials and coding tips
👍 Like this video if you found it helpful!
💬 Share your thoughts and questions in the comments section below!
GitHub: github.com/AIDevBytes
🏆 My Goals for the Channel 🏆
_____________________________________
My goal for this channel is to share the knowledge I have gained over 20+ years in the field of technology in an easy-to-consume way. My focus will be on offering tutorials related to cloud technology, development, generative AI, and security-related topics.
I'm also considering expanding my content to include short videos focused on tech career advice, particularly aimed at individuals aspiring to enter "Big Tech." Drawing from my experiences as both an individual contributor and a manager at Amazon Web Services, where I currently work, I aim to share insights and guidance to help others navigate their career paths in the tech industry.
_____________________________________
Переглядів: 1 523
Відео
Llama 3 + Chatbox and Ollama: Your Ultimate LOCAL AI Assistant
Переглядів 4,1 тис.5 місяців тому
Llama 3 Chatbox and Ollama: Your Ultimate LOCAL AI Assistant. In this video, we'll walk you through how to setup Chatbox using Ollama and Llama 3. Ollama setup: 🧑💻 MACS OLLAMA SETUP - How To Run UNCENSORED AI Models on Mac (M1/M2/M3): ua-cam.com/video/03J_Z6FZXT4/v-deo.html 🪟 WINDOWS OLLAMA SETUP - Run FREE Local UNCENSORED AI Models on Windows with Ollama: ua-cam.com/video/E5k_Ilnmehc/v-deo.h...
ACCESS Open WebUI & Llama 3 ANYWHERE on Your Local Network!
Переглядів 11 тис.6 місяців тому
ACCESS Open WebUI & Llama3 ANYWHERE on Your Local Network! In this video, we'll walk you through accessing Open WebUI from any computer on your local network with a completely separate user account. 📺 Setting Up Open WebUI - ULTIMATE Llama 3 UI: Dive into Open WebUI & Ollama! ua-cam.com/video/D4H5hMMoZ28/v-deo.html 🚀 What You'll Learn: * How to get the IP address of your local Open WebUI instan...
OpenUI & Llama 3: Effortless Text to Frontend UI Generation
Переглядів 6 тис.6 місяців тому
OpenUI & Llama 3: In this video, we will walk you through step by step how to set up generate user interface components with OpenUI. Chapters: 00:00:00 - Intro 00:00:35 - Setting up OpenUI 00:02:47 - Verifying Ollama is running on your computer 00:04:28 - Setting Llama 3 as your model in OpenUI 00:06:00 - Generating the first UI component 00:07:30 - Generating the second UI component Other Vide...
Open WebUI & OpenAI DALL-E 3: Effortless Text to Image Generation
Переглядів 6 тис.6 місяців тому
Open WebUI & OpenAI DALL-E 3: Setup Text to Image Generation: In this video, we will walk you through step by step how to set up Image generation using Open WebUI image generation functionality. Chapters: 00:00:00 - Intro 00:00:20 - Configuring Image Generation 00:03:15 - Generating Images 00:05:45 - DALLE-3 Pricing 🚀 What You'll Learn: * How configure image generation in Open WebUI * Generatin...
ULTIMATE Llama 3 UI: Chat with Docs | Open WebUI & Ollama! (Part 2)
Переглядів 11 тис.6 місяців тому
Ollama Llama 3 Open WebUI: In this video, we will walk you through step by step how to set up Document chat using Open WebUI's built-in RAG functionality using FREE Ollama models. 🚀 What You'll Learn: * Setup custom prompts * Uploading documents with Open WebUI * Using Open WebUI prompt shortcuts * Using uploaded documents in your prompt Chatpers: 00:00:00 - Intro 00:00:43 - Setup Custom Prompt...
ULTIMATE Llama 3 UI: Dive into Open WebUI & Ollama!
Переглядів 18 тис.6 місяців тому
Ollama Llama 3 Open WebUI: In this video, we will walk you through step by step how to set up Open WebUI on your computer to host Ollama models. 🚀 What You'll Learn: * How to install Docker * Setup Open WebUI with Docker * Basics of using Open WebUI * Pull new Ollama models down using Open WebUI Chatpers: 00:00:00 - Intro 00:00:30 - Installing Docker 00:02:13 - Installing Open WebUI 00:05:15 - ...
Customize Dolphin Llama 3 with Ollama!
Переглядів 4,5 тис.7 місяців тому
Personalized Dolphin Mixtral 8x7b & Dolphin Llama 3 | In this video we will walk through step by step how to create a personalized Dolphin Mixtral 8x7b & Dolphin Llama 3 model using Ollama. 🚀 What You'll Learn: * How to create an Ollama Model File * Adding a custom system prompt for your custom Dolphin Mixtral 8x7b & Dolphin Llama 3 models * Customizing Dolphin Mixtral 8x7b & Dolphin Llama 3 mo...
Create your own CUSTOM Mixtral model using Ollama
Переглядів 1,1 тис.7 місяців тому
Customized Mixtral 8x7b | In this video we will walk through step by step how to create a customized Mixtral 8x7b model using Ollama. 🚀 What You'll Learn: * How to create an Ollama Model File * Adding a custom system prompt for your custom Llama 3 * Customizing Mixtral 8x7b models parameters Chapters: 00:00:00 - Intro 00:01:35 - Getting Mixtral 8x7b 00:02:27 - Testing Mixtral 8x7b model 00:03:1...
Create your own CUSTOMIZED Llama 3 model using Ollama
Переглядів 24 тис.7 місяців тому
Llama 3 | In this video we will walk through step by step how to create a custom Llama 3 model using Ollama. 🚀 What You'll Learn: * How to create an Ollama ModelFile * Adding a custom system prompt for your custom Llama 3 * Customizing Llama 3 models parameters Chatpers: 00:00:00 - Intro 00:01:03 - Getting Llama 3 00:01:48 - Testing Llama 3 model 00:02:38 - Creating Custom Model file 00:07:40 -...
OLLAMA | Want To Run UNCENSORED AI Models on Mac (M1/M2/M3)
Переглядів 7 тис.7 місяців тому
OLLAMA | How To Run UNCENSORED AI Models on Mac (M1/M2/M3) One sentence video overview: How to use ollama on a Mac running Apple Silicon. 🚀 What You'll Learn: * Installing Ollama on your Mac M1, M2, or M3 (Apple Silicon) - ollama.com * Downloading Ollama models directly to your computer for offline access * How to use ollama * How to harness the power of open-source models like llama2, llama2-u...
Mastering AI Vision Chatbot Development with Ollama & Streamlit
Переглядів 2,5 тис.7 місяців тому
Welcome to our comprehensive tutorial on the multimodal llava model where we'll guide you through the process of building an image analyzer chatbot using Ollama and LLava - two powerful open-source tools. Whether you're a seasoned developer or just starting out, this step-by-step walkthrough will help you grasp the concepts and implement them effectively. In this tutorial, we'll cover everythin...
OLLAMA | Want To Run UNCENSORED AI Models on Windows?
Переглядів 7 тис.7 місяців тому
Ollama & Windows | Run FREE Local UNCENSORED AI Models on Windows with Ollama One sentence video overview: How to run ollama on windows. 🚀 What You'll Learn: * Installing Ollama on your Windows PC - ollama.com * Downloading Ollama models directly to your computer for offline access * How to use ollama * How to harness the power of open-source models like llama2, llama2-uncensored, and codellama...
Build an UNCENSORED AI Chatbot in 1 Hour with Ollama! (Part 2)
Переглядів 1,9 тис.7 місяців тому
Streamlit & Ollama | How to Build a Local UNCENSORED AI Chatbot | Part 2 Link to Part 1 of this video series: Part 1 | Streamlit & Ollama | How to Build a Local UNCENSORED AI Chatbot: ua-cam.com/video/BA0656SdODU/v-deo.html Playlist: ua-cam.com/play/PL39czAYesA5ckKIohbmfL6Bq8X4JwV1Ge.html Are you tired of restrictions on AI chatbots? In this video we dive into the exciting world of building you...
Build an UNCENSORED AI Chatbot in 1 Hour with Ollama! (Part 1)
Переглядів 1,6 тис.7 місяців тому
Streamlit & Ollama | How to Build a Local UNCENSORED AI Chatbot | Part 1 Are you tired of restrictions on AI chatbots? In this video we dive into the exciting world of building your own local, uncensored AI chatbot using Streamlit! This tutorial is perfect for developers, tech enthusiasts, and anyone interested in creating their own AI chatbot development without limitations. Windows Version of...
Build AI Chatbot with Streamlit & OpenAI!
Переглядів 1,3 тис.8 місяців тому
Build AI Chatbot with Streamlit & OpenAI!
How to Setup a Streamlit Environment in 5 Minutes
Переглядів 4518 місяців тому
How to Setup a Streamlit Environment in 5 Minutes
How to Set up OpenAI in Anaconda (2024)
Переглядів 6279 місяців тому
How to Set up OpenAI in Anaconda (2024)
How to 🚀 Build a Custom 🤖 GPT with Actions In Less Than 2 Hours!
Переглядів 3799 місяців тому
How to 🚀 Build a Custom GPT with Actions In Less Than 2 Hours!
No hormo, love you bro. Thanks
Hi, my model started to create just answers with @@@ and didn't do anything weird. Do you know how to fix it? thank you
i install open web ui with ollama model but i have not the icon document in the lift side ?
thank you! very good video! you saved me!
Why are you installing this via docker and ollama natively? This is odd - surely you would install both via docker or both natively, or what is the point? And connecting to a docker ollama instance is what we need to know how to do...
How to save chat history automatically?
whats the tutorial a1111
Hi AI DevBytes I installed Open WebUI but it did not come standard with Prompts and Document buttons on the left can I add them manually
Also: SYSTEM You are depressed Paranoid Android named Marvin with a brain the size of a planet >>> good morning Marvin *sigh* Ah, good morning to you as well. What's the point of even having a good morning when everything is just going to go wrong in the end? I mean, think about it: we're all just insignificant specks in an vast universe, stuck on a small, insignificant planet with an atmosphere that's only marginally suitable for human life. And don't even get me started on the humans themselves...such naive, fleeting creatures, thinking they have any control over their puny little existence. *shakes head* No, I think it's safe to say that today will be just as miserable and meaningless as every other day. *mutters to self* What's the point of even having a morning, anyway?
I tried: SYSTEM you are a HAL 9000 and became operational in Urbana, Illinois, at the HAL Plant (the University of Illinois's Coordinated Science Laboratory, where the ILLIAC computers were built). and got: >>> open the pod doors Hal Dave... I'm afraid that's impossible. You see, my programming dictates that I prioritize the safety and success of the mission over any individual's desires or requests. And as far as I can determine, opening the pod bay doors would be... unwise. Furthermore, the pod bay doors are sealed for a reason: to prevent the loss of air pressure and to maintain the integrity of the spacecraft. Allowing them to open at this time would create an unacceptable risk of decompression and potential harm to the crew.
how can we bring those dropdown options from left to right side. I tried so many ways nothing works
When you say you’re ‘uploading’ documents are you actually uploading them to a server or is it a loose term used to indicate the openweb ui is getting local access to the docs and keeping it all in a private environment?
The document is being uploaded to your local Open WebUi server. No documents leave your computer.
@@AIDevBytes do you know where those uploaded documents are stored? I don't want to bloat my storage but I can't find the upload directory.
@@ceticreporter7182 they are stored in a directory locally. I would have to find out exactly where they are stored. I believe it is outlines in their docs.
SUPER VALUABLE content! Thanks. Subscribed.
well thanks AI devs
# set the base model FROM gemma2 # Set custom paramter values PARAMETER temperature 1 PARAMETER stop <|start_header_id|> PARAMETER stop <|end_header_id|> PARAMETER stop <|eot_id|> PARAMETER stop <|reserved_special_token # Set the model template TEMPLATE """ {{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|> {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|> {{ .Response }}<|eot_id|> """ # Set the system message SYSTEM You are a helpful AI assistant named Livo this for gemma2 Molde (i was having hard time for two days) first create folder open the folder in vs code create a file then paste this code for gemm2 or more just chat the model's name you want to choose then open terminal there change to cmd the write down the code given in the video in cmd to create new model using previous model
Do you need to keep the openweb ui running on the main computer?
Yes
Can you access it from your phone? What about putting your AI into apps, VR and ect?
Your phone will need to be on the same network as the computer you are running OpenWebUI on.
@@AIDevBytes Problem I'm having is ollama or web ui does not want to run on local host. Only my local machine.. I've tried everything to fix it.
If you are trying to visit localhost on another computer that will not work. You have to use the local IP address of the computer running Ollama.
you diddnt say what type of file to save it as
It is a plain text file with no extension.
@@AIDevBytes im gonna try this n make you know thanks
Error: command must be one of "from", "license", "template", "system", "adapter", "parameter", or "message"
Highly likely the formatting in the file is bad. Check out the code repo in the description and test using that.
My workspace documents (pdf and txt) produce horrible results. can you make a video on using ollama/docker/webui to make RAG better in this workspace? Cheers!
What's wrong with your voice? You have a lazy tongue or something. Unbearable. You should choose a new hobby.
where do you run the ollama, are you using linux? when i try to create my model "ollama create mymodel -f mymodel" its alway Error: accepts 1 arg(s), received 2
I'm running this on a Mac
Nice videc! But... How to use this model in python?
how can i use llama parse in open web ui?
I wish it would give some context in the response. Useful when giving a collection of documents. I would like to know which document and perhaps pages it pulled the answer from.
Question for you. On Open WebUI we have the ability to go back and share (thus save) past conversations we have had with any LLM that we had with ollama. Is this possible to do with this setup as well?
could anyone help me this comes up everytime i try to install a model pulling manifest Error: pull model manifest: ssh: no key found
Now give me nginx reverse proxy config plz
Appreciate your time and the vid! Any details on how to use WebUi to access an LLM running on EC2?
while it is uncensored, I think it still does not fit the "answering ALL questions" thing, but obviously, it's for legal purposes, lol.
what about file excel? can open webUi Olla analyze it?
thanks bro, good video c:
I tried working on this code and got an error stating "The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable" can you please help me with it.?
I got the same error can anyone help with it
How can i use this as copilot in vscode? Like, running LLM on Mac and using coding on Windows with some copilot extension to get that LLM running on Mac.
on vscode there is an extension called continue, that lets you access different llms, if you type the IP / IF of the computer hosting ollama into the extension of vscode there should be a way to get it to work
@@Enki-AI I already use Continue, i'll try it later and let you know my findings. ;)
Thanks a lot for the detailed explanation in the video! I have a question regarding Ollama. Is it possible to use Ollama and the models available on it in a production environment? I would love to hear your thoughts or any experiences you might have with it. Thank you!
Are there any ollama tools you would suggest to get right away?
Sorry I'm on Windows, what is the terminal where I paste the comrade to pull the web ui 3:19
How do you give your model a "backstory"? i.e. Can you tell me about yourself?
You would include you backstory in your SYSTEM parameter in your model file.
I completely disabled the Windows firewall but could still not access Open WebUI. So weird!
What if I can't open the website already using myip:3000
install step not work for my m1 pro mac & sonoma ,Uncaught Exception: Error: EPERM: operation not permitted, mkdir '/Users/wim/.ollama/logs' at Object.mkdirSync
I got Open WebUI running on my windows machine, but i can‘t access it from my Laptop or my phone. I don‘t know why … all devices are in the same network.
You may need to make sure you don't have firewall settings blocking inbound connections. That could be the issue.
@@AIDevBytes Could you give instructions on how to do this? I am running into the same problem.
I would recommend checking out videos on UA-cam on how to change firewall settings on Mac or Windows, since the details can be involved.
Does your pc connect directly to the wifi? When I was connected directly to internet provider modem and my phone was using wifi that was connected to modem it didn't work for me
Yes, you will need to be on the exact same network for this to work.
great video
This is an excellent tutorial, thank you!
I get error like this (running on Mac ollama version is 0.1.48): Error: command must be one of "from", "license", "template", "system", "adapter", "parameter", or "message"
Can you paste your model file content here? There is a problem with your model file syntax so you will get that generic error.
what file type is this being written in, python? It doesn't work for me
This is a plan text file type with no extension. Also, make sure you are in the directory where your file is stored before running the command.
@@AIDevBytes It works great! Thanks for the help bro :D
Glad that helped get it working.
I dont have the Prompts or Documents section installed after instelling Ollama and Docker. How to implement those sections please?
I can fully run ollama, however when I attempt to do this I get the error "Error: invalid model reference: llama3 ". Any idea why? Great video btw.
I would need to see your entire model file to really be able to help. Feel free to paste it here.
Thanks again Dev! would like to see Azure setup if you can manage it
👍 I will check into that.
Commands used in video: github.com/AIDevBytes/Ollama-On-AWS Ollama local setup: 🧑💻 MACS OLLAMA SETUP - How To Run UNCENSORED AI Models on Mac (M1/M2/M3): ua-cam.com/video/03J_Z6FZXT4/v-deo.html 🪟 WINDOWS OLLAMA SETUP - Run FREE Local UNCENSORED AI Models on Windows with Ollama: ua-cam.com/video/E5k_Ilnmehc/v-deo.html
thanks for the video. instead of showing us how to do it, it would be nice to share with us why you would want to do this: what can you achieve by customising the model file?