TheDataDaddi
TheDataDaddi
  • 64
  • 309 753
Ollama 3.1 & Open-WebUI with Docker For Multiple Models Locally
In this video, I’ll walk you through setting up Ollama 3.1 and Open-WebUI using Docker, and show you how to integrate multiple AI models for efficient deployment. Whether you're a developer, data scientist, or AI enthusiast, or simply want to save money by hosting LLMs at home this guide will help you easily manage and run various models within Docker containers.
📚 VIDEO RESOURCES:
Docker Desktop Installation Instructions
www.docker.com/get-started/
Docker Engine (No GUI) Installation Instructions
docs.docker.com/engine/install/ubuntu/
Ollama Docker Image General Instructions
hub.docker.com/r/ollama/ollama
Open WebUI Docker Setup Instructions
docs.openwebui.com/
Llama3.1 Model List
ollama.com/library/llama3.1
Setup Commands Used In Video
drive.google.com/file/d/1W2dWlY8SwXlm-d95L3doGKqMEfFngr4k/view?usp=sharing
👋 HOW TO GET IN TOUCH WITH ME
For the most up-to-date contact details, please visit my UA-cam bio. Open to any and all inquiries, collaborations, questions, or feel free just to say hello! Thanks for your interest!
🙏 HOW TO SUPPORT MY CHANNEL
If you found this content useful, please consider buying me a coffee at the link below. This goes a long way in helping me through grad school and allows me to continue making the best content possible.
Buy Me a Coffee
www.buymeacoffee.com/TheDataDaddi
As a cryptocurrency enthusiast, I warmly welcome donations in crypto. If you're inclined to support my work this way, please feel free to use the following addresses:
Bitcoin (BTC) Address: bc1q3hh904l4uttmge6p58kjhrw4v9clnc6ec0jns7
Ethereum (ETH) Address: 0x733471ED0A46a317A10bf5ea71b399151A4bd6BE
Should you prefer to donate in a cryptocurrency other than Bitcoin or Ethereum, please don't hesitate to reach out, and I'll provide you with the appropriate wallet address.
Thanks for your support!
Переглядів: 202

Відео

Wireshark 101: A Beginner's Guide to Network Traffic Analysis
Переглядів 14721 годину тому
In this Wireshark tutorial, we’ll walk you through everything you need to get started with this powerful network analysis tool. We’ll cover key concepts and practical demonstrations to help you capture, filter, and analyze network traffic like a pro. This video includes: - How to Download and Install Wireshark - Introduction to Packet Capturing - Navigating the Basic User Interface (UI) - Indiv...
GPU Performance Benchmarking for Deep Learning - P40 vs P100 vs RTX 3090
Переглядів 12 тис.3 місяці тому
In this video, I benchmark the performance of three of my favorite GPUs for deep learning (DL): the P40, P100, and RTX 3090. Using my custom benchmarking suite, BenchDaddi, I assess the performance of these GPUs across three major DL architectures: CNN, RNN, and Transformers. Whether you're a data scientist, a machine learning engineer, or just an AI enthusiast, this comparison will provide val...
An Open Source GPU Benchmarking Project: BenchDaddi
Переглядів 1 тис.4 місяці тому
In this video, I'm excited to introduce BenchDaddi, an innovative open-source GPU benchmarking suite that I've developed. BenchDaddi empowers users to analyze GPU performance across various AI tasks with precision and ease. Throughout this tutorial, I'll walk you through the suite's repository structure, setup, and installation process, showcasing how to leverage its benchmarking scripts tailor...
10G Networking Demystified: Tips, Cost, and Real-World Use Cases
Переглядів 5686 місяців тому
Are you considering upgrading your network to 10G but unsure where to start? Look no further! In this comprehensive guide, I'll demystify the world of 10G networking, providing you with practical tips, cost considerations, and real-world use cases to help you make an informed decision. Specific Topics Covered: - 10G Networking Basics - SFP vs SFP vs QSFP - SFP Module Types and Considerations - ...
Setting Up External Server GPUs for AI/ML/DL - RTX 3090
Переглядів 8 тис.6 місяців тому
🚀 Join me on a deep dive into setting up external GPUs for high-performance AI computations! In this comprehensive guide, I'll walk you through connecting powerhouse GPUs like the NVIDIA RTX 3090 with NVLink to servers such as the Super Micro 4028GR-TRT and Dell Power Edge R720. We'll cover everything from hardware requirements to configuration steps. ⚙️ What you'll learn: - The advantages of u...
8 GPU Server Setup for AI/ML/DL: Supermicro SuperServer 4028GR-TRT
Переглядів 11 тис.6 місяців тому
In Part 2 of our series, we're diving into the nuts and bolts of setting up the Supermicro SuperServer SYS-4028GR-TRT for optimal AI/ML/DL performance. Discover the step-by-step process to configure this powerhouse server, from installing the GPUs to optimizing software and hardware settings. Learn how to harness the full potential of up to 8 dual-slot GPUs for unparalleled computational power ...
Your New 8 GPU AI Daily Driver Rig: Supermicro SuperServer 4028GR-TRT
Переглядів 3,9 тис.6 місяців тому
Welcome to Part 1 of our exciting series, where we embark on a deep dive into the transformative world of artificial intelligence, machine learning, and deep learning with the Supermicro SuperServer SYS-4028GR-TRT. In this episode, we're set to explore the myriad benefits of making this powerhouse server your go-to daily driver for all your AI/ML/DL endeavors. Uncover the incredible capabilitie...
Navigating the AWS Applied Science Internship Interview: My Experience
Переглядів 1947 місяців тому
Description: In this video, I share my journey through the AWS Applied Science interview process, providing insights and tips for aspiring candidates. From the initial application to the final decision, I'll take you step-by-step through each stage, highlighting the challenges and learning experiences along the way. Whether you're an aspiring applied scientist or just curious about the tech int...
Boomers, Millennials, Gen Z: Who Faced Toughest Home Buying Hurdles? - A Data-Driven Exploration
Переглядів 8949 місяців тому
Welcome to my deep dive into the evolving landscape of home buying! In this video, I take a unique, data-driven approach to explore one of today's most pressing questions: Is it harder to buy a home now compared to previous years (1967-2022)? Join me as I dissect trends in rising home prices and stagnant wage growth, topics that have been widely discussed on social media and beyond. My journey ...
Throttle No More: My Strategy for GPU Cooling in Dell PowerEdge
Переглядів 2,1 тис.9 місяців тому
Join me on a deep dive into managing and optimizing GPU cooling in the Dell PowerEdge server series. In this video, I share my personal experiences and strategies for preventing thermal throttling to maintain peak server performance. I'll show you how I interact with the server fans by SSHing directly into the server's iDRAC, and how to access the fans using the local command line with Dell's i...
Setting Up a Full Bitcoin Core Node with Docker and Ubuntu 22.04
Переглядів 3,7 тис.9 місяців тому
🚀 Join us as we dive into the world of cryptocurrency and blockchain technology! In this comprehensive tutorial, we're setting up a full Bitcoin Core node inside a Docker container on Ubuntu 22.04. Whether you're a crypto enthusiast, a developer, or just curious about how Bitcoin nodes work, this step-by-step guide is tailored for you! 🔍 What You'll Learn: Introduction to Bitcoin Core: Understa...
AI/ML/DL with the Dell PowerEdge R720 Server - Energy, Heat, and Noise Considerations
Переглядів 3 тис.9 місяців тому
Dive deep into the world of high-performance computing with our thorough examination of the Dell PowerEdge R720 Server, a powerhouse for AI, ML, and DL applications. This video is not just a guide; it's an insightful exploration into the server's operational dynamics, focusing on power consumption, heat production, and acoustic management. What You'll Uncover in This Video: Power Consumption In...
Best AI/ML/DL Rig For 2024 - Most Compute For Your Money!
Переглядів 22 тис.9 місяців тому
🚀 Dive into the future of AI/ML/DL computing with our in-depth analysis of the best rigs for 2024! In this video, we take a close look at the powerhouse Dell PowerEdge R720 server, equipped with top-tier components, and see how it stacks up against custom-built setups and cloud computing solutions. 🔍 Components Breakdown: Dell PowerEdge R720 Server: A robust foundation for demanding AI tasks. ...
iDRAC7 Setup and Access Guide on Dell PowerEdge R720 Server
Переглядів 1,5 тис.10 місяців тому
Embark on a journey to harness the full potential of your Dell PowerEdge 12th Generation server with our comprehensive iDRAC7 setup and access guide! In this tutorial, we guide you through the intricate steps of configuring and accessing iDRAC7, the Remote Access Controller that empowers seamless server management. Whether you're a seasoned IT professional or a tech enthusiast, this video break...
Mastering iDRAC7: Unlocking Virtual Console & Enterprise Features on Dell PowerEdge R720
Переглядів 94210 місяців тому
Mastering iDRAC7: Unlocking Virtual Console & Enterprise Features on Dell PowerEdge R720
DIY Home Network Monitoring System - Raspberry Pi 4, Smart Switch, and Wireshark
Переглядів 6 тис.10 місяців тому
DIY Home Network Monitoring System - Raspberry Pi 4, Smart Switch, and Wireshark
Dell PowerEdge R720 GPU Deep Learning Upgrade: Installing Dual Tesla P40s with NVIDIA Drivers
Переглядів 9 тис.10 місяців тому
Dell PowerEdge R720 GPU Deep Learning Upgrade: Installing Dual Tesla P40s with NVIDIA Drivers
Dell PowerEdge R720XD GPU Upgrade: Installing Tesla P40 with NVIDIA Drivers
Переглядів 9 тис.11 місяців тому
Dell PowerEdge R720XD GPU Upgrade: Installing Tesla P40 with NVIDIA Drivers
Server Data Recovery: How to Save Your System & Extract Data from a Non-Bootable Server
Переглядів 16011 місяців тому
Server Data Recovery: How to Save Your System & Extract Data from a Non-Bootable Server
Installing DUAL Tesla P100 GPU on Dell PowerEdge R720 Server with Driver Installation
Переглядів 9 тис.11 місяців тому
Installing DUAL Tesla P100 GPU on Dell PowerEdge R720 Server with Driver Installation
Installing Tesla P100 GPU on Dell PowerEdge R720 Server with Driver Installation
Переглядів 8 тис.11 місяців тому
Installing Tesla P100 GPU on Dell PowerEdge R720 Server with Driver Installation
AI/ML/DL GPU Buying Guide 2024: Get the Most AI Power for Your Budget
Переглядів 80 тис.11 місяців тому
AI/ML/DL GPU Buying Guide 2024: Get the Most AI Power for Your Budget
Detectron2 Setup with Docker: Simplify Computer Vision - Fix Bugs & Dependencies (2023)
Переглядів 1,5 тис.11 місяців тому
Detectron2 Setup with Docker: Simplify Computer Vision - Fix Bugs & Dependencies (2023)
Neo4j - WebSocket Connection Failure - How to Fix!!!
Переглядів 2,8 тис.Рік тому
Neo4j - WebSocket Connection Failure - How to Fix!!!
Neo4j - Introduction to Querying with Real World AirBnB Data
Переглядів 167Рік тому
Neo4j - Introduction to Querying with Real World AirBnB Data
2FA Setup For Linux Home Lab or Server - Cisco Duo
Переглядів 1,8 тис.Рік тому
2FA Setup For Linux Home Lab or Server - Cisco Duo
Why 3.5" Caddy (Tray) Lights Blink Amber After 2.5" SSD Replacement
Переглядів 133Рік тому
Why 3.5" Caddy (Tray) Lights Blink Amber After 2.5" SSD Replacement
How to Configure a Virtual Drive ?!
Переглядів 215Рік тому
How to Configure a Virtual Drive ?!
Upgrade Your Server's Old 3.5" HDD To 2.5" SSD
Переглядів 2,5 тис.Рік тому
Upgrade Your Server's Old 3.5" HDD To 2.5" SSD