Ian Wootten
Ian Wootten
  • 86
  • 680 845
Ollama Structured Outputs: LLM Data with Zero Parsing
Structured Output has been a feature available in hosted models like OpenAI, but now Ollama has offical support for it. This means you no longer have to worry about using another library.
Code: github.com/iwootten/ollama-structured-outputs
Post on the Ollama site: ollama.com/blog/structured-outputs
00:00 Intro
01:08 Using Structured Output
04:32 Conclusion
Support My Work:
Check out my website: www.ianwootten.co.uk
Follow me on twitter: iwootten
Follow me on bluesky: iwootten.bsky.social
Subscribe to my newsletter: newsletter.ianwootten.co.uk
Buy me a cuppa: ko-fi.com/iwootten
Learn how devs make money from Side Projects: niftydigits.gumroad.com/l/side-projects
Переглядів: 2 562

Відео

PostgREST: Dead Simple APIs in Pure Postgres
Переглядів 3,1 тис.21 день тому
I've been using PostgREST for the last couple of weeks and absolutely love it. You define you API in a Postgres DB and PostgREST will serve it for you. In this vid I cover the basics and why you should be paying attention to it. 00:00 Intro 01:16 Defining a Read Only API 03:31 Running PostgREST 05:11 Querying Data 06:24 Adding Write Access 11:55 Using the Python Client 12:51 Conclusion postgres...
How to Prompt Your LLM Directly from SQL
Переглядів 5972 місяці тому
I demonstrate how you can add a simple prompt() function to your database, so you're able to call an LLM directly from sql. 00:00 Intro 02:32 Adding a simple LLM call 05:56 Returning Structured Data 10:44 Why? 11:33 Conclusion Repo: github.com/iwootten/sqlite2llm Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten Follow me on bluesky: iwootten...
ell: A Powerful, Robust Framework for Prompt Engineering
Переглядів 32 тис.3 місяці тому
ell is an amazing new framework to help you engineer the perfect prompt without the cruft of boilerplate code. It provides a great way of versioning and a awesome webapp to visualise what's going on. github.com/MadcowD/ell 00:00 Intro 00:24 Simple Completions 04:24 Capturing Revision History 08:57 Chaining/Visualising Prompts 11:28 Complex Response Types 12:52 Core Tenets 14:00 Conclusion Suppo...
uv: A Single Python Tool to Replace pip, pipx, pyenv, poetry and more!
Переглядів 12 тис.3 місяці тому
uv just got a major update that means you can now use it to manage Python versions, projects, run scripts and run tooling. I check it out and show you what's new. 00:00 Introduction 00:29 Setup / Managing Python Versions 01:51 Running Python Scripts 03:36 Managing Python Projects 06:43 Managing Python Tools 08:17 Other Features 09:03 Discussion / Conclusion docs.astral.sh/uv/ astral.sh/blog/uv-...
FastHTML: Modern, Reactive Web Apps in Pure Python
Переглядів 10 тис.4 місяці тому
FastHTML is a new web framework allowing you to write applications entirely in Python without needing to touch HTML or JS. Here I take a look and compare it to how we typically do things. 00:00 Intro 00:42 FastTags 01:29 Using HTMX 04:48 Using a DB and Classes 10:32 Thoughts and Tooling 15:40 Outtro fastht.ml h2x.answer.ai/ Support My Work: Check out my website: www.ianwootten.co.uk Follow me o...
Instructor: The Best Way to get Typed Data from Ollama
Переглядів 2,9 тис.6 місяців тому
Instructor makes getting structured data back from large language models simple. Here I explore why instructor is so useful when you want to use an LLM as part of a larger system. 00:00 What's the problem? 02:17 Formatting responses as JSON 04:15 Using Instructor 07:46 Web scraping demo 12:59 Conclusion useinstructor.com docs.pydantic.dev/latest/ Support My Work: Check out my website: www.ianwo...
Using Ollama to Run Local LLMs on the Steam Deck
Переглядів 3 тис.7 місяців тому
The Steam Deck is a fully fledged pc, which means it's possible to run Ollama on it too. Here I try to install it, run a few models and compare it to the speeds on the Raspberry Pi 5. 00:00 Intro 00:31 Installation 04:38 Model Runs 10:04 Conclusion ollama.com store.steampowered.com/steamdeck Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten S...
Choosing Your LLM Provider is a Whole Lot Easier with This
Переглядів 1,8 тис.9 місяців тому
If you want to use a hosted language model you have so many options, how do you know which is the best? This is a great site that will help you. artificialanalysis.ai Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten Subscribe to my newsletter: newsletter.ianwootten.co.uk Buy me a cuppa: ko-fi.com/iwootten Learn how devs make money from Side ...
Will Your New Python Package Manager be Written in Rust?
Переглядів 3,6 тис.10 місяців тому
"uv" is a new Python package installer written by astral, but this one is 100x faster and written in Rust. I compare it with pip 00:00 Intro 01:20 Speed Test with pip 05:25 Differences to pip 08:47 Conclusion #python #rustlang git: github.com/astral-sh/uv Blog post: astral.sh/blog/uv Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten Subscribe...
How Fast Will Your New Mac Run LLMs?
Переглядів 10 тис.10 місяців тому
How fast can the new Apple Silicon Mac you so desperately want run LLM's and is it worth the price? llama.cpp benchmarks: github.com/ggerganov/llama.cpp/discussions/4167 Ollama: ollama.ai 00;00 Intro 00:47 Benchmarks 05:06 Unbox 05:47 Results 2023 64GB M3 Max at Amazon: amzn.to/4ekjSqB Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten Subscri...
Using Ollama to Run Local LLMs on the Raspberry Pi 5
Переглядів 81 тис.11 місяців тому
My favourite local LLM tool Ollama is simple to set up and works on a raspberry pi 5. I check it out and compare it to some benchmarks from more powerful machines. 00:00 Introduction 00:41 Installation 02:12 Model Runs 09:01 Conclusion Ollama: ollama.ai Blog: www.ianwootten.co.uk/2024/01/19/using-ollama-to-run-llms-on-the-raspberry-pi-5/ Support My Work: Check out my website: www.ianwootten.co....
Google Gemini AI: Cutting Through the Hype
Переглядів 1,1 тис.Рік тому
We got a surprise announcement of Google's new Gemini model this week. I breakdown everything that's been announced about and why you should take notice. 00:00 Introduction 00:25 Gemini Examples 03:59 Alphacode 2 05:26 Benchmarks 07:23 Availability 08:03 Conclusion Gemini: deepmind.google/technologies/gemini/ Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: twit...
Draw My UI: Turn Wireframes into Tailwind/JS with One Click
Переглядів 3,7 тис.Рік тому
Text to code is so last month! We can now just draw what we want to build, just like proper designers do. #webdevelopment Website: drawmyui.com Github Link: github.com/tldraw/draw-a-ui 00:00 Intro 00:50 Newsletter Signup 03:15 Navbar/Login 06:21 Pricing Plans 09:54 Conclusion Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten Subscribe to my n...
Easily Create Voiceovers Using OpenAI's New Text to Speech and Vision Models
Переглядів 5 тис.Рік тому
OpenAI's latest updates include TTS and GPT4V allowing us to get image descriptions and create audio. In this video I check out some of the most novel ways devs have been using it and show how to generate voiceovers for images or video. #openai 00:00 Intro 01:11 Using TTS to create audio 04:51 Using GPT4V to describe images 08:58 Using TTS & GPT4V for Video voiceovers 14:20 Conclusion Github Li...
Amazon Bedrock: Generative AI on AWS without the Headaches
Переглядів 1,2 тис.Рік тому
Amazon Bedrock: Generative AI on AWS without the Headaches
Ollama on Linux: Easily Install Any LLM on Your Server
Переглядів 32 тис.Рік тому
Ollama on Linux: Easily Install Any LLM on Your Server
Code Llama: First Look at this New Coding Model with Ollama
Переглядів 5 тис.Рік тому
Code Llama: First Look at this New Coding Model with Ollama
FaceFusion: Creating Deepfakes is Now Shockingly Simple on a Mac
Переглядів 39 тис.Рік тому
FaceFusion: Creating Deepfakes is Now Shockingly Simple on a Mac
Ollama: The Easiest Way to Run Uncensored Llama 2 on a Mac
Переглядів 36 тис.Рік тому
Ollama: The Easiest Way to Run Uncensored Llama 2 on a Mac
AI Showdown: Can Claude 2 from Anthropic Take On ChatGPT?
Переглядів 2,1 тис.Рік тому
AI Showdown: Can Claude 2 from Anthropic Take On ChatGPT?
How Developers Can Use ChatGPT's New Code Interpreter
Переглядів 2 тис.Рік тому
How Developers Can Use ChatGPT's New Code Interpreter
Aider: This AI Coder Can Create AND Update Git Codebases
Переглядів 7 тис.Рік тому
Aider: This AI Coder Can Create AND Update Git Codebases
GPT Engineer: Can AI Really Code a Complete Codebase?
Переглядів 16 тис.Рік тому
GPT Engineer: Can AI Really Code a Complete Codebase?
How to Replace Bose QC35 Ear Pads
Переглядів 83Рік тому
How to Replace Bose QC35 Ear Pads
OpenAI Function Calling: Structured Data from GPT is Now Much Simpler
Переглядів 1,9 тис.Рік тому
OpenAI Function Calling: Structured Data from GPT is Now Much Simpler
Copilot Chat: First Impressions Reviewing My Code
Переглядів 4,8 тис.Рік тому
Copilot Chat: First Impressions Reviewing My Code
Copilot for CLI - GitHub AI is Now in Your Terminal
Переглядів 1,9 тис.Рік тому
Copilot for CLI - GitHub AI is Now in Your Terminal
A Deep Dive into How Python Virtual Environments Work
Переглядів 372Рік тому
A Deep Dive into How Python Virtual Environments Work
ShellGPT: Never Leave the Terminal Again
Переглядів 7 тис.Рік тому
ShellGPT: Never Leave the Terminal Again

КОМЕНТАРІ

  • @coolmcdude
    @coolmcdude 2 дні тому

    Awesome video. I’m from America and I visited Wales and England earlier this year for the first time. Wales was so beautiful.

  • @SMCGPRA
    @SMCGPRA 3 дні тому

    What is the pc or laptop min config needed to run ollama llama 3 model and mixtral model, pls let us know

  • @njpm
    @njpm 4 дні тому

    Your mouth is way to wet

  • @PeterJung-cx1ib
    @PeterJung-cx1ib 8 днів тому

    Amerikanische Verhältnisse light. Ekelhaft!

  • @regulardev
    @regulardev 8 днів тому

    Initially PostgREST appears awesome. But then we see that the documentation is lacking and also missing a real world example repository. 1. I was not able to find a *recent* example repository with lots of migrations, views, functions. In GitHub discussions, the suggestion from owner for migrations was to package as PG EXTENSION. But again no example repository. 2. An example of how devops will look like is missing. 3. If the developer also needs to access DB, now [s]he needs ORM code which has to kept in sync with table schema created from migrations (sqitch sql scripts for row level security with policies). Or is it like the developer should always use the postgrest http client and never touch DB directly.

  • @Good-and-Geeky
    @Good-and-Geeky 10 днів тому

    Aider is pretty interesting I was trying it out using Anthropic. Did the job for me and I want to play more with it.

  • @jana171
    @jana171 16 днів тому

    Instructor patched SDK worked good as well, but this just cleans up the code and is simple. Based on my own implementation with instructor, it obeys the Pydantic basemodel structures close to a 100% of the completions, compared to the few-shot propmting setup i had before that, that had about 10% success and LOADS of failures 🙂 This way just works !

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 17 днів тому

    But given that OpenAI, Claude can do this already, why do we need ollama for it? And here, isn’t Llama doing the heavy lifting? Not clear how ollama is helping.

    • @IanWootten
      @IanWootten 17 днів тому

      Using a model that's local, open and free are three good reasons.

  • @sMadaras
    @sMadaras 18 днів тому

    I’d appreciate if you could share the codes.

    • @IanWootten
      @IanWootten 17 днів тому

      Sure thing, I've added a link with them to the description

    • @sMadaras
      @sMadaras 17 днів тому

      @@IanWootten Diolch yn fawr

  • @StudyWithMe-mh6pi
    @StudyWithMe-mh6pi 18 днів тому

    👋👋👋

  • @ofrylivney367
    @ofrylivney367 18 днів тому

    Ive been needing this feature, thanks for the info!

  • @IdPreferNot1
    @IdPreferNot1 18 днів тому

    Great adavancment for open source efforts

  • @mopoune-oo4yv
    @mopoune-oo4yv 20 днів тому

    Interesting, is it exposing swagger ui like ?

    • @IanWootten
      @IanWootten 19 днів тому

      Nope, no UI - just the OpenAPI spec if read access is enabled.

  • @musicbobo603
    @musicbobo603 20 днів тому

    Awesome, one more tool to master. Wasn't enough with pip, pipx, pipbla blatry etc. Super. The great thing about standards is there are so many to choose from!

    • @IanWootten
      @IanWootten 19 днів тому

      Or alternatively, now you only have to master one tool.

  • @JonBrookes
    @JonBrookes 23 дні тому

    Thanks Ian, I'd looked at and liked the look of postgrest. Your video sells it to me !

  • @KojoMeg
    @KojoMeg 25 днів тому

    can it be used for kyc verifications ?

  • @saptakdas9024
    @saptakdas9024 Місяць тому

    getting erro "'uv' is not recognized as an internal or external command, operable program or batch file. " but I have already installed uv. I am using windows

    • @IanWootten
      @IanWootten Місяць тому

      I guessing its not on the path.

    • @joschomo1010
      @joschomo1010 10 днів тому

      Don't use windows first of all ...

  • @zuowang5185
    @zuowang5185 Місяць тому

    Is it preferred to move all packages from requirements.txt to pyproject.toml?

  • @HifiCentret
    @HifiCentret Місяць тому

    Can Ollama benefit from an NPU hat? The Hailo 26 TOPS for instance.

  • @barulli87
    @barulli87 Місяць тому

    what if you are already using pyenv, how to replace with uv?

  • @Minepuffik
    @Minepuffik Місяць тому

    and they made fun of npm and yarn...

  • @flrn84791
    @flrn84791 Місяць тому

    This is LLMs running on CPU... yikes

  • @LeRoy9000
    @LeRoy9000 Місяць тому

    dullest man on UA-cam... zzzzzz

  • @ray-charc3131
    @ray-charc3131 Місяць тому

    Ollama2 no longer runs on my raspberry pi5 8G, there is error message that models requiring system memory (8.4G) than is availabel(7.4G), can it be resolved or anything I got wrong?

  • @emmanueloduka9304
    @emmanueloduka9304 Місяць тому

    can i use this on a 2015 Mac

  • @xiaoluwang5019
    @xiaoluwang5019 Місяць тому

    how can I use my own client? as many company has their own client originate from openai. I try to use it, but it tell me absent of provider

  • @justthecoolestmusicjohne6105
    @justthecoolestmusicjohne6105 Місяць тому

    Is this version of face fusion software unfiltered and unleashed or does it have nsfw protection filters? John E

  • @MaxS-v7x
    @MaxS-v7x Місяць тому

    Streamlit is better.

  • @mohamedsaidi5375
    @mohamedsaidi5375 Місяць тому

    hello , I 'm descovering fastHTML and the HTMX scope , and I'm wandering about the capabilities of this framework especially if i want to make a heavenly front app ( because of some webmapping that needs some frameworks and maybe javascript intervention ) ? if i have a template can i convert it to component of fasthtml very easily ?

  • @jayhargis2352
    @jayhargis2352 2 місяці тому

    your keystrokes sound like drum taps.

  • @Flash136
    @Flash136 2 місяці тому

    Thank you for making this video. I've always wondered how these LLMs perform on low-end devices. Obviously, not great, but this looks promising!

  • @benjamintowle-j1y
    @benjamintowle-j1y 2 місяці тому

    kinda seems like a redundent question since its based on arch. but you could dual boot any os.

    • @IanWootten
      @IanWootten 2 місяці тому

      I don't think it is if you're unaware of either of these things.

  • @IanWootten
    @IanWootten 2 місяці тому

    It's actually unneccessary to use apsw - you can just use sqlite3 in Pythons standard lib. Adding the function takes an extra argument, but I've added a couple of examples to the repo.

  • @aeggeska1
    @aeggeska1 2 місяці тому

    How do you do a rootless docker multistage build using uv? Preferably zero CVE with something like chain guard wolfi. Can't get it to work.

  • @RonnieStellings-b7z
    @RonnieStellings-b7z 2 місяці тому

    Schaden Ways

  • @juanjocastillo736
    @juanjocastillo736 2 місяці тому

    Something like rye, isn't it? For python I prefer things written in python.

  • @dasantiga4515
    @dasantiga4515 2 місяці тому

    Hello, don’t work more, can U update please? ❤

  • @gabrielmalek7575
    @gabrielmalek7575 2 місяці тому

    how do we stream?

  • @irrelevantdata
    @irrelevantdata 2 місяці тому

    Why not use DSPy?

  • @ConicuAutomotive
    @ConicuAutomotive 2 місяці тому

    Interesting, I’ve been building out relational neural networks that use structured data for enhanced query efficiency. Keen to see how it challenges LMMs

  • @alexsherbin2172
    @alexsherbin2172 2 місяці тому

    thanks for introducing a new tool for my work! Subscribed <3

  •  2 місяці тому

    Ths seems like an amazing tool for building the prompts and debugging but I can't see this being used in any large project in production. You need to have full control over the API calls and often optimize on that level.

    • @IanWootten
      @IanWootten 2 місяці тому

      From the github repo, I think that's it's intended use case - which it works really well at.

  • @theguywhoasked0.0
    @theguywhoasked0.0 2 місяці тому

    wow that's even faster than my pc idk how

  • @hexxt_
    @hexxt_ 2 місяці тому

    soy devs are gonna love this

  • @IdPreferNot1
    @IdPreferNot1 2 місяці тому

    How is this not known out there??? Great find.

  • @MartinBlaha
    @MartinBlaha 2 місяці тому

    Decided to give it a try in my current project instead of LangChain. So far, I'm impressed. Let's see when it comes to RAG.

  • @RogerValor
    @RogerValor 2 місяці тому

    I would have understood a simplification by returning a tuple, where it can be just two strings, with the first one being system and the second user, by default, overridable by decorating it with ell.system etc. for complex situations, but using the docstring, idk if I find that clean, otherwise very interesting toolset

  • @technicalboy1816
    @technicalboy1816 2 місяці тому

    prompt engineer joke. Engineer, sure! More like prompt monkey.

  • @zousean680
    @zousean680 2 місяці тому

    wonderful intro of ell, thanks. I am trying it with claude: @ell.simple(model="claude-3-5-sonnet-20240620"), does it automatically know that the provider is switched from openai to anthropic?

  • @kevinmcaleer28
    @kevinmcaleer28 2 місяці тому

    Great video Ian. I've only just discovered FastHTML and was looking for more information about it, and there you were!