Ian Wootten
Ian Wootten
  • 83
  • 606 792
ell: A Powerful, Robust Framework for Prompt Engineering
ell is an amazing new framework to help you engineer the perfect prompt without the cruft of boilerplate code. It provides a great way of versioning and a awesome webapp to visualise what's going on.
github.com/MadcowD/ell
00:00 Intro
00:24 Simple Completions
04:24 Capturing Revision History
08:57 Chaining/Visualising Prompts
11:28 Complex Response Types
12:52 Core Tenets
14:00 Conclusion
Support My Work:
Check out my website: www.ianwootten.co.uk
Follow me on twitter: iwootten
Subscribe to my newsletter: newsletter.ianwootten.co.uk
Buy me a cuppa: ko-fi.com/iwootten
Learn how devs make money from Side Projects: niftydigits.gumroad.com/l/side-projects
Переглядів: 20 961

Відео

uv: A Single Python Tool to Replace pip, pipx, pyenv, poetry and more!
Переглядів 2,1 тис.Місяць тому
uv just got a major update that means you can now use it to manage Python versions, projects, run scripts and run tooling. I check it out and show you what's new. 00:00 Introduction 00:29 Setup / Managing Python Versions 01:51 Running Python Scripts 03:36 Managing Python Projects 06:43 Managing Python Tools 08:17 Other Features 09:03 Discussion / Conclusion docs.astral.sh/uv/ astral.sh/blog/uv-...
FastHTML: Modern, Reactive Web Apps in Pure Python
Переглядів 8 тис.Місяць тому
FastHTML is a new web framework allowing you to write applications entirely in Python without needing to touch HTML or JS. Here I take a look and compare it to how we typically do things. 00:00 Intro 00:42 FastTags 01:29 Using HTMX 04:48 Using a DB and Classes 10:32 Thoughts and Tooling 15:40 Outtro fastht.ml h2x.answer.ai/ Support My Work: Check out my website: www.ianwootten.co.uk Follow me o...
Instructor: The Best Way to get Typed Data from Ollama
Переглядів 2,3 тис.3 місяці тому
Instructor makes getting structured data back from large language models simple. Here I explore why instructor is so useful when you want to use an LLM as part of a larger system. 00:00 What's the problem? 02:17 Formatting responses as JSON 04:15 Using Instructor 07:46 Web scraping demo 12:59 Conclusion useinstructor.com docs.pydantic.dev/latest/ Support My Work: Check out my website: www.ianwo...
Using Ollama to Run Local LLMs on the Steam Deck
Переглядів 2,4 тис.4 місяці тому
The Steam Deck is a fully fledged pc, which means it's possible to run Ollama on it too. Here I try to install it, run a few models and compare it to the speeds on the Raspberry Pi 5. 00:00 Intro 00:31 Installation 04:38 Model Runs 10:04 Conclusion ollama.com store.steampowered.com/steamdeck Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten S...
Choosing Your LLM Provider is a Whole Lot Easier with This
Переглядів 1,6 тис.6 місяців тому
If you want to use a hosted language model you have so many options, how do you know which is the best? This is a great site that will help you. artificialanalysis.ai Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten Subscribe to my newsletter: newsletter.ianwootten.co.uk Buy me a cuppa: ko-fi.com/iwootten Learn how devs make money from Side ...
Will Your New Python Package Manager be Written in Rust?
Переглядів 3,3 тис.7 місяців тому
"uv" is a new Python package installer written by astral, but this one is 100x faster and written in Rust. I compare it with pip 00:00 Intro 01:20 Speed Test with pip 05:25 Differences to pip 08:47 Conclusion #python #rustlang git: github.com/astral-sh/uv Blog post: astral.sh/blog/uv Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten Subscribe...
How Fast Will Your New Mac Run LLMs?
Переглядів 7 тис.7 місяців тому
How fast can the new Apple Silicon Mac you so desperately want run LLM's and is it worth the price? llama.cpp benchmarks: github.com/ggerganov/llama.cpp/discussions/4167 Ollama: ollama.ai 00;00 Intro 00:47 Benchmarks 05:06 Unbox 05:47 Results Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten Subscribe to my newsletter: newsletter.ianwootten.c...
Using Ollama to Run Local LLMs on the Raspberry Pi 5
Переглядів 66 тис.8 місяців тому
My favourite local LLM tool Ollama is simple to set up and works on a raspberry pi 5. I check it out and compare it to some benchmarks from more powerful machines. 00:00 Introduction 00:41 Installation 02:12 Model Runs 09:01 Conclusion Ollama: ollama.ai Blog: www.ianwootten.co.uk/2024/01/19/using-ollama-to-run-llms-on-the-raspberry-pi-5/ Support My Work: Check out my website: www.ianwootten.co....
Google Gemini AI: Cutting Through the Hype
Переглядів 1 тис.9 місяців тому
We got a surprise announcement of Google's new Gemini model this week. I breakdown everything that's been announced about and why you should take notice. 00:00 Introduction 00:25 Gemini Examples 03:59 Alphacode 2 05:26 Benchmarks 07:23 Availability 08:03 Conclusion Gemini: deepmind.google/technologies/gemini/ Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: twit...
Draw My UI: Turn Wireframes into Tailwind/JS with One Click
Переглядів 3,6 тис.10 місяців тому
Text to code is so last month! We can now just draw what we want to build, just like proper designers do. #webdevelopment Website: drawmyui.com Github Link: github.com/tldraw/draw-a-ui 00:00 Intro 00:50 Newsletter Signup 03:15 Navbar/Login 06:21 Pricing Plans 09:54 Conclusion Support My Work: Check out my website: www.ianwootten.co.uk Follow me on twitter: iwootten Subscribe to my n...
Easily Create Voiceovers Using OpenAI's New Text to Speech and Vision Models
Переглядів 5 тис.10 місяців тому
OpenAI's latest updates include TTS and GPT4V allowing us to get image descriptions and create audio. In this video I check out some of the most novel ways devs have been using it and show how to generate voiceovers for images or video. #openai 00:00 Intro 01:11 Using TTS to create audio 04:51 Using GPT4V to describe images 08:58 Using TTS & GPT4V for Video voiceovers 14:20 Conclusion Github Li...
Amazon Bedrock: Generative AI on AWS without the Headaches
Переглядів 1,2 тис.11 місяців тому
Amazon Bedrock - AWS's answer to generative AI for a whole collection of foundational models has just been released. I show you how you can use it in both the AWS Console and the command line. 00:00 Intro 00:43 Enabling Models 01:52 Basic Text Completion 05:30 Streaming Text Completions 09:32 Other Use Cases 10:33 Conclusion Link: aws.amazon.com/bedrock/ Support My Work: Check out my website: w...
Ollama on Linux: Easily Install Any LLM on Your Server
Переглядів 29 тис.Рік тому
Ollama has just been released for linux, which means it's now dead simple to run large language models on any linux server you choose. I show you how to install and configure it on digitalocean. 00:00 Installation on DigitalOcean 03:30 Running Llama2 on a Server 05:43 Calling a Model Remotely 12:26 Conclusion #llm #machinelearning Link: ollama.ai/download/linux Support My Work: Get $200 credit ...
Code Llama: First Look at this New Coding Model with Ollama
Переглядів 5 тис.Рік тому
I install and try out Metas Code Llama. I in this video I walkthrough the process of setting it up on my Mac using Ollama. We'll also attempt some Python programming challenges. Is it really any good at Python? #llm #python Using Ollama with LLama 2: ua-cam.com/video/tIRx-Sm3xDQ/v-deo.html 00:00 Intro 00:25 Install with Ollama 02:33 Better than Llama 2? 05:33 Coding Challenges 11:34 Conclusion ...
FaceFusion: Creating Deepfakes is Now Shockingly Simple on a Mac
Переглядів 35 тис.Рік тому
FaceFusion: Creating Deepfakes is Now Shockingly Simple on a Mac
Ollama: The Easiest Way to Run Uncensored Llama 2 on a Mac
Переглядів 34 тис.Рік тому
Ollama: The Easiest Way to Run Uncensored Llama 2 on a Mac
AI Showdown: Can Claude 2 from Anthropic Take On ChatGPT?
Переглядів 2 тис.Рік тому
AI Showdown: Can Claude 2 from Anthropic Take On ChatGPT?
How Developers Can Use ChatGPT's New Code Interpreter
Переглядів 1,9 тис.Рік тому
How Developers Can Use ChatGPT's New Code Interpreter
Aider: This AI Coder Can Create AND Update Git Codebases
Переглядів 7 тис.Рік тому
Aider: This AI Coder Can Create AND Update Git Codebases
GPT Engineer: Can AI Really Code a Complete Codebase?
Переглядів 16 тис.Рік тому
GPT Engineer: Can AI Really Code a Complete Codebase?
How to Replace Bose QC35 Ear Pads
Переглядів 74Рік тому
How to Replace Bose QC35 Ear Pads
OpenAI Function Calling: Structured Data from GPT is Now Much Simpler
Переглядів 1,9 тис.Рік тому
OpenAI Function Calling: Structured Data from GPT is Now Much Simpler
Copilot Chat: First Impressions Reviewing My Code
Переглядів 4,8 тис.Рік тому
Copilot Chat: First Impressions Reviewing My Code
Copilot for CLI - GitHub AI is Now in Your Terminal
Переглядів 1,9 тис.Рік тому
Copilot for CLI - GitHub AI is Now in Your Terminal
A Deep Dive into How Python Virtual Environments Work
Переглядів 343Рік тому
A Deep Dive into How Python Virtual Environments Work
ShellGPT: Never Leave the Terminal Again
Переглядів 6 тис.Рік тому
ShellGPT: Never Leave the Terminal Again
GPT4 is here! What's New and How You Can Use It
Переглядів 251Рік тому
GPT4 is here! What's New and How You Can Use It
How to Code Custom ChatGPT API Interfaces (CLI & Voice)
Переглядів 899Рік тому
How to Code Custom ChatGPT API Interfaces (CLI & Voice)
What's Microsoft's new Bing AI Chat like for Coding?
Переглядів 2,5 тис.Рік тому
What's Microsoft's new Bing AI Chat like for Coding?

КОМЕНТАРІ

  • @MataSessions
    @MataSessions 16 годин тому

    amazing Tool for exchange faces right now in 2024, thanks Ian, i'm a beginner in this technology and of course i'm totally agree with you... this scares but makes me smile too.

  • @DaveWarnock
    @DaveWarnock 21 годину тому

    I'm not sure how to check for outdated packages with uv?

  • @-iIIiiiiiIiiiiIIIiiIi-
    @-iIIiiiiiIiiiiIIIiiIi- День тому

    uv does not have a built-in command to list all virtual environments. Unlike Conda that provide commands like 'conda env list'.

  • @jabuci
    @jabuci 2 дні тому

    I prefer putting the .venv folder in a separate directory (on Linux: ~/.virtualenvs). Can we tell uv to behave like this? I store my projects in Dropbox and I don't want to litter it with huge virt. environments. If it's possible, I would switch from poetry.

  • @c-LAW
    @c-LAW 2 дні тому

    I can't understand language. Speak English like a real American. :)

    • @IanWootten
      @IanWootten 2 дні тому

      I'll have you know I speak the Queen's English.

  • @receps.8396
    @receps.8396 3 дні тому

    Thank you, indeed. It worked.

  • @Lasglamil
    @Lasglamil 3 дні тому

    My cartrige, where the RPI 2W sits gets a little hot, thats fine right? I dont think a heatsink fits there anyway :/

    • @IanWootten
      @IanWootten 3 дні тому

      Think so, I don't use mine for extended periods though.

  • @AndreaCeccanti
    @AndreaCeccanti 4 дні тому

    Great video!

  • @dlprod11
    @dlprod11 5 днів тому

    Ollama on my M1 just refused to run. How do I get around this??

  • @johannes-johannsen
    @johannes-johannsen 5 днів тому

    Thanks for finding and explaining this, its such a different model from langchain (which I like. The side-by-side comparison with openai, langchain, ell was great. Ell is so much simpler for what you showed. Would be interesting to see how to use it in complex agent architectures, like plan-and-execute or CRAG.

    • @IanWootten
      @IanWootten 5 днів тому

      Cheers, yes exploring more complex use cases is something I'm going to be doing in the coming weeks.

  • @TravisSeymour-w1o
    @TravisSeymour-w1o 6 днів тому

    How do you create a new project that I can put on github and have others then install using uv run? I'm trying to switch from pipx to uv for distributing apps.

    • @IanWootten
      @IanWootten 3 дні тому

      You'd need to publish it to a registry (most likely you'd want to use pypi). docs.astral.sh/uv/guides/publish/

  • @bagofmanytricks
    @bagofmanytricks 7 днів тому

    I don't understand how they calculate price per million tokens for the open llm's and I can't find any information about it. Are they considering the current electricity prices / prices for solar panels / windmills / gpu's ?

    • @IanWootten
      @IanWootten 7 днів тому

      It's the average price based on the providers that support it I think. If you click each bar on a chart you can dig into the details.

    • @bagofmanytricks
      @bagofmanytricks 7 днів тому

      Oh, now I get it. I interpreted "Open" as something you used locally. Thanks, I feel stupid now. =)

  • @pafnutiytheartist
    @pafnutiytheartist 7 днів тому

    I appreciate you showing the actual inference speed, other videos usually cut around it, making it unrealistically fast.

  • @yoking1213
    @yoking1213 8 днів тому

    Great! this looks super slick! will use in one of the project I am working on!

  • @PragmaticAIEngineer
    @PragmaticAIEngineer 8 днів тому

    I was literally planning to build something like this. Thank you!

  • @rsrini7
    @rsrini7 8 днів тому

    nice. another tool rye from same developer.. on top of uv also good

  • @ShamusMac
    @ShamusMac 8 днів тому

    We don't need no frameworkation. aider's CONVENTIONS markdown text file has done all this for AI-years, by adding a single sentence: "If a prompt seems to want to write a short story, {insert system prompt or executable script path}." Epic presentation, fantastic video, love your style and explanatory precision, but every time I think a framework can do more than aider I get a cold bucket of water and realize that aider is the pinnacle of human achievement, never to be underdone. Wait until you use aider to edit it's own CONVENTIONS markdown based on user input. Or give your PHP an aider() function which can edit the self-same app's own source code.Then users can make changes to the web app's behaviour that weren't preordained by the developer. Interesting to explore.

  • @bramburn
    @bramburn 8 днів тому

    It's awesome and it's missing a context manager

  • @olafge
    @olafge 9 днів тому

    I was playing with ell the past days. It's a very fresh approach. Very clean code. But I find the multi-turn tool usage quite complicated and I was unable to use the structured output with OpenAI compatible APIs. I hope these two points are being addressed.

  • @ClaudioBottari
    @ClaudioBottari 9 днів тому

    it's nice but you save few lines of code hiding the actual interaction with openai api, which can be a limitation when you are trying to bend your code to particulary funky specs. I wonder how this library would behave when I need functions and structures output

  • @mohammad_mohammad.
    @mohammad_mohammad. 9 днів тому

    These videos are beneficial. I have not yet had the opportunity to review the documentation in detail. Are there any prompt tuning or fine-tuning capabilities within this framework?

  • @ScottzPlaylists
    @ScottzPlaylists 9 днів тому

    👍 I like your videos, will you cover GUI using AI options❓ like ---- PC GUI using AI's, Web using AI's --- Windows GUI and apps as a tool 👍 Also cover projects to duplicate OpenAI 01 (strawberry)

  • @NaourassDerouichi
    @NaourassDerouichi 9 днів тому

    I love this as much as I hate the long lines in my code for a simple prompt.

  • @MarkStringer-m9n
    @MarkStringer-m9n 9 днів тому

    Richard Mountains

  • @i_accept_all_cookies
    @i_accept_all_cookies 9 днів тому

    You're very resourceful Ian! Nice find.

  • @fabriai
    @fabriai 9 днів тому

    Excellent framework review, Ian. Thanks for sharing.

  • @jerikoo
    @jerikoo 9 днів тому

    love it, thanks for sharing!! a new follower to your content! :)

  • @DougMacMillan
    @DougMacMillan 9 днів тому

    Fantastic Ian

  • @jameshickman5401
    @jameshickman5401 9 днів тому

    Ell? As in El? Yeah, we may be building the Demiurge. LOL

    • @IanWootten
      @IanWootten 9 днів тому

      Ell as in the letter 'l' I think. Think some old decorators were previously @ell.lm, which makes me think llm. Developers do love an esoteric project name!

  • @shivaylamba5641
    @shivaylamba5641 9 днів тому

    Can we have Typescript support please!

  • @theaugur1373
    @theaugur1373 9 днів тому

    Excellent demo!

  • @SirajFlorida
    @SirajFlorida 9 днів тому

    I cannot wait to give this a spin. Ell is so Elegant. :D

  • @SirajFlorida
    @SirajFlorida 9 днів тому

    Wow

  • @jelliott3604
    @jelliott3604 9 днів тому

    Her name was Lila She was a coder .....

    • @IanWootten
      @IanWootten 9 днів тому

      with yellow feathers in her hair...

  • @jcdenton1664
    @jcdenton1664 9 днів тому

    Can I store and run standardized queries on pdfs? Say I have 4 or 5 standard questions to ask of a pdf, maybe the even follow on one from the next. Can I store the queries and then load in a pdf for the queries to run on?

    • @Jason-ju7df
      @Jason-ju7df 9 днів тому

      I'm curious what are your standard questions

    • @Jason-ju7df
      @Jason-ju7df 9 днів тому

      I like, summarize and include specific details

    • @jcdenton1664
      @jcdenton1664 9 днів тому

      I would have a standard set of prompts like 1) summarise, 2) give me all the key points, lessons, takeaways, conclusions of the book, 3) what is the core problem / issue that is tackled here, 4) what solution/s are presented by the author/s to the core issues, problems, challenges identified in the book, 5) what does the book claim to be its unique, novel insight or offering, 6) summarise the book in 3 (or 5) key points, with a thesis statement, and provide me dot points as evidence to support each

  • @HerroEverynyan
    @HerroEverynyan 9 днів тому

    Wow this is fabulous. One of those things you wonder "why didn't I do this myself?". I'm sure this is going to be big. Thanks so much for covering this!

    • @TheUserblade
      @TheUserblade 9 днів тому

      And then you see the tooling quality and think “ahhhh, I’m glad I didn’t just roll my own thing for this”

    • @fabriai
      @fabriai 9 днів тому

      @@TheUserbladewise words

  • @davidyoussef8974
    @davidyoussef8974 10 днів тому

    this combined with Langroid would be so wonderful. I guess i need to refactor my code again.

  • @74Gee
    @74Gee 10 днів тому

    With a standardized syntax it would probably be possible to move towards using the web interface to construct flows into code. That would be in incredibly powerful system and spell the end of dev jobs even faster!

    • @ufffd
      @ufffd 8 днів тому

      dev jobs will never end

    • @74Gee
      @74Gee 8 днів тому

      @@ufffd Hmmm, never is a word that doesn't age well in IT. After 35 years as a programmer I see 95% of dev jobs being replaced in 10 years, and the definition or task types of dev being so fundamentally changed that it will probably require a new title.

  • @JimMendenhall
    @JimMendenhall 10 днів тому

    Looks amazing. I just wish it worked with other languages besides just python.

    • @IanWootten
      @IanWootten 10 днів тому

      It is amazing. Not sure how viable other languages are this early on.

  • @yasminkhan2408
    @yasminkhan2408 11 днів тому

    Can I customize the voice to sound like me?

    • @IanWootten
      @IanWootten 11 днів тому

      No, you can only use one of the voices they offer.

  • @therealdrawdownking
    @therealdrawdownking 15 днів тому

    Very cool. Ive had the m1 varieties and 2012, got a i7 quad now with 16gb and 512ssd. seems to run alot faster than the other i5 2012

  • @alexmcd378
    @alexmcd378 16 днів тому

    I wonder if this is compatible with the AI kit you can add to the pi5 for many times faster AI in other tasks

  • @amjadiqbal5353
    @amjadiqbal5353 17 днів тому

    You are real hero

  • @themax2go
    @themax2go 19 днів тому

    --add script is also amazing!

  • @themax2go
    @themax2go 19 днів тому

    --with [module_name] => amazing!

  • @themax2go
    @themax2go 19 днів тому

    i was looking for vids on using pyenv... well hello, uv :)

  • @blakenoh4195
    @blakenoh4195 21 день тому

    Great vid. Would you say there's a need for 96 GB RAM on a m2 or would 64 GB be enough for big models like mixtral

    • @IanWootten
      @IanWootten 21 день тому

      I use mixtral on my 64GB M1 and it's fine for me. It really depends on how fast you want your responses to be. 70B Llama 3 will be a lot faster with more memory.

  • @kmtb2011
    @kmtb2011 21 день тому

    I created at a retro pie image for my raspberry pi 0. Would my image work on a pie zero 2

  • @radadadadee
    @radadadadee 21 день тому

    man, these commenters you have in your site are nasty! hahaha

    • @IanWootten
      @IanWootten 21 день тому

      What do you mean? Everyone here are well natured lovely people.

  • @MyFriendDev
    @MyFriendDev 24 дні тому

    did you try if phi3:mini model runs faster? (as you show it seems run faster than my notebook) but did you check if it is running over gpu or cpu? (here on notebook it is running on cpu)