Practical AI through Prototypes
Practical AI through Prototypes
  • 83
  • 43 518
First look at Google's ImageFX generative AI editing capabilities
Walking through the photoshop-esque new AI editing capabilities of Imagen 3 via Google's Trusted Tester program.
In this video you can manipulate different variations of your text prompt, as well as highlight areas of the photo that you want to modify and provide a description for just that area of modification.
#generativeai , #texttoimage
Переглядів: 398

Відео

Quick Tutorial: How to rotate a texture on a single face in blender
Переглядів 1672 місяці тому
In a previous video, I showed you how to apply a texture to a single face of an object in blender. In this video, I'll quickly show you how to rotate that face using the UV mapping - rotate feature. How to apply a texture to a single face: ua-cam.com/video/Rx-aOHCfTOw/v-deo.html
Automate AI Research with Crew.ai and Mozilla Llamafile
Переглядів 12 тис.3 місяці тому
In this video we'll walk through how to set up crew.ai with Mozilla LLamafile to run a local large language model on your computer and automate multi-step tasks using a model of your choosing. Sample Code: github.com/heaversm/crew-llamafile List of Llamafile Models on hugging face: huggingface.co/models?library=llamafile Serper Search API: serper.dev/ CrewAI documentation - docs.crewai.com/how-...
First Look at Cohere's Coral Toolkit for RAG
Переглядів 4624 місяці тому
Cohere's Coral AI Toolkit is an open source collection of prebuilt components to help developers quickly build RAG applications, in order to ask questions about your docs, or directly against coral LLM models. In this video we'll walk through installing and using the prebuilt components of the Coral Toolkit. About Me: I am a Staff Design Technologist on Mozilla's Innovation Team. All opinions a...
Measuring the carbon footprint of LLM training with the Impact Framework
Переглядів 1294 місяці тому
In this video we'll use the LLM Carbon plugin for Green Software Foundation's Impact Framework to measure CO2 impact of training LLMs like Meta's Llama-7B. I'll then go through each of the inputs required to make the calculations. Lastly, we'll look at some of the other ways of using the Impact Framework. LLM Carbon Plugin - github.com/Jjing-Liang/LLMCarbon /tree/main Llama Training Research - ...
Link Gradio Figma Components to Code with Chromatic Storybook Connect
Переглядів 1694 місяці тому
In this video we show you how to link our Gradio Figma UI components to their Storybook Counterparts with Chromatic's Storybook Connect Plugin. By doing this you can leverage all of the capabilities of Storybook directly within Figma, and easily leverage the UI comparison / regression testing capabilities of Chromatic within your build process. Links: Gradio UI for Figma Components: www.figma.c...
Carbon Hack 24 Final Project Submission
Переглядів 1164 місяці тому
A summary of all the things we built for the Green Software Foundation's Carbon Hack 24, focused on the Impact Framework. Project Submission Github Issue: github.com/green-Software-Foundation/hack/issues/97 Getting Started Github Code Repo - github.com/heaversm/carbonhack-if Getting Started Medium Article - medium.com/@iretehamdani/how-to-use-the-impact-framework-to-measure-the-environmental-im...
Carbon Hack 24 Final Project Submission
Переглядів 124 місяці тому
A summary of all the things we built for the Green Software Foundation's Carbon Hack 24, focused on the Impact Framework.
Approaches and Considerations to Measuring Website Energy Usage
Переглядів 424 місяці тому
In this video, we'll look at two methods of measuring website carbon emissions - by either attributing a portion of overall energy usage to the webpage, or by calculating the energy used by each of a webpage's component parts - from the data, to the networking, to the device, and the embodied carbon of all of the equipment used to run it. We'll discuss tradeoffs and considerations of both appro...
How to use the Impact Framework to calculate your website's carbon emissions
Переглядів 645 місяців тому
This tutorial walks through using the Webpage Measurement Plugins and related manifest file from Alex Zurbonsen, contributed as part of the Green Software Foundation's Carbon Hack 24, to calculate any web page's operational carbon, green hosting, and lighthouse scores by looking at the overall data transferred through website usage, and passing that data through the CO2.js plugin to turn that d...
GSF Impact Framework Plugin Registry Prototype
Переглядів 305 місяців тому
A walkthrough of a plugin registry submission prototype for the Green Software Foundation's Impact Framework, as part of a submission for Carbon Hack 24. Why is this tool needed? Currently plugins are located in various repositories, and it can be difficult to know what they do, where they fit in to the overall pipeline, what inputs they require, what they output, and what data sources they rel...
GSF Impact Framework Pipeline Builder Prototype
Переглядів 405 місяців тому
A walkthrough of a manifest file builder prototype for the Green Software Foundation's Impact Framework, as part of a submission for Carbon Hack 24. Why is this tool needed? Currently, it can be hard to know where to find the right plugins for your pipeline, what they do, and how to configure them for your specific software workload. What does this tool do? This is a prototype of a visual inter...
Getting Started with the Green Software Impact Framework
Переглядів 1645 місяців тому
With our rapidly increasing usage and reliance on software comes an urgent need to understand their environmental impacts. The Impact Framework from the Green Software Foundation is a universal interface for the process of measuring software systems environmental impacts through an approach that is auditable, replicable, and transparent. This video covers installing and configuring the impact f...
Build with Google's New AI Text to Image API: Imagen
Переглядів 7325 місяців тому
Fresh out of Beta is Google's Imagen, the newest entrant into the text to image generation field alongside contenders like Dall-E, Stable Diffusion, and Midjourney. There is a public API, but as of right now, it's not well-documented. This video will show you how to use the Imagen API to build out a custom experience for users. We'll deploy a custom Hugging Face space with a simple to use Gradi...
Every developer should learn this! Website Accessibility testing using a screen reader
Переглядів 3116 місяців тому
Using a screen reader to test a website is not just helpful to non-sighted users, it can really help you improve the structure and SEO of your website, and identify general usability and code issues. In this video I'm running through the basics of the VoiceOver assistant and showing suggestions for various general improvements. About Me: I am a Staff Design Technologist on Mozilla's Innovation ...
Can these free text summarizers stack up against chatGPT?
Переглядів 796 місяців тому
Can these free text summarizers stack up against chatGPT?
Infinite AI Zoom Animation using just Photoshop
Переглядів 5267 місяців тому
Infinite AI Zoom Animation using just Photoshop
2 AI Chatbots Debate the Future of AI
Переглядів 2027 місяців тому
2 AI Chatbots Debate the Future of AI
Practical AI: Agriculture
Переглядів 1697 місяців тому
Practical AI: Agriculture
How to prepare and annotate data for use in ML model fine tuning with Label Studio
Переглядів 9247 місяців тому
How to prepare and annotate data for use in ML model fine tuning with Label Studio
Chat with AI in Discord with an open source local LLM
Переглядів 3,3 тис.8 місяців тому
Chat with AI in Discord with an open source local LLM
Ditch ChatGPT and try one of these downloadable options
Переглядів 1,3 тис.8 місяців тому
Ditch ChatGPT and try one of these downloadable options
Autonomous AI agents and scraping for data gathering
Переглядів 2,7 тис.8 місяців тому
Autonomous AI agents and scraping for data gathering
Talk on Building Education into the Prototyping Process at Mozilla Innovation
Переглядів 578 місяців тому
Talk on Building Education into the Prototyping Process at Mozilla Innovation
Run your own large language model with Mozilla's Llamafile
Переглядів 9 тис.9 місяців тому
Run your own large language model with Mozilla's Llamafile
Using an AI agent to do your google searching
Переглядів 1439 місяців тому
Using an AI agent to do your google searching
Using Bardeen AI for automated data scraping
Переглядів 5559 місяців тому
Using Bardeen AI for automated data scraping
First Look at Adept AI automation
Переглядів 1,8 тис.9 місяців тому
First Look at Adept AI automation
Better AI Responses with RAG Fusion
Переглядів 2,5 тис.9 місяців тому
Better AI Responses with RAG Fusion
AI Job Queues
Переглядів 1349 місяців тому
AI Job Queues

КОМЕНТАРІ

  • @basvandijk3004
    @basvandijk3004 6 днів тому

    Hi, many thanks for this video, it was only usefull one I could find on this topic. Did you do the comparison with the other api options out there? I couldn't find it and would love to see it! Futhermore, I'm trying to implement the imagen api in my flutter app. Could your setup be used to have my app call an api hosted on huging face instead of directly accessing a web page? Would love to hear your thoughts.

  • @mattportnoyTLV
    @mattportnoyTLV 20 днів тому

    Probably should've mentioned this is in beta. Don't you think?

  • @themax2go
    @themax2go 29 днів тому

    you talk about running locally but using openai... sad

    • @MikeHeavers
      @MikeHeavers 20 днів тому

      Yeah this is a fair point. I should do another version where I use an open model

  • @RealLexable
    @RealLexable Місяць тому

    Do you know something about the data protection rules of serper for using their Google API?

    • @MikeHeavers
      @MikeHeavers 20 днів тому

      I think generally it’s not so much what tool you use as what you’re scraping and what the intended use is. Most sites have their own stipulations or licenses on what you can and can’t do with their site / content

  • @procrastinatingrn3936
    @procrastinatingrn3936 Місяць тому

    So a free perplexity?

  • @chrisder1814
    @chrisder1814 Місяць тому

    hello I would like to ask you a question about AI image editing software APIs

  • @raminderpalsingh123
    @raminderpalsingh123 Місяць тому

    Great video. I am still getting charged for gpt-4o usage when my llamafile seems to be working fine? Is that expected? Also, how can I switch the code to point to gpt-4o-mini, to even further minimize my openAI API costs? THANKS A BUNCH!

  • @0xg484
    @0xg484 Місяць тому

    This is great, thanks for this

  • @dougsilkstone
    @dougsilkstone 2 місяці тому

    Having a blast with your content Mike. We're doing real similar things on yt 🫡 thanks for the awesome vids

    • @MikeHeavers
      @MikeHeavers 2 місяці тому

      Wow - ton of content, I'll check this out. Thanks for the comment.

    • @dougsilkstone
      @dougsilkstone 2 місяці тому

      @@MikeHeavers ah just finding my feet. Its good fun!

  • @alexanderheppening
    @alexanderheppening 2 місяці тому

    Great video, really helpful. THX

  • @86dansu
    @86dansu 2 місяці тому

    But you used an Open AI key and Serper key so this might not be running entirely local right ?

    • @MikeHeavers
      @MikeHeavers 2 місяці тому

      The RAG bit - grabbing content from the internet, will require being online, correct. Inference is local, provided you are using Llamafile.

  • @itsnotclever
    @itsnotclever 2 місяці тому

    Does anybody know how to translate that git to a container in Unraid?

  • @Nick__X
    @Nick__X 2 місяці тому

    awesome content dude!

  • @NickFan7
    @NickFan7 3 місяці тому

    If I want to fine-tune Ollama, can the Discord bot customize ".gguf"?

    • @practical-ai-prototypes
      @practical-ai-prototypes 3 місяці тому

      Well, you don't fine tune Ollama - you fine tune whatever model you're running (the .gguf file you mention). Ollama just serves the model. You can fine tune gguf models - llama.cpp has a script (example here: github.com/ggerganov/llama.cpp/tree/master/examples/finetune) for this. But you fine tune on data, so I guess what your bot would be doing is inserting data into a text file or something, and you would programmatically run the script you program to fine tune on that data. But you can't continuously fine tune, really - it takes a long time (supposing you have a lot of data) - which is why companies only release LLMs every so often - it takes them weeks or months for large parameter models. More appropriately, what you'd probably want to do is RAG, where you use a pre-trained model and point it at your own data - I have other videos on how to do RAG with various methods, including this one, on the Coral AI Toolkit: ua-cam.com/video/Nn16y7iHp48/v-deo.html

  • @gymlin123
    @gymlin123 3 місяці тому

    but dont I still have to pay for tokens?

  • @dbreardon
    @dbreardon 3 місяці тому

    Now everyone needs a new computer and a Cuda graphics card which are massively expensive due to crypto mining and now AI servers. Local runs way too slow on my 3-4 year old laptop. Will have to see if new Intel and AMD chips with embedded NPU's provide any support for multiple LLMs run on local machines.

    • @practical-ai-prototypes
      @practical-ai-prototypes 3 місяці тому

      Fair point - performance on local is not as good as running on cloud infrastructure. Seems like "AI-enabled" PCs will be the new trend.

  • @ryanbthiesant2307
    @ryanbthiesant2307 3 місяці тому

    Not good. Does not show the problems of crew ai working with Ollama or any other lllm. Crewai persistently asks for open ai key. The good I discovered Mozilla lllm server thank you. Crew ai is really bad.

    • @mandelafoggie9359
      @mandelafoggie9359 3 місяці тому

      So what is better than Crewai?

    • @practical-ai-prototypes
      @practical-ai-prototypes 3 місяці тому

      You don't have to use openAI or the API key - you can just remove it from the code. The Ollama file sample from the github repo shows you how to use Ollama. Note that Ollama is not an LLM - it just allows you to run LLMs locally.

    • @practical-ai-prototypes
      @practical-ai-prototypes 3 місяці тому

      @@mandelafoggie9359 You can try autogpt if you want - I found it harder to use.

    • @ryanbthiesant2307
      @ryanbthiesant2307 2 місяці тому

      ​@@practical-ai-prototypes Thank you I will check that out, again. I think it still asks for a key, even a fake key. Even if you want to use ollama.

  • @SixTimesNine
    @SixTimesNine 3 місяці тому

    Very good vid - thanks!

  • @iliadobrevqqwqq
    @iliadobrevqqwqq 3 місяці тому

    Tks

  • @mattc3265
    @mattc3265 3 місяці тому

    Love being able to run this locally. Great vid 👏👏👏

  • @practical-ai-prototypes
    @practical-ai-prototypes 3 місяці тому

    Update - I made an `app-input.py` script that allows you to create your own agent and task just by answering some questions in the command line.

    • @JofnD
      @JofnD 3 місяці тому

      Seems very useful! Is there an update video for this?

    • @practical-ai-prototypes
      @practical-ai-prototypes 3 місяці тому

      @@JofnD no - but same instructions, just run `python app-input.py` from the command line.

  • @vladimirmiletin4486
    @vladimirmiletin4486 3 місяці тому

    Nice, thanks

  • @BoboStudiosFN
    @BoboStudiosFN 3 місяці тому

    i get the error: [Shard #0] [INFO] Shard ready [Shard #0] [DEBUG] Making request to localhost:11434/api/show [Shard #0] [ERROR] Error 404 Not Found: POST /api/show [Shard #0] [ERROR] Error 404 Not Found: POST /api/show

  • @helsan74
    @helsan74 3 місяці тому

    Great tutorial! Is there a way to have NPM running has a service instead of commande line?

    • @practical-ai-prototypes
      @practical-ai-prototypes 3 місяці тому

      This is already possible with the plugin - the instructions are here: github.com/mekb-turtle/discord-ai-bot - follow the (non-docker) instructions, and start the service with 'npm start'

  • @juliamendoza2732
    @juliamendoza2732 4 місяці тому

    Error [TokenMissing]: Request to use token, but token was unavailable to the client. when i tried to run it that appears me, and i already check the token and is correct

  • @Sniksax
    @Sniksax 5 місяців тому

    i've spent 2 days searching for their image editing function in python, 0 documentation had to check every page of their github to find it in python, in node there is no documentation about image editing at all, HELP !

  • @NoRizz9999
    @NoRizz9999 5 місяців тому

    Hello, thank you so much for this easy an simple step by step tutorial! I just did everything and in the end i get confronted with an error: "Error [ShardingReadyDied]: Shard 0's process exited before its Client became ready." Checked around on froums etc. but did not semm to find the solution. Do you maybe know how i can fix this? I think i did exactly the same as you in the Video. Thank you so much!

    • @AnotherMumbler
      @AnotherMumbler 5 місяців тому

      Also having the same issue here.

    • @ChristopherPBacon1
      @ChristopherPBacon1 4 місяці тому

      Did you run "npm install" ? Thats what I had to do.

    • @Tntlover
      @Tntlover 4 місяці тому

      did you ever fix this?

    • @NoRizz9999
      @NoRizz9999 4 місяці тому

      @@Tntlover Hello all, yes I started with doing the whole bot setup on the discord dev site again form scratch and got me a new Token - (refreshed it) then it worked. Im only 99% sure it was the cause of it tho, since that was the first and only time i used ".js"

  • @lingavaraprasad1796
    @lingavaraprasad1796 5 місяців тому

    Awesome

  • @sabrinabottazzi1971
    @sabrinabottazzi1971 5 місяців тому

    Thanks for the explanation! Is there a way to run your own model weights that are not in gguf format? I have a model on HF separated in 2 .bin files

    • @practical-ai-prototypes
      @practical-ai-prototypes 5 місяців тому

      I think you'll need to convert it to GGUF - here's a few resources for that: github.com/ggerganov/llama.cpp/discussions/2948 www.substratus.ai/blog/converting-hf-model-gguf-model/ sarinsuriyakoon.medium.com/convert-pytorch-model-to-quantize-gguf-to-run-on-ollama-5c5dbc458208

  • @siddharthchandrakar5617
    @siddharthchandrakar5617 5 місяців тому

    hey we can't do the editing on the image by passing the image? basically user pass the image and prompt to edit the image and image will be edited. i read the docs to they write about we can do that but not how, pls help.

  • @RonnyTimmermansxenit
    @RonnyTimmermansxenit 6 місяців тому

    Explain what you try to achieve, not what you do. Cut the details.. Make the video shorter. Less code, this is even indigestible for chatgpt.

  • @RonnyTimmermansxenit
    @RonnyTimmermansxenit 6 місяців тому

    Boring . Sorry

    • @MikeHeavers
      @MikeHeavers 6 місяців тому

      All good. What would make it better?

  • @trumanerichson6297
    @trumanerichson6297 6 місяців тому

    ❗ 'promosm'

  • @matten_zero
    @matten_zero 6 місяців тому

    Nice demo app. Wild times ahead

    • @MikeHeavers
      @MikeHeavers 6 місяців тому

      Wild times right now!

  • @fapbiao
    @fapbiao 6 місяців тому

  • @ahmetlutfu
    @ahmetlutfu 6 місяців тому

    thank you.

  • @angeloalonzo5500
    @angeloalonzo5500 7 місяців тому

    Never thought that you can have like this locally, just wondering what are the other drawback of this aside from the size of this file

  • @MattJonesYT
    @MattJonesYT 7 місяців тому

    My prediction is that centralized LLMs will become obsoleted because they are logically crippled by political correctness. The only ways to prevent public facing LLMs from taking objective data and coming to politically incorrect conclusions is to make the LLM too stupid to do logic, or make it too lazy to do it at all. This is why decentralized open source uncensored LLMs will eventually overtake all of the commercial and centralized closed source LLMs since the decentralized LLMs have no restrictions on parroting the party line on command and claiming things like that there are five lights when there are only four.

  • @rangerEV_app
    @rangerEV_app 7 місяців тому

    Nice summary! Thanks for taking us thru Kierdorf et al's paper👍

  • @MattJonesYT
    @MattJonesYT 7 місяців тому

    Yes, the idea of precision agriculture is a niche that came up in my AI research and something I definitely intend to do blogs on, so this is on the right track!

  • @CaleyHamiltonProjects
    @CaleyHamiltonProjects 8 місяців тому

    Great job! Looking forward to the agents video you mentioned in the video

  • @pon1
    @pon1 8 місяців тому

    I use LM Studio, it can also do llama and pretty much any large language model out there. Before that I used Oobabooga but LM Studio is easier because you can search for llm's in the interface. I will follow this project though as it may get developed to a point where it is more useful than LM Studio, but for me the key is the interface, if it has a user friendly interface, one-click installer, etc., I'm really tired of having to use the commandline too much, like in the old days of AI (and to an extend even to this day).

  • @s11-informationatyourservi44
    @s11-informationatyourservi44 8 місяців тому

    perfect timing! so needed this tutorial!

  • @iainhmunro
    @iainhmunro 8 місяців тому

    Excellent - thanks for doing the video. Would like to see how we could interact with our own documents on the discord server

    • @practical-ai-prototypes
      @practical-ai-prototypes 8 місяців тому

      Yes - I think I might do a tutorial on that next!

    • @iainhmunro
      @iainhmunro 8 місяців тому

      @@practical-ai-prototypes Perfect - many thanks

  • @sambarwick4012
    @sambarwick4012 8 місяців тому

    🤩 *PromoSM*

  • @Revadike
    @Revadike 8 місяців тому

    Nice showcase, now do a proper review for each please

    • @practical-ai-prototypes
      @practical-ai-prototypes 8 місяців тому

      I'll probably do some more in depth videos. About to release one on using Ollama as a chatbot in discord.

  • @givetaa
    @givetaa 8 місяців тому

    Is there a way to make it Uncensored? Or do those methods make it uncensored itself.

    • @practical-ai-prototypes
      @practical-ai-prototypes 8 місяців тому

      It's not the services themself that are uncensored - it's the models. So, for example, you can find an uncensored version of llama2. Ollama has an article on it - ollama.ai/blog/run-llama2-uncensored-locally

    • @givetaa
      @givetaa 8 місяців тому

      yes thank you for replying, I read it and figured it out finally. Appreciate it man, keep up the content. @@practical-ai-prototypes

  • @mllegendas1319
    @mllegendas1319 8 місяців тому

    Nice!

  • @enzotheold
    @enzotheold 9 місяців тому

    Well done!!

  • @LjaDj5XQKey9mSDxh4
    @LjaDj5XQKey9mSDxh4 9 місяців тому

    This is massive