Portable AI Voice Assistant using ESP32 & Gemini AI 🔥🔥 |

Поділитися
Вставка

КОМЕНТАРІ • 160

  • @kaloprojects
    @kaloprojects 3 місяці тому +12

    Hi @techiesms, awesome .. thank YOU so much for using/featuring my KALO Recording & Deepgram transcription libraries and your kind ‘Shoutout’, it is my pleasure that i could help you a little bit and your community!. I love your cool projects, and you know: Nobody can explain all tech stuff better than you, your videos and explanations are best !.

    • @kaloprojects
      @kaloprojects 3 місяці тому +1

      Btw: cool hardware details, nice too see e.g. your headphone audio connector, the powering circuits, your auto-reset idea and replay button is a great idea too. So go forward with your great projects .. and i am always happy to support further. Thank you Techiesms for all your great daily work !

    • @techiesms
      @techiesms  3 місяці тому +1

      Thank you so much....

    • @hemanthkumarmp1886
      @hemanthkumarmp1886 3 місяці тому +1

      Sir can you send me the complete circuit diagram not schematic​@@techiesms

    • @DarylChris
      @DarylChris 2 місяці тому

      Hello @kaloprojects please is there a way to contact you, through email or something, I am stuck on a project and desperately need your help

  • @HLX01Creater
    @HLX01Creater 3 місяці тому +7

    I am trying to make all this using ESP8266, and I have actually worked on it for the last 30 days, not continuously but with a little change according to your thinking. Like, I have put this system in my wristwatch like a hidden spy. I have already made the script for ESP8266, it is working but only the part of STT and TTS is left. This is very challenging for me, like custom script or something more. But now I am copy-pasting and thank you very much for this video.

    • @lavanyabhamidipati992
      @lavanyabhamidipati992 3 місяці тому

      hi what speaker and mic did you use for this project

    • @HLX01Creater
      @HLX01Creater 3 місяці тому

      @@lavanyabhamidipati992 use the ESP32-C3 Super Mini. For the microphone, I use the xcluma INMP441 Omnidirectional High Precision MEMS Microphone Module with I2S Support.

  • @francegall-web9819
    @francegall-web9819 3 місяці тому +8

    In the next one you build, add an AI-THINKER VC-02 so that it is automatically activated by voice without pressing the switch.

  • @johnny14794
    @johnny14794 3 місяці тому +13

    Wow! Super interesting project! How about porting that sketch to a device available in the market like a M5 Cardputer, a Lilly-Go T-Deck, a Lilly-Go T- Embed, etc? Those devices include everything needed to just get it up and running as long as the proper libraries are placed into the Arduino Library, then burn the sketch on them. Since many of us don't have the skills to assemble stuff on a PCB board, get the parts needed and can't even solder a button? Other pre-made devices that have ESP32 S3 chips, SD card slot, speaker, buttons, battery connector, lights, screens, microphone, etc, the ones I mentioned would save many of the pains on building our own from scratch. I do see your point of creating home made projects though. I wish I had the skill you have and the talents of creating these IoT's. I love gadgets, but lack the programming aspects of these ESP32's. It's why it's a blessing to have you available in YT. Thanks for sharing this video brother! Stay safe and blessings!

    • @techiesms
      @techiesms  3 місяці тому +4

      Based on your suggestion I’ll try to do with other boards that I have

    • @johnny14794
      @johnny14794 3 місяці тому +1

      @@techiesms Looking forward to seeing your next video related to the sketch on other boards/devices. Take care and blessings. 🙏✨

  • @dishsadanu8979
    @dishsadanu8979 Місяць тому +1

    Thank you for what I learned from you in Sri Lanka

  • @dipanshudhote5671
    @dipanshudhote5671 3 місяці тому +5

    Hi everyone, i tried this project and found the way to avoid use of SD card by directly using SPIFFS memory which can be able to store 220 seconds of audio at 8k and 8 bit which is more than enough, for this AI assistant purpose we genrally need about 5-10 seconds, so i think it is the most reliable way to use it, also it will boost some speed for reading and writing files...

    • @inventors_india_technologies
      @inventors_india_technologies 3 місяці тому

      Please tell me

    • @Charliedave4332
      @Charliedave4332 3 місяці тому

      Holly Molly! How did you come about this? I have been looking for ways around this problem for some time now

    • @sandhyakota5350
      @sandhyakota5350 10 днів тому

      Gd evening sir , can I contact you for some guidance on the above project because u have already tried , please sir reply because we r going through this project

    • @dipanshudhote5671
      @dipanshudhote5671 10 днів тому

      @@sandhyakota5350 sure

    • @dipanshudhote5671
      @dipanshudhote5671 10 днів тому

      @@sandhyakota5350 sure

  • @marshallmann7620
    @marshallmann7620 3 місяці тому

    WOW AMAZING DETAIL!! THANK YOU!! YOU ARE AWESOME!!!!!!!

  • @amitdas3484
    @amitdas3484 11 днів тому +1

    that is a great project. But can we do away with the button pressing part ?
    Can the listening trigger be voice activated with a specific word or phrase ?

  • @braveonder
    @braveonder 3 місяці тому

    Great work. Thank you for your great support.

  • @sriharin8641
    @sriharin8641 Місяць тому +2

    can you make a simple circuit just like gpt in esp? please!

  • @jaydebkarmakar624
    @jaydebkarmakar624 3 місяці тому +1

    I would like suggest you to make a Google assistant device using raspberry pi zero. There are no detailed tutorial videos on this topic.

  • @DreamScapeRobloxStudio
    @DreamScapeRobloxStudio 3 місяці тому +1

    Just wanted to know how did you guys solder the small components with the pcb ?

  • @anlpereira
    @anlpereira 3 місяці тому

    Very interesting project. From this you can make a project that can send commands to control your house. I love it.

  • @yashrajshah7766
    @yashrajshah7766 3 місяці тому

    You can bulid a live language translator with this, which will be super useful.

  • @KiteTurbine
    @KiteTurbine 3 місяці тому +1

    Brilliantly clear tutorial. The soldering seems to happen by magic

  • @jeremygeorgia4943
    @jeremygeorgia4943 Місяць тому

    As has been mentioned, it would be nice for the project to be operated with a wake word, so that you didn't need to push a button. It might also be nice, for it to recognize certain words and phrases & activate some subroutines, to control devices attached to it. If there aren't enough I/O ports, maybe it could send messages to nearby ESP32 devices & activate equipment that way. What I'd like to use it for, is for creating a voice interactive robot, that you could control with your voice. Perhaps, it could follow you, or take pictures with its camera, after being to told to do so, with a voice command. Maybe, it could communicate with a Raspberry Pi or other computer, to figure out answers, without the Internet.

  • @mukulsunda
    @mukulsunda 3 місяці тому +1

    Can we add a ov2640 module and send a frame to gemini api when a particular word like “what am i seeing” and get response?

  • @RealSnail3D
    @RealSnail3D 3 місяці тому

    Awesome video!

  • @k2r.253
    @k2r.253 3 місяці тому

    Thank you sir ❤

  • @shashivadhangunti3411
    @shashivadhangunti3411 3 місяці тому +1

    yha hai i am a B-Tech final year student i thought of making a smart device with Raspberry pi 4 where the os look like Ai, And if we ask any thing it will show in display and respond like alexa indirectly an alexa with a display any idea for it

  • @iOT_India
    @iOT_India 2 місяці тому +1

    please integrate more AI MODELS like LLAMA, etc.

  • @sinmim1
    @sinmim1 3 місяці тому

    Nice project 🎉

  • @sakethpuppala1016
    @sakethpuppala1016 День тому

    AP+STA mode would be better where AP mode should take wifi credentials and API inputs

  • @usmanumer9871
    @usmanumer9871 3 місяці тому +1

    Maza a gaya is project say . Alampana Tusi great ho tofa Kabul Karo .🎉🎉

    • @techiesms
      @techiesms  3 місяці тому +1

      Bs kr pagle, Rulayega kya....

  • @SallyCrest
    @SallyCrest Місяць тому

    Amazing project! Do you think that maybe you'll be offering the gerber files for this project in the future so some of us can order custom PCBs from PCBGOGO in the future?

  • @electriquefarmaci
    @electriquefarmaci 3 місяці тому

    Maintenance mode is on
    Site will be available soon. Thank you for your patience!

  • @ShayanV-w2c
    @ShayanV-w2c 3 місяці тому

    bro you are really intelligent

  • @baotrangia3417
    @baotrangia3417 3 місяці тому

    Fantastic Assistance Portable (FAP) !!!

  • @Shorts01-f3h
    @Shorts01-f3h 3 місяці тому +1

    Kaise kharede ya wala circuit board

  • @Talha80777
    @Talha80777 23 дні тому

    Hello. First of all, thank you very much for sharing each and every detail of the project. I have one query regarding the schematic, what is the purpose of Q1 MOSFET?

  • @60pluscrazy
    @60pluscrazy 3 місяці тому +1

    Good one, but instead of onboard coding, we should use a free cloud hosted endpoint. It will be better allowing us our own custom knowledge and more 🎉🎉🎉

    • @techiesms
      @techiesms  3 місяці тому +1

      I didn't get your point. Can you elaborate

    • @artisticyeti22
      @artisticyeti22 3 місяці тому

      The esp code cannot be off loaded 😂. The software that can be off loaded has already been off loaded and mentioned as so in the video

  • @fusseldieb
    @fusseldieb 3 місяці тому

    I literally had the same idea one week ago. Even built a prototype hahaha
    Best of all: With the same components, even.

    • @sarathkumar785
      @sarathkumar785 3 місяці тому

      teach me bro

    • @techiesms
      @techiesms  3 місяці тому

      LOL
      No issues, Now you can easily make it with the help of this video

    • @SarathkumarP-mu3ob
      @SarathkumarP-mu3ob 3 місяці тому

      @@techiesms bro did u have any connection diagram

  • @tsshadowff
    @tsshadowff 3 місяці тому

    Please make a video of making it with easy ways! ❤

  • @apexdc07
    @apexdc07 3 місяці тому

    @techiesms I have an esp32 lyraT 4.3 board on which I have installed alexa using esp32-adf sdk, just curious if I can use this code on same with all required components already present on the board.

  • @its_yuno.
    @its_yuno. 3 місяці тому +2

    use sim for internet connection please . Then we can use it without wifi and mobile

  • @sudharsana5439
    @sudharsana5439 3 місяці тому

    How is this different from Google assistant?

  • @TheRajeev7778
    @TheRajeev7778 3 місяці тому +1

    Hello,Any plans to provide this as building kit?

    • @techiesms
      @techiesms  3 місяці тому +1

      Building Kit Means?

    • @TheRajeev7778
      @TheRajeev7778 3 місяці тому

      @@techiesms components and pcb

  • @bens4446
    @bens4446 3 місяці тому +1

    Wow, bravo. I did something similar (in python) on a 2gb RAM le Potato (minus the convenient button features, BMS, etc.). Didn't think this would be possible on a microcontroller with 520kb RAM. It does seem a bit slow at times in your demonstration, at least compared to my 2gb version. Could this be sped up with streaming? Or do you already include streaming in your .ino code? Very nice project!

    • @kaloprojects
      @kaloprojects 3 місяці тому +2

      I am also working on the idea to extend my recording library with Streaming (streaming I2S bytes realtime from microphone to Deepgram 'during' recording).. but this is crazy complex at least for me (with ESP32 & C, maybe easier in Python, which i won't use on ESP due several reasons), not sure i will ever get int work :D . We will see.

    • @devbiceps1628
      @devbiceps1628 3 місяці тому +1

      ​@@kaloprojects would love to check that out

  • @mabrurareefinroll4625
    @mabrurareefinroll4625 2 місяці тому

    brother, your schematic doesnt show all the components you used. like resistors, battery monitoring circuit. can you please please tell me every component you used and how many

  • @ha13151
    @ha13151 3 місяці тому

    Perfect!

  • @basicelectronics6324
    @basicelectronics6324 Місяць тому

    Please make a video on streaming the song from Spotify using esp32 and audio decoder module, it's very useful for us.

  • @takayasushuto4176
    @takayasushuto4176 3 місяці тому

    最高です!
    Tシャツ欲しい。

  • @ajuxx
    @ajuxx 3 місяці тому +1

    Hlo bro can you share the circuit diagram for making it on a zero pcb board without the smd components
    I seen the Schematic diagram i dont understand that make it simple plz

    • @ajuxx
      @ajuxx 3 місяці тому

      @techiesms reply me

  • @gjreditor9835
    @gjreditor9835 3 місяці тому +3

    You can use Deepgram itself for text to speech too. You won't have the hassle of chunking the response text. Just like 750 hours of voice to text free, Deepgram text to voices is free up to 250 hours.

    • @kaloprojects
      @kaloprojects 3 місяці тому +1

      you are right, Deepgram offers TTS .. but as I know they do NOT offer any languages beyond English (as today). The Open AI TTS voices are multilingual, each of the 6 voices can speak multiple languages (even changing language in one sentence). And i could not find any ESP32 library supporting their 'steaming concept' for TTS. If you know a library or function call, let us know please!

  • @NOOBKRISH
    @NOOBKRISH 3 місяці тому

    Can we add multiple wifi said and pass so it will connect to any avilable

  • @2butgaming991
    @2butgaming991 Місяць тому +1

    I want to buy this completely assembled hardware but on ur website its showing it will be back on 30th November can u help me out to get it sooner 🙏

    • @techiesms
      @techiesms  Місяць тому +1

      Sir it’s not in stock
      We ordered it and waiting for the delivery of components

    • @cerlpearl
      @cerlpearl Місяць тому

      @@techiesms how many days after 30th will we get the product ( living in Mumbai )

    • @techiesms
      @techiesms  Місяць тому

      @cerlpearl kindly share the pincode on our WhatsApp
      8200079034

  • @darshandarshu1906
    @darshandarshu1906 3 місяці тому

    Which software used for 3d vision

    • @techiesms
      @techiesms  3 місяці тому

      It was 3-D view in easy EDA

  • @gopash
    @gopash 3 місяці тому

    It can be turned into the business of bilingual interpretation .
    But can it be operate offline?

  • @Rgkroger
    @Rgkroger 19 днів тому

    lindo seu projeto amigo
    seria possivel acopla esse seu projeto a rede de comunicação na rede can do veiculo para comandar algumas funções

  • @MikaKaito
    @MikaKaito 24 дні тому

    Hello sir, Can I get this product along with display extension to check text, if you make so, I will buy this product sir, please add this on?

  • @UniqueIdeas151
    @UniqueIdeas151 2 місяці тому

    Bro can i use esp32 with micro USB port with out using USB to ttl converter system

  • @kavinesar4559
    @kavinesar4559 3 місяці тому

    bro is this capable of real time data like time date and weather

  • @pravinabaldha7240
    @pravinabaldha7240 3 місяці тому +1

    I have interesting idea and I am currently working on that I want to make tutorial of that like how to mke fully independent ai pocket device compact in size and has voice assistants and object recognization and has display on it and showing captions on that portable and use with sim card maybe thats great idea for your channel can you please make that ❤

  • @shardulambikecs1192
    @shardulambikecs1192 3 місяці тому

    Can this Gemini AI control things over esp32 like house automation , or servos , or leds in any project ?

    • @techiesms
      @techiesms  3 місяці тому +2

      Not exactly
      But to do that you can use the speech to text response and compare it to control the appliances

  • @anbur1790
    @anbur1790 3 місяці тому

    Bro your chatgpt voice assestant v2 speech to text library file is error occur (compile time)give me any solution

  • @ArtBuddyIndian
    @ArtBuddyIndian 3 місяці тому

    what will be the application of this project

  • @harshsaini5979
    @harshsaini5979 2 місяці тому

    Kitne paise lg jayenge ise bnane me including all parts and pcb and assembling them

    • @techiesms
      @techiesms  2 місяці тому

      We are selling it already through our website

  • @rummankarin6332
    @rummankarin6332 2 місяці тому

    bro can you please make a voice module price frendly in veroboard with deepgram and esp32 which is full pack of (alaxa or chtgpt)

  • @_s2700
    @_s2700 3 місяці тому

    Can we run this locally......?

    • @techiesms
      @techiesms  3 місяці тому

      no. its over internet

  • @shock2k3
    @shock2k3 3 місяці тому

    make an 3d printed case for better convinence

  • @vimal_jayavel3007
    @vimal_jayavel3007 3 місяці тому

    Where did get pcb bro ?

    • @techiesms
      @techiesms  3 місяці тому +1

      We are not selling PCB, rather we are selling the complete project

    • @vimal_jayavel3007
      @vimal_jayavel3007 3 місяці тому

      @@techiesms assemble project or compounds of project?

  • @ShubhamSen-dn1ub
    @ShubhamSen-dn1ub 3 місяці тому

    Add NXP local voice recognition ic to this

  • @hippopothomas1980
    @hippopothomas1980 3 місяці тому

    Thanks!!!

  • @elisalant
    @elisalant 3 місяці тому

    Do you ship to Australia

    • @techiesms
      @techiesms  3 місяці тому

      Yes.
      Kindly WhatsApp us on +91 82000 79034

  • @chandrakalashinde8960
    @chandrakalashinde8960 3 місяці тому

    We can make device to anytime listening

  • @Sri_Harsha_Electronics_Guthik
    @Sri_Harsha_Electronics_Guthik 3 місяці тому

    try edgetts?

  • @MikeNugget
    @MikeNugget 3 місяці тому

    Awesome

  • @JohnKourdomenos
    @JohnKourdomenos 3 місяці тому

    Can the code be entered into a Panel touch screen ESP32-4848S040 so that we can see the answer on the screen ?

  • @clips4399
    @clips4399 3 місяці тому

    what if we add a display to it, please make it

  • @sakaidosan
    @sakaidosan 2 місяці тому

    ERROR in Record_Start() - I2S not initialized, call 'I2S_Record_Init()' missed, I'm getting this error when pressing record button, please help

  • @harshsaini5979
    @harshsaini5979 2 місяці тому

    Can I buy the complete built hardware part without buying pcb from pcbgogo

    • @techiesms
      @techiesms  2 місяці тому

      You can buy complete hardware assembled on PCB from our website

  • @m.shayanshamim1202
    @m.shayanshamim1202 3 місяці тому

    Plz Send the circuit diagram in easy manner for without PCB makers

  • @armisis
    @armisis 3 місяці тому

    It's rabbit r1 with the latest patches.

  • @jesus__voice_for_all8865
    @jesus__voice_for_all8865 2 місяці тому

    Sir can I know the actual cost of the product

  • @ridwanmulyana99
    @ridwanmulyana99 3 місяці тому

    can you make faster reply from the device ?

  • @hmalamgir3489
    @hmalamgir3489 3 місяці тому

    Price

  • @ManoranjanMithas
    @ManoranjanMithas 3 місяці тому

    Sir di chij bata do google tts free kaise mile Or sir second chij sir ye esp8266 se kar sakte h

  • @VettivelSivakumari
    @VettivelSivakumari 3 місяці тому

    Does the hardware cimw in srilanka

    • @techiesms
      @techiesms  3 місяці тому +1

      Yes
      Kindly WhatsApp on +918200079034

  • @unkwon.h
    @unkwon.h 2 місяці тому

    I would like to integrate it with a sim card so that it doesn't require to connect to any hotspot

  • @harshsaini5979
    @harshsaini5979 3 місяці тому

    Hi @techiesms can you name all the parts or components used in this project and also all things simply and easy to understand because i am just a beginner and don't know about it anything but I want to make this

    • @techiesms
      @techiesms  3 місяці тому

      You can refer this schematic to check out all the parts

  • @rockfireist
    @rockfireist 3 місяці тому

    Helo bro where is schematic diagram,, can u provide link plz...

    • @techiesms
      @techiesms  3 місяці тому

      Its in the GitHub repo.
      the link is in the description

    • @rockfireist
      @rockfireist 3 місяці тому

      @@techiesms thanks bro....

  • @unkwon.h
    @unkwon.h 2 місяці тому

    Can i get the files for pcb pls?

  • @inhlapngo1601
    @inhlapngo1601 3 місяці тому

    Could you please share your PCB gerber file?

  • @hassansiddiqui5282
    @hassansiddiqui5282 3 місяці тому

    can u provide the gerber file for the pcb?

    • @techiesms
      @techiesms  3 місяці тому

      No sorry
      But you can find the schematic in the video

  • @NOOBKRISH
    @NOOBKRISH 3 місяці тому

    can u pease make a 3d case fr this

  • @eyeofsanatan
    @eyeofsanatan 3 місяці тому

    sir i am buying one iot project from your website but i have only 1500 rs, and it is of 2922, its multi pursose gps tracker kit, please tell me u can help me or not because i requre it for my project please sir 😢

  • @Patapom3
    @Patapom3 3 місяці тому

    That's great but you're entirely dependent on 1) an internet connection and 2) 3rd party services...

    • @techiesms
      @techiesms  3 місяці тому

      It’s a DIY project so I guess it’s ok…

  • @CuriosityChronicles-we5cu
    @CuriosityChronicles-we5cu 3 місяці тому

    I am really intrestest in build various kind of project but due to the cost and desire component availability i cant build one , i have a request if u could develop a affordabe micricontroller board under 200 rupess having type c interface for programming and power wifi connectivity, as well as consisting of all type of communication interface if possoble like i2c,i2s,uart,spi and also if possible can bus having small foothprint with castaleted pins and also inbuilt charging ic if possible but i know it difficult to build this within such a low cost , but even if u could add a type c port to the node mcu esp8266 and launch it on your website i would really like to purchase it even my friend ones one for our project i really want a affordable mcu under 200 to tinker and learn on it plz share this comment as much as possible

  • @hemanthkumarmp1886
    @hemanthkumarmp1886 3 місяці тому

    Sir can u send the code

  • @hemanthkumarmp1886
    @hemanthkumarmp1886 3 місяці тому

    Sir can you send me the circuit diagram

    • @techiesms
      @techiesms  3 місяці тому

      Schematic is provided in GitHub
      Check description for link

  • @phamhuan3187
    @phamhuan3187 2 місяці тому

    Please guide free speech to text without entering a credit card

    • @techiesms
      @techiesms  2 місяці тому

      It uses free speech to text using deepgram
      Watch out this video to learn in detail ua-cam.com/video/j0EEFXmikvk/v-deo.htmlsi=zB3m56n5FjoxvULI

  • @cgkinggaming5258
    @cgkinggaming5258 Місяць тому

    Hey sir i am ur customer can i know how to charge it ?

    • @techiesms
      @techiesms  Місяць тому

      Via Type C connector

  • @syedmutahir1917
    @syedmutahir1917 2 місяці тому

    good vido

  • @electriquefarmaci
    @electriquefarmaci 3 місяці тому

    can we get in touch

  • @psykopat81
    @psykopat81 3 місяці тому

    Why do I need such a device when it is installed on my phone (I ask to learn, not to criticize)

    • @gjreditor9835
      @gjreditor9835 3 місяці тому

      For making standalone device. If you can program in Android, everything being done by ESP32 OR any microcontroller can be done with mobile phone. One more thing to note is that phones have become more and more restrictive - even Android kills apps if running in background . So, unlike in past , you can't even run GPS apps or sms responder apps or any such interesting program in background for long.

    • @destiny_02
      @destiny_02 3 місяці тому

      ​@@gjreditor9835you must be using some Chinese phone with their custom android variants. They are known to aggressively kill background apps, but with some effort that behaviour can be changed in settings.
      this is not an issue in stock android as long as you have ample ram.

  • @meetpatel5142
    @meetpatel5142 3 місяці тому +1

    ❤❤🤩🤩🤩🤩

  • @adityajain3485
    @adityajain3485 3 місяці тому

    I am not able to use smd component pls help

    • @techiesms
      @techiesms  3 місяці тому +1

      Just try to get the DIP component of the same value from the market and try to build one
      We have already shared the schematic on GitHub

    • @navneetdhal0021
      @navneetdhal0021 3 місяці тому +1

      ​@@techiesms DIP is still smd. I guess you mean THT.

  • @huyifan83
    @huyifan83 3 місяці тому

    Why it has an Indian accent? 😂😂

    • @techiesms
      @techiesms  3 місяці тому +1

      lol
      May be I Choose language as Indian English

  • @looloopo2449
    @looloopo2449 3 місяці тому

    😂😂😂😂😂

  • @ajuxx
    @ajuxx 3 місяці тому

    First

    • @techiesms
      @techiesms  3 місяці тому +1

      WOAH...
      Thanks for your first view 👍🏻👍🏻