Hi @techiesms, awesome .. thank YOU so much for using/featuring my KALO Recording & Deepgram transcription libraries and your kind ‘Shoutout’, it is my pleasure that i could help you a little bit and your community!. I love your cool projects, and you know: Nobody can explain all tech stuff better than you, your videos and explanations are best !.
Btw: cool hardware details, nice too see e.g. your headphone audio connector, the powering circuits, your auto-reset idea and replay button is a great idea too. So go forward with your great projects .. and i am always happy to support further. Thank you Techiesms for all your great daily work !
I am trying to make all this using ESP8266, and I have actually worked on it for the last 30 days, not continuously but with a little change according to your thinking. Like, I have put this system in my wristwatch like a hidden spy. I have already made the script for ESP8266, it is working but only the part of STT and TTS is left. This is very challenging for me, like custom script or something more. But now I am copy-pasting and thank you very much for this video.
@@lavanyabhamidipati992 use the ESP32-C3 Super Mini. For the microphone, I use the xcluma INMP441 Omnidirectional High Precision MEMS Microphone Module with I2S Support.
Wow! Super interesting project! How about porting that sketch to a device available in the market like a M5 Cardputer, a Lilly-Go T-Deck, a Lilly-Go T- Embed, etc? Those devices include everything needed to just get it up and running as long as the proper libraries are placed into the Arduino Library, then burn the sketch on them. Since many of us don't have the skills to assemble stuff on a PCB board, get the parts needed and can't even solder a button? Other pre-made devices that have ESP32 S3 chips, SD card slot, speaker, buttons, battery connector, lights, screens, microphone, etc, the ones I mentioned would save many of the pains on building our own from scratch. I do see your point of creating home made projects though. I wish I had the skill you have and the talents of creating these IoT's. I love gadgets, but lack the programming aspects of these ESP32's. It's why it's a blessing to have you available in YT. Thanks for sharing this video brother! Stay safe and blessings!
As has been mentioned, it would be nice for the project to be operated with a wake word, so that you didn't need to push a button. It might also be nice, for it to recognize certain words and phrases & activate some subroutines, to control devices attached to it. If there aren't enough I/O ports, maybe it could send messages to nearby ESP32 devices & activate equipment that way. What I'd like to use it for, is for creating a voice interactive robot, that you could control with your voice. Perhaps, it could follow you, or take pictures with its camera, after being to told to do so, with a voice command. Maybe, it could communicate with a Raspberry Pi or other computer, to figure out answers, without the Internet.
Hi everyone, i tried this project and found the way to avoid use of SD card by directly using SPIFFS memory which can be able to store 220 seconds of audio at 8k and 8 bit which is more than enough, for this AI assistant purpose we genrally need about 5-10 seconds, so i think it is the most reliable way to use it, also it will boost some speed for reading and writing files...
Amazing project! Do you think that maybe you'll be offering the gerber files for this project in the future so some of us can order custom PCBs from PCBGOGO in the future?
@techiesms I have an esp32 lyraT 4.3 board on which I have installed alexa using esp32-adf sdk, just curious if I can use this code on same with all required components already present on the board.
Good one, but instead of onboard coding, we should use a free cloud hosted endpoint. It will be better allowing us our own custom knowledge and more 🎉🎉🎉
Wow, bravo. I did something similar (in python) on a 2gb RAM le Potato (minus the convenient button features, BMS, etc.). Didn't think this would be possible on a microcontroller with 520kb RAM. It does seem a bit slow at times in your demonstration, at least compared to my 2gb version. Could this be sped up with streaming? Or do you already include streaming in your .ino code? Very nice project!
I am also working on the idea to extend my recording library with Streaming (streaming I2S bytes realtime from microphone to Deepgram 'during' recording).. but this is crazy complex at least for me (with ESP32 & C, maybe easier in Python, which i won't use on ESP due several reasons), not sure i will ever get int work :D . We will see.
brother, your schematic doesnt show all the components you used. like resistors, battery monitoring circuit. can you please please tell me every component you used and how many
yha hai i am a B-Tech final year student i thought of making a smart device with Raspberry pi 4 where the os look like Ai, And if we ask any thing it will show in display and respond like alexa indirectly an alexa with a display any idea for it
Hlo bro can you share the circuit diagram for making it on a zero pcb board without the smd components I seen the Schematic diagram i dont understand that make it simple plz
I have interesting idea and I am currently working on that I want to make tutorial of that like how to mke fully independent ai pocket device compact in size and has voice assistants and object recognization and has display on it and showing captions on that portable and use with sim card maybe thats great idea for your channel can you please make that ❤
Hi @techiesms can you name all the parts or components used in this project and also all things simply and easy to understand because i am just a beginner and don't know about it anything but I want to make this
You can use Deepgram itself for text to speech too. You won't have the hassle of chunking the response text. Just like 750 hours of voice to text free, Deepgram text to voices is free up to 250 hours.
you are right, Deepgram offers TTS .. but as I know they do NOT offer any languages beyond English (as today). The Open AI TTS voices are multilingual, each of the 6 voices can speak multiple languages (even changing language in one sentence). And i could not find any ESP32 library supporting their 'steaming concept' for TTS. If you know a library or function call, let us know please!
sir i am buying one iot project from your website but i have only 1500 rs, and it is of 2922, its multi pursose gps tracker kit, please tell me u can help me or not because i requre it for my project please sir 😢
I am really intrestest in build various kind of project but due to the cost and desire component availability i cant build one , i have a request if u could develop a affordabe micricontroller board under 200 rupess having type c interface for programming and power wifi connectivity, as well as consisting of all type of communication interface if possoble like i2c,i2s,uart,spi and also if possible can bus having small foothprint with castaleted pins and also inbuilt charging ic if possible but i know it difficult to build this within such a low cost , but even if u could add a type c port to the node mcu esp8266 and launch it on your website i would really like to purchase it even my friend ones one for our project i really want a affordable mcu under 200 to tinker and learn on it plz share this comment as much as possible
For making standalone device. If you can program in Android, everything being done by ESP32 OR any microcontroller can be done with mobile phone. One more thing to note is that phones have become more and more restrictive - even Android kills apps if running in background . So, unlike in past , you can't even run GPS apps or sms responder apps or any such interesting program in background for long.
@@gjreditor9835you must be using some Chinese phone with their custom android variants. They are known to aggressively kill background apps, but with some effort that behaviour can be changed in settings. this is not an issue in stock android as long as you have ample ram.
Hi @techiesms, awesome .. thank YOU so much for using/featuring my KALO Recording & Deepgram transcription libraries and your kind ‘Shoutout’, it is my pleasure that i could help you a little bit and your community!. I love your cool projects, and you know: Nobody can explain all tech stuff better than you, your videos and explanations are best !.
Btw: cool hardware details, nice too see e.g. your headphone audio connector, the powering circuits, your auto-reset idea and replay button is a great idea too. So go forward with your great projects .. and i am always happy to support further. Thank you Techiesms for all your great daily work !
Thank you so much....
Sir can you send me the complete circuit diagram not schematic@@techiesms
Hello @kaloprojects please is there a way to contact you, through email or something, I am stuck on a project and desperately need your help
In the next one you build, add an AI-THINKER VC-02 so that it is automatically activated by voice without pressing the switch.
I am trying to make all this using ESP8266, and I have actually worked on it for the last 30 days, not continuously but with a little change according to your thinking. Like, I have put this system in my wristwatch like a hidden spy. I have already made the script for ESP8266, it is working but only the part of STT and TTS is left. This is very challenging for me, like custom script or something more. But now I am copy-pasting and thank you very much for this video.
hi what speaker and mic did you use for this project
@@lavanyabhamidipati992 use the ESP32-C3 Super Mini. For the microphone, I use the xcluma INMP441 Omnidirectional High Precision MEMS Microphone Module with I2S Support.
Wow! Super interesting project! How about porting that sketch to a device available in the market like a M5 Cardputer, a Lilly-Go T-Deck, a Lilly-Go T- Embed, etc? Those devices include everything needed to just get it up and running as long as the proper libraries are placed into the Arduino Library, then burn the sketch on them. Since many of us don't have the skills to assemble stuff on a PCB board, get the parts needed and can't even solder a button? Other pre-made devices that have ESP32 S3 chips, SD card slot, speaker, buttons, battery connector, lights, screens, microphone, etc, the ones I mentioned would save many of the pains on building our own from scratch. I do see your point of creating home made projects though. I wish I had the skill you have and the talents of creating these IoT's. I love gadgets, but lack the programming aspects of these ESP32's. It's why it's a blessing to have you available in YT. Thanks for sharing this video brother! Stay safe and blessings!
Based on your suggestion I’ll try to do with other boards that I have
@@techiesms Looking forward to seeing your next video related to the sketch on other boards/devices. Take care and blessings. 🙏✨
Thank you for what I learned from you in Sri Lanka
As has been mentioned, it would be nice for the project to be operated with a wake word, so that you didn't need to push a button. It might also be nice, for it to recognize certain words and phrases & activate some subroutines, to control devices attached to it. If there aren't enough I/O ports, maybe it could send messages to nearby ESP32 devices & activate equipment that way. What I'd like to use it for, is for creating a voice interactive robot, that you could control with your voice. Perhaps, it could follow you, or take pictures with its camera, after being to told to do so, with a voice command. Maybe, it could communicate with a Raspberry Pi or other computer, to figure out answers, without the Internet.
Hi everyone, i tried this project and found the way to avoid use of SD card by directly using SPIFFS memory which can be able to store 220 seconds of audio at 8k and 8 bit which is more than enough, for this AI assistant purpose we genrally need about 5-10 seconds, so i think it is the most reliable way to use it, also it will boost some speed for reading and writing files...
Please tell me
Holly Molly! How did you come about this? I have been looking for ways around this problem for some time now
Just wanted to know how did you guys solder the small components with the pcb ?
can you make a simple circuit just like gpt in esp? please!
I would like suggest you to make a Google assistant device using raspberry pi zero. There are no detailed tutorial videos on this topic.
Very interesting project. From this you can make a project that can send commands to control your house. I love it.
WOW AMAZING DETAIL!! THANK YOU!! YOU ARE AWESOME!!!!!!!
You can bulid a live language translator with this, which will be super useful.
Great work. Thank you for your great support.
Amazing project! Do you think that maybe you'll be offering the gerber files for this project in the future so some of us can order custom PCBs from PCBGOGO in the future?
Can we add a ov2640 module and send a frame to gemini api when a particular word like “what am i seeing” and get response?
@techiesms I have an esp32 lyraT 4.3 board on which I have installed alexa using esp32-adf sdk, just curious if I can use this code on same with all required components already present on the board.
Please make a video on streaming the song from Spotify using esp32 and audio decoder module, it's very useful for us.
Good one, but instead of onboard coding, we should use a free cloud hosted endpoint. It will be better allowing us our own custom knowledge and more 🎉🎉🎉
I didn't get your point. Can you elaborate
The esp code cannot be off loaded 😂. The software that can be off loaded has already been off loaded and mentioned as so in the video
use sim for internet connection please . Then we can use it without wifi and mobile
Wow, bravo. I did something similar (in python) on a 2gb RAM le Potato (minus the convenient button features, BMS, etc.). Didn't think this would be possible on a microcontroller with 520kb RAM. It does seem a bit slow at times in your demonstration, at least compared to my 2gb version. Could this be sped up with streaming? Or do you already include streaming in your .ino code? Very nice project!
I am also working on the idea to extend my recording library with Streaming (streaming I2S bytes realtime from microphone to Deepgram 'during' recording).. but this is crazy complex at least for me (with ESP32 & C, maybe easier in Python, which i won't use on ESP due several reasons), not sure i will ever get int work :D . We will see.
@@kaloprojects would love to check that out
brother, your schematic doesnt show all the components you used. like resistors, battery monitoring circuit. can you please please tell me every component you used and how many
yha hai i am a B-Tech final year student i thought of making a smart device with Raspberry pi 4 where the os look like Ai, And if we ask any thing it will show in display and respond like alexa indirectly an alexa with a display any idea for it
please integrate more AI MODELS like LLAMA, etc.
bro can you please make a voice module price frendly in veroboard with deepgram and esp32 which is full pack of (alaxa or chtgpt)
Hlo bro can you share the circuit diagram for making it on a zero pcb board without the smd components
I seen the Schematic diagram i dont understand that make it simple plz
@techiesms reply me
Please make a video of making it with easy ways! ❤
I have interesting idea and I am currently working on that I want to make tutorial of that like how to mke fully independent ai pocket device compact in size and has voice assistants and object recognization and has display on it and showing captions on that portable and use with sim card maybe thats great idea for your channel can you please make that ❤
Did you succeed?
Brilliantly clear tutorial. The soldering seems to happen by magic
Thanks
Hello,Any plans to provide this as building kit?
Building Kit Means?
@@techiesms components and pcb
Can we add multiple wifi said and pass so it will connect to any avilable
Kaise kharede ya wala circuit board
Plz Send the circuit diagram in easy manner for without PCB makers
I would like to integrate it with a sim card so that it doesn't require to connect to any hotspot
Bro can i use esp32 with micro USB port with out using USB to ttl converter system
I literally had the same idea one week ago. Even built a prototype hahaha
Best of all: With the same components, even.
teach me bro
LOL
No issues, Now you can easily make it with the help of this video
@@techiesms bro did u have any connection diagram
It can be turned into the business of bilingual interpretation .
But can it be operate offline?
bro you are really intelligent
I want to buy this completely assembled hardware but on ur website its showing it will be back on 30th November can u help me out to get it sooner 🙏
Sir it’s not in stock
We ordered it and waiting for the delivery of components
@@techiesms how many days after 30th will we get the product ( living in Mumbai )
@cerlpearl kindly share the pincode on our WhatsApp
8200079034
Fantastic Assistance Portable (FAP) !!!
make an 3d printed case for better convinence
Can this Gemini AI control things over esp32 like house automation , or servos , or leds in any project ?
Not exactly
But to do that you can use the speech to text response and compare it to control the appliances
We can make device to anytime listening
How is this different from Google assistant?
ERROR in Record_Start() - I2S not initialized, call 'I2S_Record_Init()' missed, I'm getting this error when pressing record button, please help
Hi @techiesms can you name all the parts or components used in this project and also all things simply and easy to understand because i am just a beginner and don't know about it anything but I want to make this
You can refer this schematic to check out all the parts
Awesome video!
Maza a gaya is project say . Alampana Tusi great ho tofa Kabul Karo .🎉🎉
Bs kr pagle, Rulayega kya....
bro is this capable of real time data like time date and weather
最高です！
Tシャツ欲しい。
That's great but you're entirely dependent on 1) an internet connection and 2) 3rd party services...
It’s a DIY project so I guess it’s ok…
Which software used for 3d vision
It was 3-D view in easy EDA
Thank you sir ❤
Most welcome
Add NXP local voice recognition ic to this
Maintenance mode is on
Site will be available soon. Thank you for your patience!
Bro your chatgpt voice assestant v2 speech to text library file is error occur (compile time)give me any solution
what if we add a display to it, please make it
Can the code be entered into a Panel touch screen ESP32-4848S040 so that we can see the answer on the screen ?
You can use Deepgram itself for text to speech too. You won't have the hassle of chunking the response text. Just like 750 hours of voice to text free, Deepgram text to voices is free up to 250 hours.
you are right, Deepgram offers TTS .. but as I know they do NOT offer any languages beyond English (as today). The Open AI TTS voices are multilingual, each of the 6 voices can speak multiple languages (even changing language in one sentence). And i could not find any ESP32 library supporting their 'steaming concept' for TTS. If you know a library or function call, let us know please!
can you make faster reply from the device ?
Can I buy the complete built hardware part without buying pcb from pcbgogo
You can buy complete hardware assembled on PCB from our website
can u pease make a 3d case fr this
try edgetts?
what will be the application of this project
Nice project 🎉
Glad you like it!
Sir di chij bata do google tts free kaise mile Or sir second chij sir ye esp8266 se kar sakte h
Sir can I know the actual cost of the product
Kitne paise lg jayenge ise bnane me including all parts and pcb and assembling them
We are selling it already through our website
It's rabbit r1 with the latest patches.
Perfect!
Thanks
sir i am buying one iot project from your website but i have only 1500 rs, and it is of 2922, its multi pursose gps tracker kit, please tell me u can help me or not because i requre it for my project please sir 😢
Could you please share your PCB gerber file?
Helo bro where is schematic diagram,, can u provide link plz...
Its in the GitHub repo.
the link is in the description
@@techiesms thanks bro....
Thanks!!!
Welcome!
I am really intrestest in build various kind of project but due to the cost and desire component availability i cant build one , i have a request if u could develop a affordabe micricontroller board under 200 rupess having type c interface for programming and power wifi connectivity, as well as consisting of all type of communication interface if possoble like i2c,i2s,uart,spi and also if possible can bus having small foothprint with castaleted pins and also inbuilt charging ic if possible but i know it difficult to build this within such a low cost , but even if u could add a type c port to the node mcu esp8266 and launch it on your website i would really like to purchase it even my friend ones one for our project i really want a affordable mcu under 200 to tinker and learn on it plz share this comment as much as possible
Can we run this locally......?
no. its over internet
Please guide free speech to text without entering a credit card
It uses free speech to text using deepgram
Watch out this video to learn in detail ua-cam.com/video/j0EEFXmikvk/v-deo.htmlsi=zB3m56n5FjoxvULI
Awesome
Do you ship to Australia
Yes.
Kindly WhatsApp us on +91 82000 79034
can u provide the gerber file for the pcb?
No sorry
But you can find the schematic in the video
Does the hardware cimw in srilanka
Yes
Kindly WhatsApp on +918200079034
Where did get pcb bro ?
We are not selling PCB, rather we are selling the complete project
@@techiesms assemble project or compounds of project?
Can i get the files for pcb pls?
Price
good vido
Why do I need such a device when it is installed on my phone (I ask to learn, not to criticize)
For making standalone device. If you can program in Android, everything being done by ESP32 OR any microcontroller can be done with mobile phone. One more thing to note is that phones have become more and more restrictive - even Android kills apps if running in background . So, unlike in past , you can't even run GPS apps or sms responder apps or any such interesting program in background for long.
@@gjreditor9835you must be using some Chinese phone with their custom android variants. They are known to aggressively kill background apps, but with some effort that behaviour can be changed in settings.
this is not an issue in stock android as long as you have ample ram.
Sir can you send me the circuit diagram
Schematic is provided in GitHub
Check description for link
Hey sir i am ur customer can i know how to charge it ?
Via Type C connector
can we get in touch
Sir can u send the code
❤❤🤩🤩🤩🤩
I am not able to use smd component pls help
Just try to get the DIP component of the same value from the market and try to build one
We have already shared the schematic on GitHub
@@techiesms DIP is still smd. I guess you mean THT.
😂😂😂😂😂
Why it has an Indian accent? 😂😂
lol
May be I Choose language as Indian English
First
WOAH...
Thanks for your first view 👍🏻👍🏻
Wow so nice
Great idea keep it up bro 👍🎉
Can I get your WhatsApp number?
Bro can i use esp32 with micro USB port with out using USB to ttl converter system