Some limitations of this project are: 1. The recording time is only 1.9 seconds. To make this time longer, you would have to increase the wavdatasize. But that wouldn't be possible since the esp32 has limited memory. However, you could use a micro sd to store the wav file and then send it to cloud to be converted. 2. Alot of times, the esp32s computational power is not enough to keep up with the audio playback. What this means is that, if you generate a response of more than 20-30 tokens, a lot of times what happens is that the esp32 doesn't synthesis the text and there isn't an audio playback on the speakers even though you have received the generated output. 3. Doesn't have a wake word detection. 4. A huge delay starting from the input to the output. A simple solution maybe to use a faster board like nvidia jetson nano which is an ideal development board with computational power more than enough for this kind of projects.
Hello I found your reply helpful, I'm inquiring about how I can be able to incorporate a wake word in this same project. Do I have to train and deploy a separate model to detect the wake word or is there a way around this?
Nice video,can't help about coding but for sure it needs to be fast and instead of ir sensor u can use single words same like Alexa Google , also using 2 board isn't a good idea I think someone who knows how to edit Library can change name of the same library,also isn't there any alternative for that lib
I'd suggest: - using a push button instead of an IR sensor. It's cheaper. - using a turn ON sound instead of an audio output saying "Starting" and also reducing its response time from when the IR sensor is triggered. It's an awesome project. Thankd very much.
🎯 Key Takeaways for quick navigation: 00:00 🎯 The video introduces a voice assistant project based on ChatGPT running on an ESP32 board. 00:26 📚 To understand this project, viewers need to watch three previous episodes in the series for the context. 01:25 🏭 The video is sponsored by Altium 365, an electronics product design platform that offers PCB design, data management, collaboration, and more. 02:08 🎤 The previous episode successfully converted speech to text using Google Cloud services, leading to filtered text responses. 03:16 🔄 Merging the speech-to-text and text-to-speech codes caused compiling errors, resolved by using separate ESP boards for each function. 03:58 🔌 The communication between the two ESP boards is done via UART, enabling a seamless flow of data for the voice assistant. 06:00 📐 After assembling the components and fitting them inside a plastic casing, the voice assistant project is ready for testing. 06:18 🛠️ Turning on the voice assistant, it responds to questions with different LED indications for recording and processing. 07:02 🗣️ The voice assistant successfully answers questions, including multilingual responses, demonstrating its functionality. 07:45 💡 Viewers are encouraged to suggest improvements for the voice assistant project in the comments section for possible future episodes. Made with HARPA AI 👍 Upvote to improve video surfing
I initially started watching this entire series with a hope to find a solution of problem im facing in one of my project. What im trying to do is record video and audio using esp32cam. I thought the part of speech to text might be helpful but still it will have the problem of syncing with the video. If you have done any such project earlier please point me to the link and if you haven't done it yet, then please make one project covering this part
It would be more interesting (and usefull) if there was a way to merge this with another ESP32 that could act as "Alexa" (turning lights on or off, etc)
Is there a way to make this work with T-Display ESP32-S3 boards, would be cool if you could use both screens, the speech recognition board could show the text from your speech and the output board could show the text from GPT.
have you provided the needed api? or you can use other models like (if OpenAI's api doesn't work) GeminiUltra by Google which is free (60 requests per min)
This is so cool! I will build it tomorrow, thanks a lot for the great work, Edit: just finished the video, now I understand why I was having a conflict running speaker and mic !
Great that you've built it. Actually I want to use this as a part of my project and it's the first time me and my group is building something like this. Ik it'd be coming off a bit wierd but is there a way we could contact u to help us out in our project if we ever need help or get stuck somewhere and need a little guidance. It'd be really appreciated. Please 🥺
Can you please share the GitHub repo of your project. We are trying to build it as our college project but we are getting an error in the text to speech part .
hey, great project. In one of your previous video you said this project could be performed using esp8266 as well. It would be great if you create a video on that.
Hi ! I bought two BAOFENG handys, how can I transmit from one arduino to another using them ? I mean turn audio and mic plug to TX RX, from arduino to HANDY KENWOOD PLUGS (one is 3.5 stereo the other 2.5 stereo) and receive the message in another handy which receivesd the signsal and sends via plugs to ardunio and read the message in serial moriunor a
How many languages does this program support? Can Vietnamese be used? Thank you for answering my question. Thank you for sharing what you shared. It is wonderful.
How can we modify this into a language translator between two different cultural people sir. I am working on a project and your answer will definitely helps me sir.
Can you merge Google assistant and Chat GPT , ( yani Ok Google ya Hay Google bol kar Hame esa kahe Answer the Question using ChatGPT , to Google assistant hame ChatGPT redirect karde ya Usse Voice leke Read karne lage , overall ChatGPT+Google Assistant Also Murge Google Bard Ai with Google Assistant and make own Assistant
i can use the bard ai apk or token in place of chat gpi api directly if not what changes i need to do in my project to use the google bard api insted of chat gpt
A Single esp32 has 2 CPU cores. So why not just use a Single esp32 for this? It also has enough memory, and if needet an sd card can be Connected too...
while running the speech to text code I have got( 'LED_BUILTIN' was not declared in this scope ) in "pinMode(LED_BUILTIN,OUTPUT);" this line , how to rectify this?
@@techiesms Thanks, but had to comment out the led_builtin code to make it work further. But now I am getting this error - E (2623) i2s(legacy): i2s_check_set_mclk(1799): ESP32 only support to set GPIO0/GPIO1/GPIO3 as mclk signal, error GPIO number:3000 E (2624) i2s(legacy): i2s_set_pin(1881): mclk config failed Can you help with this? I will be happy to pay for your time. Thanks.
@@techiesms I was able to downgrade to v1.0.6 and the upload to ESP32 worked. However, I get the following error Press button Record start! Recording Completed. Now Processing... Json daata--- Guru Meditation Error: Core 1 panic'ed (LoadProhibited). Exception was unhandled.
Some limitations of this project are:
1. The recording time is only 1.9 seconds. To make this time longer, you would have to increase the wavdatasize. But that wouldn't be possible since the esp32 has limited memory. However, you could use a micro sd to store the wav file and then send it to cloud to be converted.
2. Alot of times, the esp32s computational power is not enough to keep up with the audio playback. What this means is that, if you generate a response of more than 20-30 tokens, a lot of times what happens is that the esp32 doesn't synthesis the text and there isn't an audio playback on the speakers even though you have received the generated output.
3. Doesn't have a wake word detection.
4. A huge delay starting from the input to the output.
A simple solution maybe to use a faster board like nvidia jetson nano which is an ideal development board with computational power more than enough for this kind of projects.
Hello I found your reply helpful, I'm inquiring about how I can be able to incorporate a wake word in this same project. Do I have to train and deploy a separate model to detect the wake word or is there a way around this?
@@nicksonamwine8869 did you find out how you can implement that?
Does this project run on esp8266?
@@olahroland3788 yeah I did, though I implemented it using python
yeah it should work with esp8266, but as he said you will have an memory issue
@@atiradordeteia-brasil_01
Now make it control electric components
For that you would want a local model
You should connect with relay module
Nice video,can't help about coding but for sure it needs to be fast and instead of ir sensor u can use single words same like Alexa Google , also using 2 board isn't a good idea I think someone who knows how to edit Library can change name of the same library,also isn't there any alternative for that lib
Thanks for the tip
Can we select the language ? I have interested idea ! 😊
CHAT GPT already detect language, so no need to change.
I'd suggest:
- using a push button instead of an IR sensor. It's cheaper.
- using a turn ON sound instead of an audio output saying "Starting" and also reducing its response time from when the IR sensor is triggered.
It's an awesome project. Thankd very much.
Check out our updated version of this project
ua-cam.com/video/zvR9DTfMwPE/v-deo.htmlsi=Q4NoseGfsoZgdOTm
Sir also make a video on google bard AI
why using two esp32? can't we do this project with one esp?
🎯 Key Takeaways for quick navigation:
00:00 🎯 The video introduces a voice assistant project based on ChatGPT running on an ESP32 board.
00:26 📚 To understand this project, viewers need to watch three previous episodes in the series for the context.
01:25 🏭 The video is sponsored by Altium 365, an electronics product design platform that offers PCB design, data management, collaboration, and more.
02:08 🎤 The previous episode successfully converted speech to text using Google Cloud services, leading to filtered text responses.
03:16 🔄 Merging the speech-to-text and text-to-speech codes caused compiling errors, resolved by using separate ESP boards for each function.
03:58 🔌 The communication between the two ESP boards is done via UART, enabling a seamless flow of data for the voice assistant.
06:00 📐 After assembling the components and fitting them inside a plastic casing, the voice assistant project is ready for testing.
06:18 🛠️ Turning on the voice assistant, it responds to questions with different LED indications for recording and processing.
07:02 🗣️ The voice assistant successfully answers questions, including multilingual responses, demonstrating its functionality.
07:45 💡 Viewers are encouraged to suggest improvements for the voice assistant project in the comments section for possible future episodes.
Made with HARPA AI 👍 Upvote to improve video surfing
Can you give me the name of the components used
Check description for that
@@techiesms thanks, I got it
I initially started watching this entire series with a hope to find a solution of problem im facing in one of my project. What im trying to do is record video and audio using esp32cam. I thought the part of speech to text might be helpful but still it will have the problem of syncing with the video. If you have done any such project earlier please point me to the link and if you haven't done it yet, then please make one project covering this part
Have u solved the solution
It would be more interesting (and usefull) if there was a way to merge this with another ESP32 that could act as "Alexa" (turning lights on or off, etc)
Anyone whose project is made successfully by the help of this video...??
Then please also tell me🥺??
Can you remake the schematic diagram and code while adding a micro sd card and increasing the wavdatasize I'd really appreciate
I literally thought about this before seeing this video ❤❤much love
I can't find the microphone and amplifier board. Could you suggest alternatives?
Is there a way to make this work with T-Display ESP32-S3 boards, would be cool if you could use both screens, the speech recognition board could show the text from your speech and the output board could show the text from GPT.
that is exactly what I was thinking
Very useful project!! Now it will be possible make lots of industrial as well as educational projects .=Thanks!!
Happy Making 😇
why are 2 esp32s needed? why not use 1?
How to make a voice controlling gps navigator saying directions as output in a speaker
seriously awesome bro you are doing great
hi bro i am doing this project for exibition . when it done copy your code insert the libraries it doesnt get chat gpt replay
have you provided the needed api? or you can use other models like (if OpenAI's api doesn't work) GeminiUltra by Google which is free (60 requests per min)
Hi Mate .. have tried
to compile Text to Speech, how can I get the Audio.h for this as this ?
was that a L7805 voltage regulator used in the circuit diagram?
Sir please make chatgpt and home automation
bu video pekçok şeyi degiştirebilir . teşekkürler emeginiz için harika bir konu olmuş. artık daha akıllı cihazlar tasarlanabilir
Como siempre techiesms trayendo ideas fuera de lo ordinario. Simplemente el mejor!!!
There is an error in the code. The I2S.h library is faulty, the code from speech to text gives an error.
me too facing the same error...can any one help
Amazing sir can we use this project on old android phone which not support any assistant like android 2.3
Should we buy cloud for it
This is so cool! I will build it tomorrow, thanks a lot for the great work, Edit: just finished the video, now I understand why I was having a conflict running speaker and mic !
You could try renaming one of the libraries (.h, .cpp files).
Great that you've built it. Actually I want to use this as a part of my project and it's the first time me and my group is building something like this. Ik it'd be coming off a bit wierd but is there a way we could contact u to help us out in our project if we ever need help or get stuck somewhere and need a little guidance.
It'd be really appreciated. Please 🥺
Can you please share the GitHub repo of your project. We are trying to build it as our college project but we are getting an error in the text to speech part .
@@bolobolobolobo hey did you built it then. if Yes . did you use a wake word instead of this IR bullshit?
Add an lcd that displays the input and output speech
Professional Project Bro... 😍♥️🔥
Can we control home appliances with it?
How could it be done with just one esp32?
Btw, amazing video, congrats!❤
this is awesome ,, but did you try to increase the input sampling rate in order to increase the speed of the Google Cloud API ?
Can you make a video using Tensorflow lite?
hey, great project. In one of your previous video you said this project could be performed using esp8266 as well. It would be great if you create a video on that.
{chatGPT Voice Assistant Components} can I by this bundle from srilanka. do you deliver to the srilanka
Can we use this model as the speaking model for my robot project ? Is it a good idea ....help me out plzz 😊
where can i get more datail about this project like connections etc...
Hi bro loved❤ your video, but can you tell how much is the battery's voltage
how did u replace 7333-A voltage regulator using a toggle switch
Hello , I'm working with s3 module, but i2s Library is not matched with the previous esp version . Can you help me with this issue?
Can we have programing test read out from this ? Of program lines
Isse ham koi bhi question puchh sakte he jese chat gpt se puchhate he ????
Bro.
Bunun Türkçe dilinde nasıl yapılacağı konusunda yardımcı olurmusun?
Bro this is incredible 👏
hi, how to fix error I2S.cpp:57:10: error: 'i2s_read_bytes' was not declared in this scope
is it possible to use one microcontroller instead two microcontroller
Bro really great work ❤ can you please make this using raspberry pi
Hi ! I bought two BAOFENG handys, how can I transmit from one arduino to another using them ? I mean turn audio and mic plug to TX RX, from arduino to HANDY KENWOOD PLUGS (one is 3.5 stereo the other 2.5 stereo) and receive the message in another handy which receivesd the signsal and sends via plugs to ardunio and read the message in serial moriunor a
Is it necessary to connect the microphone via SPI? Can't we connect a microphone like Max9814?
Bro in which platform ur writing code and in which language ur using plz tell me bro
Hi Sachin! upload the code for Text To Speech and Speech To Text to each ESP32?
or one of the esp32?
Hi can i use MAX98357 I2S 3W CLASS D powerful AMPLIFIER instead of i2s amplifier?
I think the best idea is to use voice command to wake up the device instead of IR
Yea
Yes but its implementation is not as easy
Hello sir how we can get the code for both the esp32
Can you make it understand & speak in a language other than English?
How many languages does this program support? Can Vietnamese be used? Thank you for answering my question. Thank you for sharing what you shared. It is wonderful.
Can you make it start by voice and not motion detection? Improve the delay time. Store common questions locally?
We tried to lower down the delay, but didn't get success in it as there are a lot of task running for getting the answer
How can we modify this into a language translator between two different cultural people sir. I am working on a project and your answer will definitely helps me sir.
Hey I'm working on something almost similar, could we get in touch somehow?
Can you merge Google assistant and Chat GPT , ( yani Ok Google ya Hay Google bol kar Hame esa kahe Answer the Question using ChatGPT , to Google assistant hame ChatGPT redirect karde ya Usse Voice leke Read karne lage , overall ChatGPT+Google Assistant
Also Murge Google Bard Ai with Google Assistant and make own Assistant
i can use the bard ai apk or token in place of chat gpi api directly if not what changes i need to do in my project to use the google bard api insted of chat gpt
Cool next gen ESP
Can you add facial expressions using an OLED screen or any other screen? And also make it respond to a wake word like Hey GPT or any wake word
We are thinking of adding a wake up command
but let's see
@@techiesms that’s great
What about it’s personality
Does this project run on esp8266?
Hi sir can you install Alexa in means we can also use homeautomation and voice assistant please reply
can it be done just by one ESP32 module ?
very cool bro... simple is beauty 👍👍👍
Thanks 👍
Bro really great and thanks
Hi Sir, Can i use 1 NodeMCU for microphone, and Other ESP32 Wrooms board for Chatgpt etc?
A Single esp32 has 2 CPU cores. So why not just use a Single esp32 for this? It also has enough memory, and if needet an sd card can be Connected too...
Hi how can I make this project only using one board
Does it talk any language or English only thank you
How many dates to ship your product
while running the speech to text code I have got( 'LED_BUILTIN' was not declared in this scope ) in "pinMode(LED_BUILTIN,OUTPUT);" this line , how to rectify this?
I am stuck on this too. Any solution found?
Just select the board as ESP32 Dev Kit V1 in the boards section
@@techiesms Thanks, but had to comment out the led_builtin code to make it work further. But now I am getting this error - E (2623) i2s(legacy): i2s_check_set_mclk(1799): ESP32 only support to set GPIO0/GPIO1/GPIO3 as mclk signal, error GPIO number:3000
E (2624) i2s(legacy): i2s_set_pin(1881): mclk config failed
Can you help with this? I will be happy to pay for your time. Thanks.
@@techiesms I was able to downgrade to v1.0.6 and the upload to ESP32 worked. However, I get the following error
Press button
Record start!
Recording Completed. Now Processing...
Json daata---
Guru Meditation Error: Core 1 panic'ed (LoadProhibited). Exception was unhandled.
Perfectoo.
I need ones
Amazing project 👍👍👍
Glad you like it
Bro we are doing this project can u help us regarding this
Which component is there downside the battery charging module 5:35
HT 7333A
how big of battery are u using????
Anyone who compiles and gets the error esp32 I2S error: 'i2s_read_bytes' was not declared in this scope, I suggest using ESP32 Board version 1.0.6
Thank you so much, i really love your project🤖⭐⭐⭐
can we make this with one board?
Yes
Here is the video
ua-cam.com/video/zvR9DTfMwPE/v-deo.htmlsi=HX5Be7oMREEkQ9Nv
Please detailed vedio applode and all components name or by link and full code link
pinMode(LED_BUILTIN,OUTPUT); error while uploading speech to text in esp32
what to do ?
i am also getting the same error, how did you rectify this error ?
Hello, I too similiar problem
@@patrickrios99did you solved this problem?
Love this Project
you are genius 👍👍
Thanks 😊
Please add home automation chatgpt
You did it 🎉🎉🎉
Yessss
Nice PROJECT
Great video 👍
Thanks 😊
can we make it with esp8266
Can we make a robot with this idea ?
Nice video, thanks :)
Glad you liked ✌️
Please make again
Hi, sir I have completed hardware but all the code is having compiling error. Please help, as I have spent all my savings 😭
hello i m facing the similar problem, did u figure your one out? if yes pls help
@@goodsquirrel2725 bro did u find the errors solution
Whats ur error i have error too
Can i ask the question in malayalam, is it responde Or not?
Why not just rename the library? Huh?
Hlo brother if i orderd theese components. How many days it will came to my destination
What’s your order number ?
@@techiesms no I couldn't ordered but suppose if I order how many days it will come to my home
can't we rename the library?