Speech Command Recognition With Tensorflow.JS and React.JS | Javascript AI
Вставка
- Опубліковано 14 лип 2024
- Speech is a powerful medium.
Words have shaped nations, built empires and rallied masses.
So, why not bring speech into your next React.JS app!?
This video shows you exactly how to do that. Using AI powered speech command recognition through Tensorflow.JS you're able to detect speech commands through the browser using your microphone. The speech commands have been pre-trained using a deep neural network (AI) to be able to recognise a number of different commands like 'up', 'down', 'left' and 'right'.
And what's best? In just 26ish minutes you'll be able to integrate into your existing React.JS app!
In this video, you'll learn how to:
1. Install the Tensorflow.JS Speech Command Recognition
2. Build a React Web App that leverages the model
3. Displaying speech commands to the screen
Get the code: github.com/nicknochnack/Speec...
Chapters:
0:00 - Start
2:29 - Installing React.JS using Create React App
4:45 - Installing Tensorflow.JS & Speech Command Recognition
6:03 - Importing Dependencies
7:02 - Setting Up Application States
10:07 - Creating a Speech Recognizer
14:49 - Activating Speech Recognizer
16:41 - Displaying Commands to the Screen
20:31 - Argmax for Javascript
21:32 - Getting the Highest Probability Detection
23:25 - Displaying Commands to the Screen
Oh, and don't forget to connect with me!
LinkedIn: / nicholasrenotte
Facebook: / nickrenotte
GitHub: github.com/nicknochnack
Patreon: / nicholasrenotte
Join the Discussion on Discord: / discord
Happy coding!
Nick
P.s. Let me know how you go and drop a comment if you need a hand! - Наука та технологія
AI is having fun with your Australian accent. Thank you for your great job on all the TensorFlow.js - React series
Thanks a lot Nick for dropping these tutorials. Why on earth will someone dislike this video!!!!
Thanks so much @Ola.Techie, glad you like them!
Haha, the timing is awesome!
I was exploring how to search files with speech and there you go uploading this! :D
Sweet, in your own webapp @SouvlakiGyros?
@@NicholasRenotte Yes! ;)
@@justalex8342 awesomeee!
Thank you so much
Please more advanced videos about Speech Commands with Tensorflow.JS + React.JS 👍🏼
Oooooh, stay tuned, wait til you see what’s coming out on Sunday @b3of!
Oo gawd, I was just on your channel for making a new project and taking some reference and here you dropped a new awesome thing 🔥😍. Ty Nick sir
Anytime my man! Stay tuned, I think you'll enjoy Sunday's vid as well!
@@NicholasRenotte waiting 🤩🤩
great stuff! you make learning tensorflow so fun
Thanks so much! So glad you're enjoying it.
This channel has some very cool videos. Keep at it 👊
Thanks so much @Sarthak!
Nice video. Thanks
Awesome video!
Thanks so much @Joshua!
Greate video can you do a video about transfer learning as well
Great video! can you do a video about transfer learning and train the model to get used other words?
You got it!
@@NicholasRenotte Yeah I am also interested to know how to train model so it can identify other words
I just discovered your channel thanks for the inspiration! I’m working on a voice recognition app and I’m paying for the API, but maybe I can use this since it’s free and can be used offline? Crazy times
Hell yeah, give it a crack @Mike! The paid APIs might be a little more accurate but I found that this was pretty awesome considering how straightforward it was to use.
I am having issues with @tensorflow/tfjs, error; module cannot resolve fs. I am using nextJs though
Wow! Does that apply to React Native as well?
Hello, i have a project for audio emotion detection with python, and i need to do the ihm with React js, can anyone tell me what should i do ? the steps ? the library thank you
awesome!
Thanks so much @Norman!
Please tell me if we can use this code to do urban sound recognition.
Can you use this in Electron?
So I just rewatched the video, and I have a question - if my app displays a random sentence that I want TF to recognize, how do I train the model to get used to these words? Is there a broader speech recognition model I could use other than the commands like "down/up"?
Heya @Mike, you can use transfer learning to train custom commands. Check out the walkthrough at towards the bottom of this: github.com/tensorflow/tfjs-models/tree/master/speech-commands Let me know if you want a vid on it!
@@NicholasRenotte I have the same task to do it is very helpfull if you can do a video about transferlearning
So good!
Thanks so much @Shivan!! Doing anything interesting with it?!
@@NicholasRenotte Do you recall when you have your eyes tested you have to read out words on a letter chart? I want to make this using speech commands. Again, another idea living in my head.
@@ShivanS that is superrr cool, and ridiculously practical as well. Let me know how you go with it!
How to make custom dataset for tensorflow js operation
are you using node.js?
How do i popolate the Commands? There are only 20. But what to do if i want to remove them & create my custom command? I am a biginner please guide me with your valuable suggestions.
Check out the transfer learning section here: github.com/tensorflow/tfjs-models/tree/master/speech-commands
Can speech command recognition be combined with image recognition?
Yup, could build a multi modal model off it!
how can I use it to create a voice activated music app ?
You would probably need to build or have the app already then plug this in @Deepak.
I see. the model was pre trained.
Make also a video of how to deploy phyton model in react
Heya @Chandan, phyton or python?
@@NicholasRenotte like if we make our own custom model in photon and to use that model in our react project. I hope for your next upcoming video 🙂
@@sanchari_samaya hmmm, might need to look into it. Haven't worked with photon before. Mainly tfjs!
sir how to become a great datascientist like you
😊 I don't know if I'm that great but honestly my number one tip is to work at it every day, code something new and showcase it to the world!
i kid you not took me 2 hours to resolve fs error XD.. I'm soo dead inside, and some other error that occurred.. ahhh XD
how did you fix it? i have the same issue