Thanks for this. It gave a fresh new perspective on how to use this. And bro I'll suggest. Make videos in ur own voice as inthis for other vids as well.
@Falalfel I guess you must have already checkout out this video, showing how to create whatsapp AI agent: ua-cam.com/video/YnH3Q_1VOJY/v-deo.html You can update it to accept voice message and return voice response.
Thank you for the video. Excellent. I am curious why not user whisper API to convert audio to text and use openAI APIs to do the response for this specific usecase? Thank you
@ramp2011 Yes that's what OpenAI node is doing behind the scenes for transcribing the audio. We need an agent here instead of a simple openAI API call because we want to use additional tools and chat memory to prepare the final response.
Can we call this webhook from JS and do you have code available? After using the code I am getting The item has no binary field 'data' [item 0] on transcribing the audio.
@vinod_chauhan7 Yes, we can call it from JS code. You can find the code here: github.com/futurminds/voice-ai-assistant-wordpress-plugin/blob/main/js/voice-chat.js#L157
@SoloJetMan You could create another workflow (or update existing one to route to different flow) that would either create embeddings to vector store instantly, or you could write the user inputs somewhere (e.g google sheet) and have a cron running that checks for new entries every few min or hours and creates embedding out of them. Hope this answers your question.
@b.err.3401 Pricing is per token, details here (Audio models): openai.com/api/pricing/ Yes there a number of other ways to create Voice AI Agent. Will cover them in the upcoming videos.
@@FuturMinds Lets say i have a db of appointment and timings. And, if someone asks if an appointment is available in 4-430pm slot. I should be able to read from db and tell them a slot is availble and collect details and book his details against the slot.
@KarthickKalidoss Yes, you can do that with with existing n8n db nodes or via http nodes. It depends on which DB are you using. Best way to organize appointment is on google calendar. You can then use google colander node and check if slot is available. It becomes simplified.
Yeah theoretically n8n enables us to do almost everything voiceflow offers and much more. It may just require more number of nodes/steps and other services. Voiceflow is a managed service that enables you to create important and common agents easily and faster. If your use case and budget aligns with voiceflow, you should consider it in favor of avoiding headache to manage your own server and a number of services.
You can of course implement features provided by voiceflow in n8n. Though it may require more tooling and complex workflows. You can evaluate if that suits your requirements.
Very useful and no BS guide. Love it very much
Thanks @passion4z846
I will definitely give this workflow a try on my developer WordPress. Thanks Futur, Great Video!
Glad it was helpful!
Thanks for this. It gave a fresh new perspective on how to use this.
And bro I'll suggest. Make videos in ur own voice as inthis for other vids as well.
@HarshSharma-vm3nm I'm glad you liked it. Thanks for the suggestion :)
this is great. I'm going to use , but what would you recommend for a quick test without wordpress or domain?
@Falalfel You can use replit and convert that plugin code to equivalent python code. That's another way.
@FuturMinds I was thinking telegram or WhatsApp bot would be better for businesses
@Falalfel I guess you must have already checkout out this video, showing how to create whatsapp AI agent: ua-cam.com/video/YnH3Q_1VOJY/v-deo.html
You can update it to accept voice message and return voice response.
Thank you for the video. Excellent. I am curious why not user whisper API to convert audio to text and use openAI APIs to do the response for this specific usecase? Thank you
@ramp2011 Yes that's what OpenAI node is doing behind the scenes for transcribing the audio. We need an agent here instead of a simple openAI API call because we want to use additional tools and chat memory to prepare the final response.
@@FuturMinds Thank you so much for your response. That makes sense
Can we call this webhook from JS and do you have code available?
After using the code I am getting The item has no binary field 'data' [item 0]
on transcribing the audio.
@vinod_chauhan7 Yes, we can call it from JS code. You can find the code here: github.com/futurminds/voice-ai-assistant-wordpress-plugin/blob/main/js/voice-chat.js#L157
I'm getting the same error.
I heard you cannot use the https: , as such, google drive, in the locally hosted n8n, how true is that Sir??
@shillowcollins6392 I didn't really understood the question. Can you elaborate?
well done! how do you setup a flow where the user's input is the source of the knowledgebase?
@SoloJetMan You could create another workflow (or update existing one to route to different flow) that would either create embeddings to vector store instantly, or you could write the user inputs somewhere (e.g google sheet) and have a cron running that checks for new entries every few min or hours and creates embedding out of them. Hope this answers your question.
Hey. Thanks for this tutorial.
How much cost for OpenAI transcribe service ? Specially for this kind of use.
Is there any other alternatives ?
@b.err.3401 Pricing is per token, details here (Audio models): openai.com/api/pricing/
Yes there a number of other ways to create Voice AI Agent. Will cover them in the upcoming videos.
Awesome, I followed the build jus waiting to get into our wordpress hosting to add the plug-in... then let's see if this bad boy works.
how can I test it out in my whatsapp?
You can follow this to trigger n8n workflows from WhatsApp: ua-cam.com/video/YnH3Q_1VOJY/v-deo.html&lc=Ugzr0xcuGoFDlu495qd4AaABAg
If I have to use a database (like available appointments) to read and write, is there a plugin to connect?
@KarthickKalidoss Can you elaborate the use case? If you want to use database for better responses, you can use SQL Agent (if you have sql db)
@@FuturMinds Lets say i have a db of appointment and timings. And, if someone asks if an appointment is available in 4-430pm slot. I should be able to read from db and tell them a slot is availble and collect details and book his details against the slot.
@KarthickKalidoss Yes, you can do that with with existing n8n db nodes or via http nodes. It depends on which DB are you using. Best way to organize appointment is on google calendar. You can then use google colander node and check if slot is available. It becomes simplified.
thank youu can you create an apointment setter in n8n ?
@arijhajlaoui5219 Can you share more details on what kind of setter you are looking for? I'll create just that.
@@FuturMinds an appointment setter that book meetings
@arijhajlaoui5219 I have added this to my list. Stay tuned.
Great ❤can you share the workflow json ,
@takimdigital3421 Added in the description.
@ you are the best thank you
@@FuturMinds i can not find the link 😊
@@takimdigital3421 It's the first link in the description. drive.google.com/drive/folders/1MjV7BvJESX5oZmbc4X1azrD2xzTA5CKj
can n8n do everything voiceflow does?
Yeah theoretically n8n enables us to do almost everything voiceflow offers and much more. It may just require more number of nodes/steps and other services. Voiceflow is a managed service that enables you to create important and common agents easily and faster. If your use case and budget aligns with voiceflow, you should consider it in favor of avoiding headache to manage your own server and a number of services.
@FuturMinds I know n8n and I host my stuff. No rush either. So my question is if I I know n8n would I really need voiceflow?
I guess not but I was told otherwise
You can of course implement features provided by voiceflow in n8n. Though it may require more tooling and complex workflows. You can evaluate if that suits your requirements.