Unreal Engine 5 Speech Recognition (Sphinx-UE4 Plugin)
Вставка
- Опубліковано 4 гру 2022
- You asked for it, so here it is!
Little tutorial on how to use the Sphinx-UE4 Plugin in UE5, for speech recognition! Sorry for the crappy quality, I'm not really equipped for making videos.
Twitter: / waxolp
Twitch: / waxolp
Links for resources in video:
Instructions: unrealcommunity.wiki/speech-r...
Demo Files: nerivec.github.io/old-ue4-wik...
Github repo: github.com/ukustra/sphinx-ue4
UE5 doc for how to install plugins: docs.unrealengine.com/5.0/en-... - Ігри
Brilliant stuff! I look forward to trying this out soon, thanks alot!
It's Cool! Also looking forward to you updating your VR game related videos.
You just gave us the greatest tool to make an epic Global Game Jam 2023 entry, thank you from the Support Squad
Let me know how it goes!
Got it working! Thank you so much!
Omg I'm so glad to this video is uploaded😇 thanks for your kindness
Thank you so much!
Hello, i have a problemI can't get it to work on android, the errors I get are -
Source/SpeechRecognition/Public/SpeechRecognition.h(81,16): error: assigning field to itself [-Werror,-Wself-assign-field]
Source/SpeechRecognition/Public/SpeechRecognitionWorker.h(3,10): fatal error: 'sphinxbase/err.h' file not found
Hey! I liked this video! this is something I had been looking for, and you did an awesome job of explaining the whole setup and the various nodes! I appreciate the video, and I'll be checking back in on your YT in case you find any more of these cool niche goodies!
Thanks man! Appreciate the comment! Currently building a new PC so I can develop more with VR, my current PC is really struggling. Hopefully I'll have more cool things to share soon! :)
@@Waxolp I'm tryin to get it to work on the quest 2, but when I'm launching it, I'm getting a plugin error, I did what it said in the documentation, but what all did you have to do to get that to work?
@@SicoSiber Oof, good question. I only tried it with my Vive, so to be honest I don't know how to help. Can you try just running it without a VR pawn, maybe just in 1st or 3rd person?
@@Waxolp I got it working with first and third person, the plugin is just on the struggle bus when I try to export it, but it just might not support android yet 🤷♂
Thanks for the info though, and keep up the good work!
Hi, when changing GameState, the game does not work in the client. Is there any way we can use this plugin without changing GameState? Or can we combine the previous GameState with the SpeechRecognitionState class?
Hi! How to set up microphone for speech recognition?
Hi, I rebooted the UE5 project after placing both the SpeechRecognition folder and the model folder in their places, but with the following error: "Missing myproject Modules The following modules are missing or built with a different engine version:
SpeechRecognition
Would you like to rebuild them now?" . There are two options: yes and no. After I click yes, error still appears: "myproject could not be compiled. Try rebuilding from source manually." Could you please tell me how to solve it? (I use a Macbook pro M1 pro, UE 5.0.1, and "myproject" is myproject name)🥲🥲🥲
Hi! How can I check if microphone is connected?
I have a problem when trying to open a project
"could not be compiled try rebuilding from source manually"
Hey, when I compile, I get an error: Building patch from 1 file(s) for Live coding module C:\Users\iGamer-EPIC\Documents\Unreal Projects\MMORPG\Plugins\SpeechRecognition\Binaries\Win64\UnrealEditor-SpeechRecognition.dll
Could not spawn process C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.34.31933\bin\HostX64\x64\link.exe. Error: 267
Thanks for the upload, would appreciate a higher resolution than 360p tho.
That's weird, you should be able to have 1080p...
@@Waxolp I'm only getting 360p. Tried in two browsers.
@@wolfsdendogsanctuary731 Yeah don't know! I tried in Incognito mode and I still see all the qualities up to 1080 :s
hello, does this work on 4.26?
cool stuff
Always when i press T in UE 5.1.1 Its write me an error.. i put api and all needed.. but its look its cant get my voice or something
and when we export the game, will it works ? :/ like build the game
I can't seem to get anything from any "Bind event to" Node, no debug is printing at all. This is also true no matter the word or tolerance. I'm pretty certain my mic is working because I also have proximity voice chat working in the game. Any ideas? I followed this tutorial more or less to the letter in version 5.1.
Do you see all the other nodes? If so, that means at least the plugin is installed. If not, I would redo those steps. If you have the Speech Recognition Subsystem node, did you try pulling off that one to get the "Bind Event To" Node? Make sure you also have the GameState properly set in the project properties!
Plugin is installed, I have the subsystem node and Bind event to on Words Spoken. Project properties is set up same as tutorial. Is there anything else possibly simple I am missing, After creating an actor with Bind word spoken event I am just dropping it into my scene. Is there maybe some box I haven't checked to initialise the code in the scene or something?
I have a bug, I am told: The SpeechRecognition plugin was designed for build 4.9.1 Attempt to load it anyway?
i said yes and : The following modules are missing or built with a different engine version
I said yes again and : "myproject" could not be compiled try building from souce manually
How do I resolve this???
Really want to try it but i sucks at making stuff in UE😞😞
It did not work for me, is there an example project download for ue5? All examples I found were ue4.
Can you use this as well for speech recognition with a metahuman
Sure.. the plugin works as a stand-alone. You can use the events generated from the speech recognition to trigger anything, including interactions with metahumans. You just need to refactor the code to work how you want
I copied the code exactly as shown in the video, but when I test it I can't get anything to print verifying it understood what I said. I'm also not getting any errors. The only thing I can think of that may have caused an issue is that when I tried extracting the files it gave me an error saying "The same volume can not be used as both the source and destination" so I extracted it into a different drive and dragged the English model over(it was the only on that extracted) and followed the steps from there. Sorry that's alot but if anyone has any idea what I did wrong I'd appreciate it.
finally fixed the issue, it WAS an issue with the model. I had to install the premade version just to copy over the models into my game and it FINALLY worked. Man I thought I was going nuts.
@@christianbellamy8726 haha happy it worked man! Thanks for letting us know in case others have similar issues!
@@Waxolp yeah fs, I didn't want to delete it in case someone else started goin through my troubles lol
To anyone getting the "The same volume can not be used as both the source and destination" error and unable to extract any of the files, try using 7-zip to extract it. I was able to extract everything when once I finally used it.
Thanks for the tutorial, I made a new game state and used it with my existing game mode seems to work the same . In the game state I actually didnt configure nothing I changed from the details settings you mentioned the words I want works fine also same as with mannual integration like you did . My issue is I want to use this plug in for words that dont exist in the dictionary . I've added the words to the english en.dic file with the phonetics used by sphinx but it just doesnt recognises it. Any tips how to add new words I could try out for my project ? this is the word I added in the en.dic : lumoss L UW M OW S
I followed every steps but still not work, there is no text come out when I speaked to them😢😢😢
Hi, Waxolp,everything was done according to your process but it didn't work, and I don't know what's wrong.
What I would have done if I just wanted to translate what I said.
i dont know why it isn't working :(
It works when I make a game, but once I build as exe it disappears.
Bump, would like to know this too.
Good to put an AI Assistant inside your game, thats my idea
It works in ue 5?
yes!