Part 3 Adding Animations And Lip-sync
Вставка
- Опубліковано 3 кві 2023
- Part 3 of the tutorial series for setting up the Convai UE plugin for Conversational Characters.
Full Playlist here - • Convai Unreal Engine I...
Tutorial Project here - drive.google.com/drive/u/4/fo...
Extra plugins here - drive.google.com/drive/u/4/fo...
Sign up at convai.com to create your own character.
Find the UE plugin here - www.unrealengine.com/marketpl...
Write to us at support@convai.com for any queries, bug reporting, collab, or business-related engagement.
Discord: / discord
LinkedIn: / convaitech - Ігри
🛑 Important update for MetaHuman lip-sync for plugin version 3.0.0 or later: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/creating-metahuman-characters/adding-lipsync-to-metahuman-from-plugin-version-3.0.0-or-later
I've gotten everything working great. This is really amazing. However, my metahuman NPC is stuck in the Idle animation. The lips are syncing, the bodyAnim is applied and the idle anim working. But they can talk for an hour without doing anything really. I have actions enabled for the project and the character. Using UE 5.3.4 Until it's updated for 5.4. Any suggestions?
Hi@@Sakur.aiMusic, you can use our Actions sample project: drive.google.com/drive/u/1/folders/1UWgQMHTTSq4O45PtKCyr8sjZbbkq-2_o
As a guide to compare from, could be something very simple like the navigation mesh not properly working.
Hello, thanks for the tutorial! I just discovered this and it's amazing what it can do! I'm currently using the latest plugin version with the latest UE 5.2. I like the new chatbox appearence much better than the green one, however, I do like to customize it further - for example adding logos or even just moving it around the UI so it doesn't cover my existing icons. How can I do that please as I seached everywhere for an answer. You prompt response is highly appreciated!
Thank you for your request. Feel free to join us on discord for more discussion: discord.com/invite/Ws37cTZGWC
We have a channel specific to UE
@@convai please make a video on the Ui or Widget for youtube. I don't enjoy using discord. thank you!
in your character blueprint if you edit the conviaplayer blueprint you can see the functionality of the ui and by pressing F10 and messing with the setting you can get a feel for how you can customize it slowly. I still would rather just edit the widget though, and cant find out how to do that yet.
does this work for UE 5.2 ? the latest version of lipsync available is for UE 5.1
Yes, the ConvaiOVRLipSync plugin is available on the drive link for UE 5.2
Did you guys setup lip sync with Audio2Face yet? Or is this in the pipeline?
We are working on something :) stay tuned
Hello, the lipsync looks pretty rough... has it been updated? Is there a way to simple use the output text with a different Text to Lipsync option? Also, please do a tutorial on how and what the options are for high end output, customer animations, emotional animations, etc... How to make it all better...
We are working on more lipsynch and will be improving this!
I'm getting "Linked graph node Control Rig has no valid instance class to spawn." in the convai_metahuman_faceanim blueprint ever since I updated to UE5.3, any ideas?
Edit: Re-installing the lip-sync plugin fixed it!
ConvAI could not be compiled. Try rebuilding from source manually.
My UE release is 5.2
Is there an update for Mac yet with the lipsync plugin? Working on an Mac Mini M2 and the other features work great!
Hello, lipsync for Mac is supported by using the FaceSync component, the OVRLipSync plugin is no longer required which caused issues with Mac.
Hi, the Convai base plugin returns a error when I try to rebuild? I'm using UE 5.1. I've copied the "Convai" folder into my Plugins forlder of the project?
Hello,
The plugin should work out of the box without needing to be rebuilt. If you're encountering errors while trying to build the plugin for a custom engine build, please share the error with us via our support email support@convai.com. We'll take a closer look and assist you further.
Hi, i upgrade the project to UE 5.2 and import a new metahuman but OVR plugin for lipsync not working, Log "LogOvrLipSync: Error: Can't initialize ovrLipSync: -2204"
Hello, sorry to hear you are having issues. You can message us at support@convai.com
Same problem here. How can I fix it?
Hello, this is not yet available for Mac? my meta work, but no lipsynch...
I have the same problem, until I understand that the Plugins folder is not inside the "Content" folder, is outside!! And this copy is made outside UnReal! Try this! Worked
@ the plugins folder go into the project folder, but i am on mac, they reply the plugin is not ready yet
@@diegobevilacqua4407 I wanted to clarify that we are actively working on supporting the LipSync functionality for the Mac platform. We've encountered a few challenges along the way, but rest assured, we're committed to making it available in due time.
Is there a lipsync version for mac jet?
Still working on it, should have a version up in the next two weeks, and it will be designed such that no extra plugin is required to be installed
hello, please tell me how to make the widget not always displayed, and when I approach the NPC, and when I leave it disappears, how to do this? Help
Join us on discord and we can discuss that there: discord.com/invite/Ws37cTZGWC
@@convai can you explain it here to please
hi there is this project still working since i have the face animations but not the lips sinc also the chat bot tutorial don't work anymore it seems outdated btw thks for your work
Hi, it is indeed deprecated but the video still have some insights that could help in some cases, we advice that you do not use the lipsync in the video but instead use the FaceSync component here:
docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/creating-metahuman-characters/adding-lipsync-to-metahuman-from-plugin-version-3.0.0-or-later
Hello, I connected convai and interacted with my metahuman character, but it does not make lip animations and I tried the plug in in convai's own documentation, but I can't get results. can you help?
friend, a mistake that is made sometimes is that one gets confused with the folder icon and adds the folder without extracting it, sometimes inside there are also folders that have to be extracted, check, it could well be that and be careful with the version
Hey, could you quickly elaborate on the steps you did to add LipSync? Just make sure that you have the ConvaiOVRLipSync component added to the metahuman blueprint
I added my Metahuman character from Quixel Bridge, entered the Bp of the character and selected the convai character from the class setting (I also selected convai player from the third person section), then I selected the body in the companents section and selected convai_metahuman_bodyanim in the anim class section, my next step was to select the face section and select convai_metahuman_face anim in the anim class section.
it was able to communicate with my character and it was following me with its head, my next step was to install the convai Lip-sync plugin as you mentioned in the video and add ConvaiOVRLipSync from add new companents, as a result my lip movements still didn't work
my engine version is 5.1 and my plugin version is the same as the engine version @@convai
Update: I tried the methods I mentioned on version 5.2 of my friend's computer and the result was successful, unfortunately I still can't get results on version 5.1.
@@msalihkara8003I'm having a challenge replicating the issue you mentioned on our end for UE 5.1. Could you please send us an email with the output logs after interacting with the character? Also, make sure you've downloaded the correct Convai OVRLipSync plugin that corresponds to UE 5.1.
hi my metahuman dont play anim body while talking, the lypsyn is work perfectly but the body just do not thing
It happens to me also
Hi @linhphamarts1532 and@@4yiphayiph, if the body animation is not working that could mean that the animation blueprint is not set correctly over the MetaHuman body skeleton.
It works but my metahuman keeps looking at the floor, occasionally she looks up
support chinese?
We have support in our betta version