Unreal Engine - Improving Audio2Face Lip Sync with Metahumans Tutorial

Поділитися
Вставка
  • Опубліковано 12 вер 2024

КОМЕНТАРІ • 37

  • @ClydiieTwo
    @ClydiieTwo Рік тому

    PLEASE if you havent already I would LOVE a clean up tutorial I guess it wouldnt be the most entertaining vid but its something that I personally could learn so much from. Thank you!

  • @LFA_GM
    @LFA_GM 2 роки тому +1

    Great workflow, well done. Thank you for sharing.

  • @antoniopepe
    @antoniopepe Рік тому

    Great TIPS ... thanks for sharig

  • @sabkarim
    @sabkarim Рік тому

    Awesome, thanks for the tutorial!

  • @natashaavellaneda6218
    @natashaavellaneda6218 Місяць тому

    How do you set the localhost? it doesn't appear to me

  • @jumpieva
    @jumpieva Рік тому

    hmm i am in 2022.2.1 now and 'source shot' with the presets is not there. it's a bunch of individual emotion sliders but i assumed the presets had a lot of these preconfigured. any insight on this?

  • @christiandebney1989
    @christiandebney1989 Рік тому

    i cant see any wav files when i try to load my own

  • @user-DEV_V
    @user-DEV_V 8 місяців тому

    how can I implement lip-sync for chatbot? I have tried using MetaHumanSDK, but now they have make it a paid plugin. I needed an alternative, is there any other option available?

  • @reza84tr60
    @reza84tr60 2 роки тому

    Perfect

  • @imai_official
    @imai_official Рік тому

    ​ @Small Robot Studio Hello how're you? can you make .exe file that Lip Sync with Metahumans we are ready buy this project.

  • @Instant_Nerf
    @Instant_Nerf 2 роки тому

    So right now you have to use maya to import into unreal 5 or is that used for cleanup? Unlike u real 4 .. you could just make a folder in content and import facial animation.. but it’s not the same in UE5 .. uhhh so complicated

    • @SmallRobotStudio
      @SmallRobotStudio  2 роки тому

      Not sure if you can go from Audio2Face right into Unreal currently - I wouldn't personally as I prefer to do animation cleanup in Maya.

  • @MPRGetProfit
    @MPRGetProfit 2 роки тому

    How to add this type of animation in flutter apps

  • @mekanikmusik
    @mekanikmusik 2 роки тому

    So there is no way to do this on a Mac? 🙁

  • @hitlab
    @hitlab 2 роки тому

    Does anyone know if there is a comparable script/work flow for 3ds max?

    • @Amelia_PC
      @Amelia_PC 2 роки тому +1

      Not yet. I'm a 3ds Max user (since 2009) and I'm pretty sure they'll create a script for Blender before. Just our luck -__-

  • @MonsterJuiced
    @MonsterJuiced 2 роки тому

    Is there a way to apply improved lip syncing onto a metahuman that was already recorded inside unreal engine? I used the take recorder to record the metahuman and audio, but the lip syncing is poor.

    • @SmallRobotStudio
      @SmallRobotStudio  2 роки тому

      Just within Unreal or are you doing the touch-ups in Maya?

    • @MonsterJuiced
      @MonsterJuiced 2 роки тому

      @@SmallRobotStudio Just in unreal, it would be too messy to do the touchups through exporting the model with animations and then re-importing them I think. Due to the way I've recorded, I don't think it saved an animation file for the mesh that I could tweak (I haven't looked yet I was in a rush when capturing), when I want to play back the takes, I open the animation sequence and then it spawns in the metahuman and plays back the animation that way.

  • @ToddHillerich
    @ToddHillerich 9 місяців тому

    There must be a solution to drive the mouth movement with proximity chat.

  • @nicksushkevich
    @nicksushkevich 2 роки тому

    Interesting. I wonder how did you manage to apply metahuman grooming to your mesh

    • @SmallRobotStudio
      @SmallRobotStudio  2 роки тому

      This is just an "out of the box" metahuman so it's the standard groom that it comes with. I'm working on a tutorial for doing custom grooms and exporting them to Unreal for use with Metahumans so look out for that next week hopefully :)

    • @nicksushkevich
      @nicksushkevich 2 роки тому

      @@SmallRobotStudio Thank you! Thought you've managed to put your scanned and retopologyzed head back to Metahuman in Unreal.

  • @ClydiieTwo
    @ClydiieTwo Рік тому

    how do you import the audio 2 face file to maya?

    • @SmallRobotStudio
      @SmallRobotStudio  Рік тому

      Check the tutorial I released before this one on the topic

  • @the_end_boss
    @the_end_boss 2 роки тому +1

    Someone needs to build a plugin that matches the shape mouth settings in UE5 Metahumans to the English phonemes that allows you to import an audio file or TTS synthesis and automatically rig the character.

    • @SmallRobotStudio
      @SmallRobotStudio  2 роки тому +1

      You could always create blendshapes on the controller to automatically get those visemes

    • @KelechiApakama
      @KelechiApakama 2 роки тому +2

      Working on one now, my friend.... Should hopefully hit the marketplace at some point

    • @Instant_Nerf
      @Instant_Nerf 2 роки тому

      @@KelechiApakama cool man .. can’t wait.

  • @Amelia_PC
    @Amelia_PC 2 роки тому

    Have anyone tried to export it from Maya to Unreal (like, right after completing this tutorial)?

    • @SmallRobotStudio
      @SmallRobotStudio  2 роки тому

      I have another tutorial on the channel for how to do this - look at the Maya and Unreal Metahumans import/export video

    • @Amelia_PC
      @Amelia_PC 2 роки тому +1

      @@SmallRobotStudio Ah, that one! I thought it was a different process. If I can use that tutorial right after this tutorial, it'll be easier than I thought. thanks!

    • @SmallRobotStudio
      @SmallRobotStudio  2 роки тому +1

      @@Amelia_PC yep just skip to the part where I export the facial controller rig

    • @Amelia_PC
      @Amelia_PC 2 роки тому

      @@SmallRobotStudio Thanks! (yup, it wouldn't make sense to export the facial controller because the face animation should be loaded on Sequencer :D )

  • @aitrends8901
    @aitrends8901 2 роки тому

    Is there any automatic / programmatic way to control face rig / lip sync on the fly when an audio file is provided ?

    • @SmallRobotStudio
      @SmallRobotStudio  2 роки тому

      In audio2face? Not to my knowledge, this is pretty much the breadth of it

    • @aitrends8901
      @aitrends8901 2 роки тому

      @@SmallRobotStudio Thanks for your reply and did I say, your video is great help ! :)