Dude your awesome! Although I've already started getting confused a couple parts ago, this is going to help soooooo much!! I love how you used your own voice or the dialogue bit, you rock !
FOR EVERYBODY THAT CAN'T GET LIP SYNC ON A HWM MODEL!!!! Right click on the animation set, got to show in element viewer, then click on AnimationSet. Then expand presetGroups. You will see 'Phonemes' is not there. Right click on presetGroups, then select Import Element... Go to the file path for the model (should be: game/tf/models/player/hwm) then tell it to look for all files. Select 'class_phonemes.pre' (instead of class there would be Scout, Soldier etc.).
INFO: This Lipsync-Guidevideo only works with TF2-HighPoly-Charakters...to make this Work on HL2-Characters like Alyx or Barney, select the model in the "Animation Set Editor", make a rightclick on the Modelname and search for the function "Show in Element Viewer", then select the Modelname again in the "Element Viewer"-section with a rightclick and activate "Create phoneme Presets based on HL2 FACS Controls". This will make "Phoemes extraction" work with Hl2 Models!!!
it appears im not the only one that got confused lol if you are having problems with lip-sync on a placed character model, it's because you need a HWM model instead of a regular one: in the model menu select the tf_movie folder or search HWM, and the 9 mercs should appear. HWM models are higher quality and have the mouth controls necessary for phoneme extraction. (I'd recommend using this from now on, these where the models used for the meet the team videos, and are much better than game player models)
it would be much more work to make software know the difference between languages, so no, it isn't. (think about how language speaking AI is really bad still, even in 2021) it works by listening to the individual sounds it hears and moving the mouth exactly where it should be to produce that sound. There is only one way the mouth can produce an S or Th or EE sound. There's only one way you can make an MM or VUH/ F sound. No matter what language you speak, we all use the same mouth and sounds. Lipsync ai works for all languages, however it will always require a bit of additional work to get the plosive and tongue movements just right, especially if it's a quickly spoken phrase.
Making mouth animations is more detailed and complex than I thought. But I didn't know automatic mouth animation was possible, this is a great feature.
When lipsyncing, be sure that the tab "Phonemes" shows up next to the "emotion" tab. If it doesn't show up, restart your SFM and try again. It works for me.
You must get the model under the hwm folder, so instead of player/engineer.mdl select the player/hwm/engineer.mdl These models are in alot more detail than the standard ones.
coming in here to say that with eyes, generally when trying to display emotion, it's better to turn off the target view factor entirely and animate eye movement from scratch, and when the eyes look at something in particular to use the viewtarget factor
Let me see if i can explain. Click the big plus symbol in the top left hand corner of the animation set editor. Click Create Animation Set(s) For Existing Elements. Click the camera of which is being used in the scene. scroll or type in scout and look for his character. Once you click on him and press ok he will appear in the Animation Set Editor and you can edit his motion, lipsync, and everything else about that character
For no reason, the lipsync stops in the middle of the dialogue (6 sec custom scout sound) I simply did the extract phonemes thing and the entire audio is within one scene and scout just stops talking with his mouth open and the audio still playing. Ok so the model was a recorded model and it looks like he stops when the recording originally stopped creating the still frame.
Trust me its not all characters. When you're selecting a model from the Animation Set Editor you need to make sure the model is from HWM. To be specific change your mod filter from "All Mods" to Tf_Movies. And the scout for example his file folder would be player/hwm/scout ! =] I had the same problem as you and this is how i learned
The more this guy teaches me about SFM, the higher chance I might be able to win in the Saxxy Award's Drama Catagory, that is, if I find the right voice actors.
The camera may be keyframed to move ideally in front of the scout or then the camera's animation set has been locked to with the scout's animation set so it moves correctly in front of the scout.
For everyone who don't have lower face and tongue, and if lypsinc doesn't work You're probably using wrong model, search on youtube "source filmmaker tip of the day replacing models" and watch the first video It must help
Some people have missing phoneme tabs with certain HWM models. Even if you add another model with the proper phonemes so the tab appears, you can not modify the phonemes for the original model.
try using HMW models, you can search them in the model menu. you are probably using player models, lipsync doesnt work in them (unless you record yourself)
When I extracted phonemes and applied them on a character, somehow it suddenly did not play any other animations at all apart from the lip sync. When I pressed "show sample points", I could see that the animations are actually present there, but visually a character just stands in a pose set by me originally and just moves his lips.
Yeah, it can be easy if you aren't completely savvy with the program. Many times you have to have a pretty steady hand to get things where you want and a bit of technical know-how will help in not making mistakes.
Funny thing I found: When trying to replace a model with a different one, the character's limbs go everywhere. This happens possibly because the pose for the model isn't meant for the others.
i cant get my character to do the lip sync and i've done every thing he did in the video the only difference is that i'm using a sfm model instead of a ingame one
Hey, I've been searching for a fix for this, I was having the same problem, but when you use the sfm model, type in hwm in the filter, and try again, if it still doesn't work restart the computer. Note: Source Filmmaker is still in beta so report any bugs, also restart will have to work.
im pretty sure when it becomes easy and "fluent" it would take much less time. I mean, the guy's trying to teach us, he isn't gonna go at his normal pace :P
I found the solution. Check with his "sound" tutorial. What I did wrong ( and I assume you too) was that I zoomed into the actual video clip, and put the sound there. Now, go check out the sound tutorial (#3 or 4), and see that he opens a separate worktable for sounds. Put dialogue in the "Dialogue" bit, show the waveform, and it should work! If you still cant get it to work, i reccomend re-doing the scene, following the sound totorial first, that's how I got it working. Hope it helps.
It won't work for certain models. There are 2 models for each character. For example, medic. The working one: player\hmw\medic.mdl The one that doesn't: player\medic.mdl
All of the people for who lipsync doesnt work : You should open the hwm model instead of the standart model when you create animation set for new model, worked for me ! The hwm model is in the "tf_movie" mod while the standart model is stored in the "tf" mod
Wait...so let me get this straight....if you record a sound clip and place it into the video, the model will try to lip sync it automatically?? CUZ THATS AWESOME!! Im probably just confused though :\
"It's like playing a Piano, it takes some skill to get it right!" It does? Well, I guess it does if you can't listen to a track and pick out the notes! :P (Also known as playing by ear) :P
Nice....now if only SFM would work for me. :( Whenever I try to play it now, it just says: "Not Responding", and never starts working. Even 5 hours later, it still does that.
Is there a way to zero things out? like in maya when you can grab the name on the slider you are adjusting and enter 0 and it will return to it's neutral state? So I can build a mouth shape with many different sliders, and when I move on to the make the next sound and I want to start from scratch with all the sliders in their neutral positions, I can just hit a hot key or something and everything returns to neutral? Thanks for the tutorials, they are a huge help :)
I got a question. I got a model, that doesn't have a face category, and it is stuck in unnknown, and has like 20 sliders for facial expressions... What do I do ther e?
FIX THE PHONEMES! Sometimes, when I make a new session, I spawn a spy. He has no phonemes! I spawned a hwm model, but it still doesn't have phonemes. And sometimes it does. Fix this, Valve!
ctrl+z is undo (only do this if the distortion was ur last action)... or right click on the audio file, then edit clip, then set timescale, and change the timescale to 1.0
OH I GET IT, it doesnt work on recorded player movements/models? eg the original running scounts + soldier? cause i wanted my soldier to say "if ya know whats best for ya, you best RUN" but theres nothing selectable in his scene
"G'job, buddeh."
-- RAITT, Bay
That part with turning your voice and words into the Scout's was awesome. Didn't think it'd be that easy!
Dude your awesome! Although I've already started getting confused a couple parts ago, this is going to help soooooo much!! I love how you used your own voice or the dialogue bit, you rock !
Hes a valve employee, these are official valve tutorials.
@@cruelyplayz a bit too late....
he is source film maker
@@TerrificToilet yeah just a tiny bit 🤏
6:30
Watch as a Blu Scout mystically turns Red, then back to Blu...
Demoman : *Bloodeh Spy*
I love how you dont have to do a word for word for frame animation for the mouth, the program already does it :D
Although not always. Sometimes it isn't smooth lipsync.
Ok thanks but everybody ate you going to the bathroom
@@Movie-xs4up what
@@Movie-xs4up what
@@Movie-xs4up Ah, you play Gacha. That explains everything...
goddamnit volvo, you forgot to say in the end "Also, save before exiting"
he said "dont forget to save your work"
FOR EVERYBODY THAT CAN'T GET LIP SYNC ON A HWM MODEL!!!!
Right click on the animation set, got to show in element viewer, then click on AnimationSet. Then expand presetGroups. You will see 'Phonemes' is not there. Right click on presetGroups, then select Import Element... Go to the file path for the model (should be: game/tf/models/player/hwm) then tell it to look for all files. Select 'class_phonemes.pre' (instead of class there would be Scout, Soldier etc.).
thank you so much
Still don't work
GIVE THIS MAN MORE LIKES
@@purplebanana1433 I forgot I ever even used SFM tbh
Auto lip sync! Yes! Finally! After all these years! This is incredible. The amount of good quality sfm videos will be overwhelming!
I know im late but didnt sfm release in 2012 the same time when this tutorial video got released, so it wouldn't be years it would be months lol
Did someone else noticed that the scout running in front of the pyro is red?
yus
OreMaster Animations This something they need to fix
Right-click on the scout in the animation set editor, then go to set skin and choose whichever one is the blue scout outfit.
i noticed that and found this thing called skin and i set it to skin 1 idk where it is tho
He forgot to set skin to blue on that scout
These tutorials are still very helpful 11 years later
nah
12 years later and they still
My god, thank you. Thank god I was able to import my animations onto the HWM model. I owe you!
INFO: This Lipsync-Guidevideo only works with TF2-HighPoly-Charakters...to make this Work on HL2-Characters like Alyx or Barney, select the model in the "Animation Set Editor", make a rightclick on the Modelname and search for the function "Show in Element Viewer", then select the Modelname again in the "Element Viewer"-section with a rightclick and activate "Create phoneme Presets based on HL2 FACS Controls". This will make "Phoemes extraction" work with Hl2 Models!!!
I know this was 11 years ago but thank you so much, I was literally doing this with Alyx and wondering why it wasn't working
@@uncheckable_vibe this was so long ago, i dont even remember writing the og comment xD Time flies ... glad this helped :)
it appears im not the only one that got confused lol
if you are having problems with lip-sync on a placed character model, it's because you need a HWM model instead of a regular one:
in the model menu select the tf_movie folder or search HWM, and the 9 mercs should appear.
HWM models are higher quality and have the mouth controls necessary for phoneme extraction. (I'd recommend using this from now on, these where the models used for the meet the team videos, and are much better than game player models)
i searched for HWM models and there is none. do i need to import them or smth?
I guess lip sync in Source Filmmaker is only for english dialouge?
it would be much more work to make software know the difference between languages, so no, it isn't. (think about how language speaking AI is really bad still, even in 2021)
it works by listening to the individual sounds it hears and moving the mouth exactly where it should be to produce that sound. There is only one way the mouth can produce an S or Th or EE sound. There's only one way you can make an MM or VUH/ F sound. No matter what language you speak, we all use the same mouth and sounds. Lipsync ai works for all languages, however it will always require a bit of additional work to get the plosive and tongue movements just right, especially if it's a quickly spoken phrase.
Making mouth animations is more detailed and complex than I thought.
But I didn't know automatic mouth animation was possible, this is a great feature.
When lipsyncing, be sure that the tab "Phonemes" shows up next to the "emotion" tab. If it doesn't show up, restart your SFM and try again. It works for me.
My God SFM is amazing.
This is loads of fun animating TF2 characters, the fact they taught animating your own models in uni was what put me off, because my models suck :p
You must get the model under the hwm folder, so instead of player/engineer.mdl select the player/hwm/engineer.mdl These models are in alot more detail than the standard ones.
This is such a good idea for Valve to release this software to us. Can't wait till the L4D2 resources are released to us!
"GOOD JOB BUDDY" Alright dude.
If you're referring the lipsync, it's not as complex as it sounds - usually you can just use auto-lipsync and a bit of smoothing to make it look good.
coming in here to say that with eyes, generally when trying to display emotion, it's better to turn off the target view factor entirely and animate eye movement from scratch, and when the eyes look at something in particular to use the viewtarget factor
Instructions unclear, broke my own jaw...
Let me see if i can explain. Click the big plus symbol in the top left hand corner of the animation set editor. Click Create Animation Set(s) For Existing Elements. Click the camera of which is being used in the scene. scroll or type in scout and look for his character. Once you click on him and press ok he will appear in the Animation Set Editor and you can edit his motion, lipsync, and everything else about that character
Damn i didn't know there are auto lipsync
For no reason, the lipsync stops in the middle of the dialogue (6 sec custom scout sound)
I simply did the extract phonemes thing and the entire audio is within one scene and scout just stops talking with his mouth open and the audio still playing.
Ok so the model was a recorded model and it looks like he stops when the recording originally stopped creating the still frame.
Trust me its not all characters. When you're selecting a model from the Animation Set Editor you need to make sure the model is from HWM. To be specific change your mod filter from "All Mods" to Tf_Movies. And the scout for example his file folder would be player/hwm/scout ! =] I had the same problem as you and this is how i learned
oh, so that might be why my demo isnt doing anything with his mouth
thx brodda :) you just saved me a lot of time.
The more this guy teaches me about SFM, the higher chance I might be able to win in the Saxxy Award's Drama Catagory, that is, if I find the right voice actors.
The camera may be keyframed to move ideally in front of the scout or then the camera's animation set has been locked to with the scout's animation set so it moves correctly in front of the scout.
If I may still say it more straight, the camera's animation set is "bonemerged" when animation set is locked with another animation sets parts.
need new version tutorial
likes to VALVE try to see me
I'm glad I self taught myself how to manually lip sync and edit the face to my likings
For everyone who don't have lower face and tongue, and if lypsinc doesn't work
You're probably using wrong model, search on youtube "source filmmaker tip of the day replacing models" and watch the first video
It must help
LA Noir: We require 15 HD cameras to make our facial animations badass!
Valve: What cameras?
i can hear a sound but my charachters lip also closed
same
wat! SFM has autolip-syncing :O GOD FREAKIN AWESOME!
The voice he did for the scout kinda sounds like his voice actor, but not imatating the scout...
Some people have missing phoneme tabs with certain HWM models. Even if you add another model with the proper phonemes so the tab appears, you can not modify the phonemes for the original model.
i cant get this to work with any other modesl, but the only have I and O sliders, any tips?
try using HMW models, you can search them in the model menu.
you are probably using player models, lipsync doesnt work in them (unless you record yourself)
thank you for late responce, i did find a work around @@PyroCheeses
I extracted the line, but my spy isn't talking.
cant find any hwm characters
Mr Lenny is it. An wav? Sync only works if you use wav files.
same
It will work if you selected the desired audio, and it must be a WAV.
Did you make the spy happy, mad or frown? Cut if you did he won't lip sync
Does the automatic lipsyncing only work for recorded players? Can't get it to work with a model of the Scout.
Thanks man. Didn't realize I was using the wrong model. Now I have some help with the lip sync!
Valve has created something revolutionary - again.
Good job buddy!
You have no idea how hard it was not to skip to this part XD
You have no idea how this is super broken.
1:19 Made me laugh so hard "good job buddy!"
this is the feature I'm most excited about.
Wait, when he recorded his voice, the SFM AUTOMATICALLY synced the Scout's mouth with the recording? YUS!
Later on, when I got pretty good with SFM. I realized that not all models work and only certain Valve ones do.
Meanwhile, in Valve, a couple dozen employees are wondering how the hell ponies are suddenly more important than the video.
I'm so excited about this whole thing! Watch the portal 2 boots trailer to get even more excited about this!
When I extracted phonemes and applied them on a character, somehow it suddenly did not play any other animations at all apart from the lip sync. When I pressed "show sample points", I could see that the animations are actually present there, but visually a character just stands in a pose set by me originally and just moves his lips.
i wish he told us that the lip sync doesn't work for the placed models like the pyro. took me like 20 minutes to realize
wait pyro has a mouth?
Yeah, it can be easy if you aren't completely savvy with the program. Many times you have to have a pretty steady hand to get things where you want and a bit of technical know-how will help in not making mistakes.
Funny thing I found: When trying to replace a model with a different one, the character's limbs go everywhere. This happens possibly because the pose for the model isn't meant for the others.
+Jamesthe1 {[Minecraft, Music, and more!]} you can fix that by right clicking the model and click *Reattach to Model*
i cant get my character to do the lip sync and i've done every thing he did in the video the only difference is that i'm using a sfm model instead of a ingame one
Hey, I've been searching for a fix for this, I was having the same problem, but when you use the sfm model, type in hwm in the filter, and try again, if it still doesn't work restart the computer. Note: Source Filmmaker is still in beta so report any bugs, also restart will have to work.
"Good job, buddy!"
im pretty sure when it becomes easy and "fluent" it would take much less time. I mean, the guy's trying to teach us, he isn't gonna go at his normal pace :P
I cant click on 2 control groups. as soon as i click on one, the other one is not highlighted any more
If you're still having this problem just hold shift while clicking on the tabs.
That's because LA Noir uses actors. Valve uses science! Thank you to Dr. Paul Ekman and FACS!
I found the solution. Check with his "sound" tutorial. What I did wrong ( and I assume you too) was that I zoomed into the actual video clip, and put the sound there. Now, go check out the sound tutorial (#3 or 4), and see that he opens a separate worktable for sounds. Put dialogue in the "Dialogue" bit, show the waveform, and it should work! If you still cant get it to work, i reccomend re-doing the scene, following the sound totorial first, that's how I got it working. Hope it helps.
It used to take 3d animators days to make their character's mouths move, now its like...pow
Actually the problem was in Meet the Heavy, only one audio track even works period.
I can't thank you enough. Thank you sir!
I was getting ready to spend 30 months lip syncing for "RUN COWARDS!", but it's just does it automatically? Good god :U
Yup, you right, i have this problem too now :(
This is insane automatic lip sync i love it
It won't work for certain models. There are 2 models for each character. For example, medic.
The working one: player\hmw\medic.mdl
The one that doesn't: player\medic.mdl
I hope you remember someone made a Spitfire model for Source.
its like character customization in a bethesda game
Yepp, not working for me either. Does it require any of that BS that Faceposer needs? I had massive problems with that as well.
All of the people for who lipsync doesnt work : You should open the hwm model instead of the standart model when you create animation set for new model, worked for me !
The hwm model is in the "tf_movie" mod while the standart model is stored in the "tf" mod
Even if it does have to do with ponies, remember that the pony's wife is cheating on him and he is drunk all the time. But don't tell that to him
Automated lipsync? Good god, that's badass
The more I see, the more I want this.
Thanks works for me, also please update sfm so it runs a newer version of tf2 (currently it is a 2008 version) and fix the many bugs
When I extract phonemes, after showing the waveform of my desired dialogue, no lip sync occurs at all. :c
Wow. I´m glad it still works for me
Might wanna watch the Graph Editor tutorial, it's the same for props and models.
Well, technically it was an inflatable balloonicorn. But your point is still valid.
Wait...so let me get this straight....if you record a sound clip and place it into the video, the model will try to lip sync it automatically?? CUZ THATS AWESOME!! Im probably just confused though :\
Last tutorial-scout is red
This tutorial-scout is blue
I think he left something out...
it just wont work! I don't know why, i cant find any explanation! Everything works fine, but after you press extract, NOTHING happens! Please help me!
"It's like playing a Piano, it takes some skill to get it right!" It does? Well, I guess it does if you can't listen to a track and pick out the notes! :P (Also known as playing by ear) :P
How strange. :o
biggest problem I have with SFM is that it crashes rather often.
Is the recorded sound programmed to blend in with the class voice?
6:29 blue scouts
6:31 red scout o.O
6:32 blue scouts
good job buddy :P
Nice....now if only SFM would work for me. :( Whenever I try to play it now, it just says: "Not Responding", and never starts working. Even 5 hours later, it still does that.
Is there a way to zero things out? like in maya when you can grab the name on the slider you are adjusting and enter 0 and it will return to it's neutral state? So I can build a mouth shape with many different sliders, and when I move on to the make the next sound and I want to start from scratch with all the sliders in their neutral positions, I can just hit a hot key or something and everything returns to neutral? Thanks for the tutorials, they are a huge help :)
Is it any good? I.e. worth checking it out to get familiar or did they change a lot of stuff?
I got a question. I got a model, that doesn't have a face category, and it is stuck in unnknown, and has like 20 sliders for facial expressions...
What do I do ther e?
Lipsync for the Pyro?
CHALLENGE ACCEPTED.
if anyone is saying "MY PRO WON'T MOVE HIS MOUTH" HE HAS A GAS MASK NOT A MOUTH
FIX THE PHONEMES!
Sometimes, when I make a new session, I spawn a spy. He has no phonemes! I spawned a hwm model, but it still doesn't have phonemes. And sometimes it does. Fix this, Valve!
@Jmv 871 it plays the audio file, not the sounds of it
***** well jeah... it is google plus...
One problem I have is the fact that for some reason the Medic and Spy have no lower face category..
ctrl+z is undo (only do this if the distortion was ur last action)... or right click on the audio file, then edit clip, then set timescale, and change the timescale to 1.0
OH I GET IT, it doesnt work on recorded player movements/models? eg the original running scounts + soldier? cause i wanted my soldier to say "if ya know whats best for ya, you best RUN" but theres nothing selectable in his scene