Real-Time Matchmoving and Green Screen Compositing in Blender 4.0 is the BEST
Вставка
- Опубліковано 29 чер 2024
- Blender has some really amazing tools for matchmoving, tracking and compositing. In this video we'll go over how to add a green screen keyed actor in your CGI HDRI Maker 2.0 environment using import images as planes, animate the camera movement in real-time as the animation is playing, refining the animation using sample keyframes and soft keyes which is exactly what I did for this scene shot in the music video "Hero" for Norwegian singer and artist Raylee.
In the scene she sits on the hood of a DMC DeLorean from the film Back to the Future and sings playback with the camera moving around in the scene, all composited directly in Blender. A great and easy way of creating a cool sync shot for a music video, short film etc by blending live action green screen chroma keyed footage into your CG environment.
It's more of a brief overview of how I created this scene, but I hope you learn something from it. 😊
Links mentioned in video:
DeLorean model: bit.ly/3lVN7rW
HDRI Maker 2.0 addon: bit.ly/3pnSz99
💡 00:00 Intro to video
💡 00:15 tiedtke.
💡 00:21 Overview
💡 00:35 Keying in After Effects
💡 01:31 Export for Blender
💡 02:02 Composition
💡 03:25 Import pre-keyed Green Screen footage
💡 05:30 HDRI Maker Addon
💡 06:00 Improving imported footage
💡 07:15 Real-Time Matchmove
💡 11:02 Outro
Thanks for watching, if you like the video feel free to like and subscribe for more tutorials on #blender #editing and #3d
Follow my journey to become a Layout, Modeler and Lighting 3D artist working in the industry.
𝗖𝗼𝗻𝗻𝗲𝗰𝘁 𝘄𝗶𝘁𝗵 𝗺𝗲! 🖐️
🔸 ARTSTATION - www.artstation.com/tiedtke
🔸 IG - / tiedtke
🔸 LINKEDIN - / tiedtke
🔸 FB - / tiedtkeio
🔸 PORTFOLIO - www.tiedtke.io
𝗟𝗼𝗼𝗸𝗶𝗻𝗴 𝘁𝗼 𝗯𝗲𝗰𝗼𝗺𝗲 𝗮 𝗽𝗿𝗼 𝘃𝗶𝗱𝗲𝗼𝗴𝗿𝗮𝗽𝗵𝗲𝗿? 😍 𝗛𝗲𝗿𝗲'𝘀 𝘄𝗵𝗮𝘁 𝗜 𝘂𝘀𝗲 𝗳𝗼𝗿 𝗺𝘆 𝘄𝗼𝗿𝗸.
💻 𝗦𝗼𝗳𝘁𝘄𝗮𝗿𝗲:
🔸 Adobe Premiere Pro
🔸 Autodesk Maya 2022
🔸 Blender 3.0
🔸 Adobe After Effects
🔸 Adobe Photoshop
🔸 Foundry Nuke
🔸 DaVinci Resolve
🎥 𝗖𝗮𝗺𝗲𝗿𝗮𝘀:
🔸 Sony Alpha A7S III
🔸 Insta360 One R
📷 𝗟𝗲𝗻𝘀𝗲𝘀:
🔸 XEEN 16mm T2,6 Cinema Prime
🔸 Sigma 24-70mm 2.8 ART
🔸 Takumar 135mm F3,5 M42 mount
🔸 Helios 44-2 58mm F2 w/ M42 to EF adapter
💡 𝗟𝗶𝗴𝗵𝘁𝘀:
🔸 Aputure LS 300D
🔸 Aputure LS 120D II
💻 𝗘𝗱𝗶𝘁𝗶𝗻𝗴:
🔸 AMD Ryzen Threadripper 5800X
🔸 NVidia Geforce GTX 3090
🔸 NVidia Geforce GTX 1080 TI
🔸 Logitech MX Master
🔸 Microsoft Designer Keyboard
💾 𝗦𝘁𝗼𝗿𝗮𝗴𝗲:
🔸 LaCie 4TB Rugged Portable HDD
🔸 Sandisk 128GB 170mb/s SD card
🔸 Prograde 128GB V90 300mb/s SD card
I've worked 8+ years as a Director of Photography in Sweden, working on projects ranging from feature films to commercials and music videos. Currently studying at Visual Magic in Skellefteå, Sweden. Years active in the 3D industry is about 1 year. Focusing on 3D modeling, layout and lighting which is my passion.
✉️ For any business inquiries, email me at michael@tiedtke.se
👋 For any personal questions DM me at tiedtke
would love to see a more detailed method for your keying method, thanks for the video!
Thank you for watching Lee! Glad to hear, then I'll make sure to make a detailed video about keying. 😊
@@tiedtkeio I would love to see this too!
@@PeterNeill Sweet! 🙏
same
@@tiedtkeio Yes, totally would help a lot
This is not match-moving. Match-Moving is when you match a 3D Object, the car, to a real object, real car, usually moving on set. This is more... texturing.. maybe texture/camera projection. 2.5D Compositing. Nice end result though.
Yeah, it would've been nice to know that before the 7 minute mark...
Exactly, but if it looks like a duck and quacks like a duck ... What's amazing is that it takes a static 2D shot and applies 3D camera moves to it without losing realism. It makes the CGI artist the director of photography, sort of. Had the director done all the camera moves "live", not only would it have required a choreographed dolly crane ballet on set and the CGI artist would have had to painstakingly matchmove that, there would be very little flexibility to change the movement later. Here, you get the same effect with a lot less work (both on-set and in Blender) and the director could decide to have the camera bob up or down or weave left on a certain beat, faster here, slower there ... all in post. That's brilliant.
yeah, it’s just a 2d card rendered in 3d where the footage is an asset. match moving requires “matching” cameras as the name suggests.
If you have to consider, workaround, or otherwise incorporate three axis in the work, it is 3D.
Period.
Opinions on this are irrelevant.
Yeah, there was a certain vital camera solver lacking in this so called matchmove.
Incredible! I will be trying this out at some point in the future for sure! :D
Awesome! Please do so! 😍
Great as always!
Great tutorial, a quick observation... if you want a fast playback. Don't go to "render view", use the "solid view" to view the image on the plane, use the drop down menu where you can change the "studio, flat, random and material" setting, you will see an option to choose "texture"... (I'm talking about the drop down button on top the axis gizmo)
If you choose texture, you will be able to see the image on the plane, in the solid view. And the playback will be faster. Except if you have subdivisions or a very heavy scene.
Thanks man
Oh wow thank you Ridwan! I didn't know that. Super helpful in the future! Thanks! 🙏🙏
@@tiedtkeio I'm glad you find it helpful.😇😇
Thank you for sharing such an amazing idea and technique in match moving in blender3d. am new to it and am finding ways to ease compositing, VFX and match moving to stay creative and deliver fast. Thank you so much.
Thank you so much for your kind comment! Sounds great, Blender is really fun and opens lots of opportunities. Have a nice day! 😊
So cool!!! Wow!!!
I was looking for such a tutorial for a long time, thank you tiedke
Awesome, glad I could help! 😊
Used this style in one of my new videos that is coming out tomorrow... Thank you so much!
Just looked at your video, superb work! Very nice! 👌
Incredible
Really Like it
COMPLETELY FOOLED ME WITH THIS TRICK!! I totally believed that tracking was involved.
Thank you so much! Could you create a video going over your export and compositing technique? Great appreciation for the content, very inspiring!
Beautiful Work
Thank you! I really appreciate it! 😊
Fire😍
Thank you!! 😊✌️
thank you!! You earned subscribe!
Thank you! Glad you like it! 🤗
Awesome man....
Thanks in advance for the keying tutorials!
Thank you Tino for watching!! 😊
Awesome! I'd love to see a video on the HDRI map addon
Nice one!
very very cool !
Thank you so much!! 😄
really neat
Thank you Dan!! 😊🙌🏾
Great. Thank you.
Thanks for watching! 🤓
Thank you, Sir
Thx soo much🖤🖤🖤
Thank you for watching!! 🤓
👏🏻👏🏼👏🏻🍷🍷Very inspiring Work, you resolved her video issues with simple effective solution.
Thank you! Very often it's the simple solutions that works best. 🤩
Brilliant
Thank you! 😊
Great tutorial.
Thank you Ramsey!! 🙏
Good tutorial!) Would be interesting to see how you set up whole hdri map with this addon.
Thank you! Nice, perhaps I can make a video on how to use the HDRI map addon. 🙏
It is very useful to get your video, bro, I hope you will release such videos again
Great tutorial
Amazing, thank you Izaan! Glad you liked it! 😊
Technically this isn't match moving. Match moving is matching blender camera movements to composited camera footage, hence the "match" part. Good intro to green screen compositing but I'd update the title.
I was going to write exactly the same.
Would have been nice if the original video with green screen had movement to track it in blender, in such case that had been match moving, but he animated the camera…
Agreed Adrian
It would be easier to constrain the camera to look at a target empty then put noise on the camera motion graph. Also, its best to do colour correction before green screen removal as it works better and leaves you with media with correct lighting. Great video though, love your laid back Dutch approach - true artist! :D
Thank you Prince! 🤗🤗
YES! shot the AE keying
I just made that video, it's on my channel! 😊🙏
@@tiedtkeio SWEET!!! i'll check it out!
Thank you @tiedtke
you save my day....
Haha wow happy to hear that! Have a great day! 🙂✌
Thanks man your totorial was awesome, i try it and it really works , but the depth to field doesn’t woken how do get it?
nice man.
Thanks Avery! ☺️🙏🙏
Great Video.. i have subscribed to your channel.. keep positing tutorial like this..
Thank you!! I will! Thank you for watching! 😊
Can you re-time the image sequence after you've imported it as a plane? like moving it further in the timeline? When you need for example to aligned the "clip/image sequance" with some action.
thanks for this, and yes will be grateful for a more indepth tut, infact would patreon that ...
Haha, god bless Tony. I'm working on that keying tutorial right now! :)
I just uploaded the tutorial on keying, hope you enjoy! 🙏
@@tiedtkeio God Bless you too man, and a very big thank you !!
In the final shot, you have shadows being cast by the png. Iirc, last time I used a png with images as planes, it would treat the edges of the png as the edge of the image instead of the alpha. Any hints how to change it so it does what it does in your video?
Yes, very simple and a very good question too, I forgot to adress it in the video. In the material settings for the image plane, under viewport display tab. Just change blend mode and shadow mode to "alpha hashed". 😊🙏
ASMR TUTORIAL I LOV IT
Just subscribed hope you do more tutorials😁
Thank you! I will! Lots more coming about Blender, After Effects, Premiere, Maya and DaVinci. 😄
nice! you can use object constraint, track to camera and the green screen footage will always face the camera :)
Yes! That's really smart. Good tip! 🙏🙏
Great!
Thanks for watching! 😌🙌🏾
HI ! i found your channel, amazing video this help me a lot !!!! thank you man !! its really an amazing world nowadays all is possible, i have an ask, how much samples do you use to render the final images?
Hi! Thank you Kevin! I'm really glad to hear that. I was a bit afraid this one would be too brief and not explain enough. It was rendered in Eevee with 50 samples, making each frame render in about 10-15 seconds.
@@tiedtkeio thanks ! and hi again, sorry for bother but when i import in blender the png secuense i can't the the footage correctly, its all transparent can se the alpha like your with color and all secuence :(, its happened before to you?
@@tiedtkeio and its like in violet color, can't see correctly the footage, i was so excited and now im trying to solve this but doesnt work :( hehe wanna cry
@@Hencekevin Is your Blender timeline the same amount of frames as there are PNG images? If you're at frame 0 in the timeline and the first frame starts at 1 or even let's say 254 your image plane will be transparent/pink/violet.
@@tiedtkeio i cant believe it it was that, mine started at 465 i don't know why but that was ! i am so happyy !!! thanks a lot mann you save my day !!! :D :D :D
Wow. Kick a$$ tutorial - thanks so much I would love to see more of the match moving process involving the lighting and environment stuff. Question: She's lip syncing to her song - so when you imported the footage is the audio attached to it? Or is the footage pre-synced and this clip just gets matched back up with the audio after? Cheers again!!
Hi! Sorry for such a late reply. If it's still relevant I did everything without audio and then simply matched the render with the song audio again in DaVinci Resolve. 🙂
@@tiedtkeio aaah… thanks!
Please make a tutorial about how you key in after effects! Great Video man
Thank you Yagoras!! I just uploaded a keying tutorial for you, have a look on my channel! Enjoy! 😊
@@tiedtkeio Thank you so much!
As someone familiar with the topic and the process I must say that you did an excellent job. Honestly, amazing and seamless integration of CG and live footage. Great, great job!
Thank you so much! That makes me really happy to hear! 🤗🙏
Yes please do the keying tutorial :)
Already have! 😊 It's on my UA-cam channel!
Keying in After Effects tutorial? Yes please!
Haha awesome, I'm on it! Will share soon. 😊
I just uploaded the keying tutorial on my channel, check it out! 🙏
cool stuff! would have been better if the focal length of the footage matched the blender scene's focal length...
Thank you! It did! 24mm. :)
Hi, just curious, isn't there a way to have the image plane be aligned to the camera so that the actor is always properly angled in front of the camera?
Hi Brian, yes sure is! By using "constraints" you can achieve this. 🙂
Hi, awesome tutorial, is there any reason why you used After Effect instead of Blender To to do the masking and the png sequence?
Hi Juan, thanks for watching! Because After Effects is the software you want to use for that. I try to use the programs the same way as major VFX houses would - that way if I ever get hired for a studio I can more easily adapt their workflow and be more attractive for them to hire me again. You can do it in Blender, but most large studios wouldn't. To be fair they would do it in After Effects either, probably Nuke, which is what I'm learning now. :)
@@tiedtkeio I see, thanks for your fast and complete respond to my question, again, awesome job!!!
Really cool but I didn't like the part where you just guessed on the camera movement. Putting more time into this part would have really elevated the final result. That being said it still looked really good in the end.
Interesting! Still I think it is important to note that "matchmoving" actually refers to the technique of extracting 3D camera translations (position+rotation) in live action footage and then having a 3D camera using this movement to render a 3D scene accordingly. if there was no camera movement while shooting in the first place, matchmoving is the wrong term. What you actually do is have a 3D scene with camera movement and include an animated texture as a *billboard*. the effect is really nice, it is just not what I actually expected.
another detail; your perspective is a bit inaccurate if the billboard does not fill the entire camera view -> if the live action was shot at 24mm but the billboard only covers 80% of your view, the visual perspective is actually more wide angle (-> 24*0.8≈19mm). this leads to a camera that appears farer away in 3D than it was while shooting (=distorted perspective), or the artist is appearing smaller than she actually is. you can compensate for that if you shoot with a longer lens and bigger distance to her. of course, moving the 3D camera also results in a somewhat inaccurate perspective, still this is negligible if not done excessive.
one last thing; the easiest way to bring the billboard into camera space is either just align it to the camera, or parent it under the camera and then zero its local rotations. also, if you know her height and the distance between her and the camera while shooting, you can work in cm units, which really helps fixing the relations.
That's looks so cool subscribe :)
Thank you!! Really glad to hear that! Stay awesome friend. 🙏
Does this mean that Blender 3.0 has proper shadows to transparent image planes??
Used to be only possible in cycles (which is useless to me, a Mac user)
Yes, for this render I used Eevee which allows for transparent images. 😊
@@tiedtkeio Transparent images are possible now, but they cast wrong shadows, not based on their true alpha
so can we track our camera movements while shooting via iphone (lidar) then replace that movement with it ? will it be realistic ? does it work like that ?
Yes that could work! You can also film with any other camera, 3D track the camera motion and use it in your scene
@@benklewais i usually make color grading in my professional life but this kind of works are very interesting to me. I want to learn :)
thx fore your tutor pls can make tutorial about HDRI MAKER and greenscreen footage
Please make a tutorial on how to do compositing by nodes and rendering in the same video😅
She looks so dull and flat in the viewport but looks brighter and more 3D in render. Any tips on how to do this?
That is because of the color grading I've done after rendering the footage. I color graded in Adobe Premiere with Lumetri. 😊
What's the lens distortion effect you're using?
There is a built-in distortion effect in the compositor in blender called "dispersion" under lens effects, this particular one though in the video was made with Sapphire plugins for After Effects called Universe.
a little tip : go in the camera view before you add image to plane
Yes! 😊🙏
Hey man, thanks a lot for the tips!
Btw I noticed you're saying "Ähm" a lot, maybe you can work on that a little bit, but just a tip, I enjoyed it nonetheless 😇
Thanks for the feedback! Haha, I am, happens way to often. At first I edited it, but I said it way too often so I just left it there. But I will try to avoid it in the future. 😅🙏
It didn't bother me at all. In fact I like "ahm" vs "uhm".
I'd love to see a keying tutorial.
Thanks for watching! Sounds great, I'm on it! Will share soon. 😊
I just uploaded the keying tutorial on my channel, check it out! 🙏
@@tiedtkeio Thank you I will.
Can this be done in cinema 4D ?. Thank you.
Most likely! I haven't used C4D so can't say how you do it, but it should probably be the same method. :)
Please let us know more about keying in AE
Thank you! I have a video on keying on my channel now. 😊🙏🙏
we'd love a more comprehensive keying tutorial, thank you!
Awesome! I have one on my channel now Costa! 🙏
@@tiedtkeio yes, it was on my suggested list, it's awesome! ty for everything!
@@costaliberta5969 Thank you for watching! 🤗
Very Impressive! Thank you!
Can you show how to create particle animation in blender? What tools to use? How to use them creatively? I appreciate.
Don't suppose you could show us how to this exact thing using Unreal 5? :)
I would! I started learning Unreal myself only a few months ago, but I can try to focus on how to apply the same thing in UE. So, soon I could show! 😊🙏
@@tiedtkeio Seriously looking forward to that!!! :D I have been watching a lot of channels do it, but I think with your eye and skill you would be able to really do something amazing!! If it would look anything like the results in this video, it will change a lot of things for many people!! I know it will help me big time!! I want to do music videos from green screen to unreal environments.
@@jacquesokes Hi Jacques, I want to make the same thing and it's the best tutorial I have find (for Blender) and me to I want learn also Unreal for make some virtuals concerts.
Great but as freelancers and employees we need to remember that the easier it gets in the software the less they will want to pay us out in the workspace / job market. I started with stuff like this in after effects back in the early 00's after getting into AE in the late 90's. All of us 3d guys need to band together.. as an industry we need to start protecting our jobs. Overseas competition is the norm now and the only thing keeping work going for us right now is that those low paid guys cannot afford the hardware!! That's changing. Great tutorial just spreading the word , dont just be a 3d puppet for a living guys be a teacher, be a person who educates our new up and coming to understand how the big websites / job agencies are controlling your wages.. Blender is free... but the hardware isn't... Great tutorial.. I want to see people in developing countries do well but our industry is virtual.. it can be done anywhere! xx
please you need to make the keing tutorial in ae
Thank you! Yes, I'm on it. Will share soon! 😊
Link to music video commercial: ua-cam.com/video/XLDHUUuNsNs/v-deo.html
my images dont pop up..
Hi! You're probably just on the wrong frame in the timeline. Make sure your image sequence match with your timeline. If the image sequence starts at frame 3758 it won't show up since the timeline starts at frame 1. 😊
Please make green key in Blender video
Will do! :)
I don't get the title.. this is neither realtime, nor matchmoving?
I could have sworn the artist was Martina Hingis.
Haha, well, I do see the resemblance. 😄
It's not in Real Time ...?
This isn’t match moving, this is virtual camera move. And it’s not real tube either. Real time beans 24fps or higher and fully rendered. Like game engines do.
Very good tutorial but this is not matchmoving
this is not match moving. this is literally just animating a camera in a 3d scene.
What weird shot 😆 the way she sitting is weird 😆
mAtChMovinG lol
Click baty... There's no real time match moving or compositing here man ..
Kinda click bate. Not a matchmoving at all.