Getting Started with Virtual Production | Everything You Need for Machinima, Mocap and Mixed Reality
Вставка
- Опубліковано 1 сер 2024
- In this instalment of the Beginner's Guide to Virtual Production series, we’re going through everything you need to get started with virtual production at home on a budget. We cover the hardware, software and online resources you need for machinimas, mocap and mixed reality.
------------------------------------------------------------------------------
Subscribe for more virtual production:
/ @realityredefined
Support the channel:
Donate: www.buymeacoffee.com/realrede...
Amazon affiliate link: amzn.to/2VMkIqt
Follow me on social:
Instagram - / realityredefined_
Join the Unreal Engine Virtual Production groups on Facebook and Discord:
Facebook - / virtualproduction
Discord - / discord
------------------------------------------------------------------------------
Links
VR Systems
Oculus Rift S - amzn.to/2RV8dXu
HTC Vive - amzn.to/32IuhuR
Vive Tracker - amzn.to/3hLdZXh
Virtual Camera Rig
kit.co/realityredefined/my-vi...
Mixed Reality
Elgato Cam Link - amzn.to/2RQv1Ih
BlackMagic DeckLink - amzn.to/3ct07yT
Greenscreen - amzn.to/32DyZdk
Lighting Kits - amzn.to/32ErHpD
Motion Capture
Vive Mocap TrackStraps - amzn.to/2H2KX7R
Valve Index Controllers - www.valvesoftware.com/en/inde...
Rokoko Smartsuit - www.rokoko.com/
Perception Neuron - neuronmocap.com/
Xsens - www.xsens.com/motion-capture
StrechSense - stretchsense.com/
ManusVR - manus-vr.com/
Software
Unreal Engine - www.unrealengine.com/en-US/
Aximmetry - aximmetry.com/en/
Reality Engine - www.zerodensity.tv/products/r...
Vive Mocap Kit - www.unrealengine.com/marketpl...
IKinema Orion - www.ikinema.com/docs/s317i365...
Manus VR Polygon - www.manus-vr.com/polygon
KinectAnimationStudio - marcojrfurtado.github.io/Kinec...
iPi Motion Capture - ipisoft.com/
Resources
Unreal Online Learning - www.unrealengine.com/en-US/on...
Quixel Megascans - quixel.com/megascans
Mixamo Animations - www.mixamo.com/#/
Character Creator - www.reallusion.com/character-...
Amazon Prime 30-day free trial - amzn.to/2HdV3TC
As an Amazon Associate I earn from qualifying purchases.
------------------------------------------------------------------------------
Timestamps:
Overview - 0:00
VR Systems - 1:51
Virtual Camera Rigs - 4:48
Mixed Reality - 6:34
Finding Assets - 9:51
Motion Capture - 12:09
Outro - 17:31
------------------------------------------------------------------------------
Accreditation
Doghut (TouchOSC files) - www.doghut.de/virtual-camera/
Copyright Chillhop Music
Birth by Mr. Käfer - chll.to/d4dd78e2
Reliving by No Spirit - chll.to/48c75832
Long Time Ago by Philanthrope, No Spirit, Sitting Duck, Otaam - chll.to/e59f3dca
Beach Volley Club by sadtoi - chll.to/7e989840
Beyond Clouds by Saib - chll.to/6cf6c6c3
Caffeine by Blue Wednesday, Felty - chll.to/c1c61770
Lagoons by Strehlow, Chris Mazuera - chll.to/454d5727
Crema Cafe by Strehlow, Glimlip - chll.to/31592039
All videos, images and graphics used in this video belong to their respective owners. They have been used for informational and educational purposes only. This channel does not claim any copyright over them.
------------------------------------------------------------------------------
#virtualproduction #unrealengine #vfx - Наука та технологія
This video series is amazing! Thank you for this! I'm learning so much. Please continue to make videos on virtual production, MoCap, Mixed Reality and so on! I'm really excited to learn more from you!
Looking fwd to your next videos- this was one of the clearest overviews on VP, for an indie filmmaker, that I’ve seen. Thank you.
Wow, thanks!
Thanks for this was looking to get some things to start virtual production, awesome channel btw
Damn dude, this is an amazing overview. I didn't even know I was interested in this topic but kinda want to give this a shot. Thanks!
That’s awesome, thanks for watching!
Great video! Looking forward to more on this.
By far the best intro video on VP I found. Thanks, bud! Can you point me to a video that walks you through a simple VP set-up - end-to-end? Nothing fancy, just a getting started tutorial with some of the budget equipment and software you have featured.
That was a pretty thorough overview. Thank you!
No problem, thanks for watching!
Great video! I’m just getting started and this info is all very useful. Thank you 🙏
No problem, glad I could help!
Great video bud! Keep up the amazing work.
Thanks bud, will do!
Where have you been this whole time?! This video has been much needed. Cant thank you enough for sharing all of your knowledge. You went over so much I am definitely going to be watching this a few times. You mentioned that you can do mocap using the vive. So far I have a base station and tracker. Saw the link you posted on using TouchOSC and definitely going to use the link. As far as the mocap though, what other gear would you suggest if I wanted to go that route? And which of the softwares in that list do you use? Kind of blown away about the technology you went over regarding that and what Nvidia has in store for the future using the webcam. Cant wait for that. Again, thank you so much for this video!!!
Thanks for watching and glad you found it helpful! For Vive Mocap, I'm still yet to try this out myself, however I'm going to be ordering some more trackers soon and will post a whole video on it. Based on what I've seen, most Vive mocap software requires you to have at least 5 tracking points - one controller per hand, one tracker per foot and a headset or tracker for your head, some also require a torso tracker too. In terms of the best software, the one I'll be trying first is Glycon VR as it supports Valve Index finger tracking right out of the box, and seems very reasonably priced and user friendly. Hope this helps, thanks again for watching!
Good job! I like the flow and the links attached 👍🏼
Awesome, thank you!
Great video thanks man
Wow!
Thanks a lot for all the provided info ánd links.
Makes it so much easier for me for my research and purchases.
Glad I could help and thanks for watching!
I've been wanting to try this using a short-throw projector instead of LED walls. I'm still learning Unreal Engine, but would love to see your process for tethering your real camera to the virtual camera in Unreal. Great stuff!
Any luck?
Great info! Well put together and helping understand the sea of information that is 3D and virtual production.
Thanks for watching, glad you found it helpful!
really informative video! thank you!
Informative! Thanks!
Great video - was looking for an overview like that 🤙thank you
No problem, glad I could help!
Wow, really great vid! Appreciate your tips
it's nice shopping list thx.
Hey, really enjoyed your video and in-depth and clear breakdown for a VP setup, especially for a someone completely new like myself. I was wondering however, if you have a video where you went through a setup of HTC Vive tracker + base stations without the HMD because I put money into those and having an extremely hard time setting those up with unreal. I keep hearing they are super easy to configure but can’t find any easy setup videos explaining that particular step. Everyone just dives straight into unreal. I was hoping if you could help explain how to setup just the tracker and base stations without HMD 🙏🏽
very detailed and informative video. I normally don't comment. You earned a sub :)
Awesome, thanks for the kind words and the sub!
Very professional video and great description. Easy to listen to voice. Good info. I tip my hat to you.
Thanks!
Thank you dude, really useful.
Awesome, glad I could help 👍
Good Job!
Mate! Thank you!!
Happy to help!
Great Video! More content please!
I like! Just subscribed. I'm interested only in blending real (live) actors into virtually created scenes as per 'The Mandalorian' so as to make live action films, not video games. From what I've seen of the state of the art in motion capture technology, especially regarding body and facial accuracy/believability, a lot of work still has to be done to make it subtle enough to be mistaken for actual reality.
Awesome overview. Would be cool to see full body mocap setup with vive trackers and vive mocap plugin with iphone for face mocap. Keep it up
Thanks for watching, I'm hoping to get hold of some more trackers and experiment with Vive Mocap soon!
Very nice one!
AWESOME THX
Thank you for your reply!
No worries!
I saw you on reddit. Nice vid mate!
Awesome, thank you!
great overview, thx
Thanks for watching!
That’s for explaining this. I’m subbing, I want to build a studio for this.
Awesome, thanks for subscribing. Good luck with the studio!
Reality Redefined Thanks This is scary ($$$) territory for me since the buy-in cost is unknown. Got the SLR, basic lenses, tripod. Anything more is...anxiety producing due to that limit of money
I can definitely relate to that, it's very easy to go down the rabbit hole of spending! There's tons more I want to explore with virtual production and I'd also like to have my own studio one day, but like you said the cost can be intimidating.
Great stuff!
Thanks!
You mention that some Sony cameras can hook up to the PC without a capture card and while that´s true it doesn´t help with Unreal. At least I haven´t been able to find any way of Unreal recognising the incoming video even though Sony Remote and OBS for example are showing it just fine...
awesome intro, subscribed....
Hey man, great video! Thanks for this amazing intro to virtual production. Do you think the new Oculus Quest 2 is as good as the Rift S tracking-wise?
Thanks for watching! I haven’t personally used any of Oculus’ headsets as I own a Vive, but from what I’ve read the tracking is pretty comparable between the Rift S and Quest 2. Both seem accurate, so you can’t go wrong.
Interesting Info
Great vid! Of the products you listed, which do you think one should buy first for "filming in their room" level projects?
I’d say as the bare minimum you should invest in a VR headset. If your main concern is cost, space or portability, then go for an inside-out tracked headset like the Oculus Rift S or Vive Cosmos, however if you want superior tracking and don’t mind spending a little more, go for an externally tracked headset like the Vive Pro or Cosmos Elite; these headsets also have the added benefit of being compatible with Vive trackers. A physical rig to hold your controller/tracker is nice to have, but isn’t necessary. Same goes for external monitors and control interfaces, they’re a convenient addition but not needed if you’re just starting out - your computer’s monitor and a keyboard or xbox controller will work just fine. I’d also recommend checking out the Unreal marketplace, there you’ll find tons of free characters, animations, props and environments you can download to get started with your projects. Thanks for watching and hope this helps!
@@RealityRedefined thank you!!
Do you think I can use my Oculus 2 Quest controller for VP?? You mentioned oculus rift.. thanks
Am I use the cannon m50 mark 1 to achieve real time on virtual production ?? Cuz that’s the current camera I have
i need position and rotation data can i use VIVE tracker without base station device?
Are these all the things I need to get into virtual production or options I have to et into virtual production?
This is incredible thanks for putting it together!
Considering you could use lighthouses and a tracker without a headset, is there any reason I couldn't do this with my OG Vive? Or do you need the pro -- are those lighthouses different?
Yes the base satations are different
Thanks for watching! The original lighthouses are still entirely compatible with Vive Trackers, the only big difference between the 1.0 and 2.0 is the amount of base stations you can use in the same room.
What's your recommended system configuration?
can quest one be used with vive base stations?
Is it just the tracker base station and capture card ?
Awesome! Do you have any suggestions on how to pick a future proof graphics card for Virtual Production? 🙏🏾
I'd say any of the new GTX 30 series cards would be a pretty safe bet for most applications, they way outperform the previous generation of GPUs and provide a much better price to performance ratio. The only issue is that stock is rather limited at the moment. However if you plan on rendering to an LED wall like on The Mandalorian, then you'd need a Quadro card. Thanks for watching and hope this helps!
@@RealityRedefined Thank you ... very helpful 🙏🏾
Can mixed reality virtual production be done with a laptop using the elgato 4k capture card?
Great video! Thank you so much to share it! I'm stuck in choosing the best solution: HTC Cosmos or Vive Pro? Do you have any advice?
Thanks for watching! While the Cosmos is cheaper than the Vive Pro, because it utilises inside-out tracking it won't be as accurate and may cause stuttering when trying to do finer movements. Also, because it doesn't utilise base stations, you won't be able to use a Vive Tracker with the Cosmos, so you can't do Vive mocap for example. I'd say if you're just a hobbyist and are on a really tight budget, then the Cosmos will do just fine, however if you don't mind spending a little for more for superior tracking and greater versatility, go for the Pro. You could even invest in a pre-owned original Vive, which is a lot cheaper than the Pro but still uses base station tracking, making it compatible with trackers. Hope this helps!
Thank you mate, this is really helpful and clear.
No problem, glad I could help!
This is a great overview but now I feel like I know even less, lol. My head hurts.
ths bro
Can i use Android smartphone ar tracking instead of vive?
So for the black magic what exactly do I need lol I’m confused
Thanks for posting :) Check out the Hollyland Mars 400s Pro for wireless HMDI, a good system
Thanks for the suggestion, will check it out 👍
Wish someone would write a plug-in which would enable using a gimbal as the tracking device inside Unreal...
thanks!
No problem!
Was you able to download Zero Density Reality engine for free? i got email from them but without download link.
@@djwosa2000 I haven't tried downloading it yet as I'm still working primarily in Unreal, however I believe they said it would be free to download as of "late September". It's a bit ambiguous, but it should be available within the next couple of days. If it doesn't arrive by the start of next month, I'd say just contact their support team.
@@RealityRedefined thanks a lot! :)
Great!! Can u please help me on how to render out a video from aximmetry?
Thanks for watching! I've mainly used Unreal for greenscreen work, having researched Aximmetry but not done much with it myself. Richard Frantzén has a good series on Aximmetry, that may be useful. I'll also link a forum post I found that might help too - my.aximmetry.com/post/168-making-a-rendered-video Sorry that I don't have an exact answer, but hope this helps!
@@RealityRedefined thankyou so much it helped ❤️
Would be even better with logos, picts, names and titles when you mention solutions!
This is all vague, lets get the nuts and bolts ....what are all the cables and component needed to use the vibe tracker...how does the data get sent to steam VR with steam VR works? No channel has details .
i have a question
im looking into buying a setup for virtual production with led walls
but i still need an explanation on how i can make my camera work like that in Mandalorian
like what are the things that i need as far as its concerned about the hardware
any insight into that topic would be great
just to be more specific im talking about using the real camera's perspective to match the perspective in unreal
Unity is also free.
Don’t use a Microsoft kinect promotion capture
CRAZY ACCENT SH ??SU ???
CAN'T DO THIS FELLOW !