Virtual Camera with iOS device: Virtual Production in Unreal Engine Tutorial UPDATED VID IN COMMENTS
Вставка
- Опубліковано 13 лип 2024
- In this video, you'll learn how to use your iPhone or iPad as a virtual camera for virtual production in Unreal Engine.
This tutorial was made for UE4.26, but should work with prior versions, and the recently released UE5 beta.
The programs that you will need are: Unreal Remote (for your iOS device), and Unreal Engine (for your windows computer).
00:00 Introduction
00:39 Live Camera Tracking start
01:05 Plugins
01:25 Project Settings (IP Address)
01:55 Place Actors (VirtualCameraActor)
02:09 iOS device set up
02:16 Live Link
02:46 World Outliner (Enabling Virtual Camera)
03:01 Using iOS device as Virtual Camera
03:23 Extra Options
03:48 Ending and Thanks
Contact Details :)
Jovan Tomasevic
jovan@jvnfilms.com
UPDATED VIDEO WITH NEW iOS VCAM APP ua-cam.com/video/Tfe1HaZ-iQQ/v-deo.html
Thanks for this video and instructions. I plan to test this in coming days. Got me subed to you channnel. Cheers.
This is crazy! Nice
Thank you very much
happy to help:)
Got a sub 😄
Thanks!!
Wow
I hope thats a positive wow haha!
Is it possible to put the iPhone in a vr headset and use it for vr?
hello….
YOUR VERY COOL
Hey, thank you for the guide!
I have an issue with my new Ipad (2021, M1). When I click connect, the camera in Unreal is controlled, but on my Ipad screen (on the Unreal Remote 2 app) I only see 'Connecting to [IP]', but no controls and no input from the engine.
Did you run into this perhaps?
Ah yes I did have this issue come up a few times. Sometimes it'll even be connected and be working in Unreal, but will have the Coloured TV bars on the app. I think it's a pretty common issue with the Unreal Remote 2 app, have seen it happen a few times with other devices that myself and others have used.
My usual workaround was honestly just to try restart the process. Getting off the app and disconnecting it through LiveLink within Unreal, and trying again usually worked. The Unreal Remote app, when it works, can work pretty well, but it does often have a LOT of issues sadly.
I'll have a video coming out in a few weeks about alternate tracking methods for cameras in Unreal, they'll include some proprietary hardware but do tend to work more reliably.
Any thoughts on how to send a clean unreal output to ndisplay? Essentially using the iPhone or iPad as a tracker mounted to a LUMIX or Blackmagic camera to film against an 86” television or Led Panel.
Hey, haven't used ndisplay before but am looking into it at the moment. I've recently learnt how to use composure, with a blackmagic camera, and will have a video on that later this month, essentially I connected my camera to my computer using an Elgato CamLink, and set up composure using the Unreal Docs, and then to have a clean display, I think I pressed by when I had the composure option selected. I'll look into it more though and let you know if I find something
Hi, I have two questions:
1. how to set the offset for iPhone using it on real camera mount to avoid the paralax effect?
2. how to adjust the vcam filmback and focal for matching the real camera?
When I set this and klick on activate the vcam overrides this parameter with the standard settings 35mm and 16:9.
My real cam is a BMPCC4K so I have to use the filmback 18.96x10 and the calculated focal for this crop.
Hey, there's a new updated version of this app, so the process might be a bit different now.
But,
1. Sorry, but I'm not 100% sure how to delay the iphone tracking input, but I'll be updating this tutorial and will try figure it out and make it known then.
2. To adjust the filmback and focal length, select your camera and go to the detail section on the right side of your screen, and scroll down to the camera attributes. There should be one called filmback, which is auto-set to 16:9, but you can change this to a custom filmback of your choosing. Same goes with the focal length.
I also use a BMPCC4k as well so I'll be making a video on my full virtual production workflow in a few weeks time.
@@JovanTutorials Hi, I set the camera filmback and the lens as well but as soon as I click on active in the vcam settings all the settings are overwritten to the standard settings and when I try to set it to the correct filmback again it seams be locked and stay on the settings from the vcam.
Cool , can you use this with composure,and a green screen, so the virtual background will move with the human actor? Is there an android version of this? Thanks.
Yes and no. You aren't able to record and output camera tracking with a mobile device at the moment. What I've done is mount the phone onto a camera rig, and use the phone for the transformation data and the separate camera for the footage recording. And if you do this this method, with just using the phone as a tracking device, then it should work with composure and a green screen. The CINEMATOGRAPHY DATABASE channel has a video on this called 'indie virtual production is here', he uses a vive Tracker instead of a phone but the concept is the same.
As far as an Android version for this goes, sadly there's not one yet that I've found/used. I have a Samsung phone and have to use a friend's iPhone when I want to do this. Unreal Engine doesn't seem to have made any notion of bring it to Android yet. There is an app that you can find if you search "Unreal Engine Remote Control" on the Google play store, but I haven't tested it out yet so can't make a recommendation on it.
There is an android version from byowls check it out.. worth the price
Great video! but how should an iphone 6 track the camera position accurately?
If it's not supported by the Apple ARKit then it sadly won't be able to be used:(
@@JovanTutorials but your chart says it can be used
is it because i tried to use iphone 8 ios 15.1 but it didn't work?
Can i use the phone for tracking but use a camera for the actual footage capture?
Yes you can! I've actually just written and am about to record a video on how to send your camera's footage into unreal engine. And will have an updated video on that camera tracking using a new app that unreal has just released for iOS devices. These will be coming very soon.
@@JovanTutorials sweet. Can’t wait!
which iphone supported unreal engine for virtual production
Should be any iphone since the iPhone 6s.
00:49 for the list!
Can you do this with Android and ARCore?
Hey, sadly there isn't an Android equivalent for this yet. If I manage to find one I'll have a video on it and will respond here. Another alternative is to use a VR system, but those can get pretty expensive. I'm trying to figure out how to do that with an Oculus Quest 2, being a hopefully sort-of budget option, and if I get it working I'll be making a video ASAP!
Hello, I am trying to connect with an android phone using the virtual app but it won't connect to my network , I tried the auto IP and tried inputting my IP manual but it won't connect, can someone please advise how to fix this problem, thanks
Hey so sadly I haven't actually used that app. I think there's a paid app on the Unreal marketplace to use with the Android app, as this method doesn't seem to work with androids
Tried 3 devices and it didn’t work what could I be doing wrong?
Hey, I've got a new video with the updated app coming out in a few hours. Hopefully that solves your problem, if it doesn't, please do comment again and I'll try help you out:)
Hey
Hey sovanhap Mom🫡