Where’s the Camera?! Content Aware Fill - Seamlessly Remove Objects In 360° VR Video

Поділитися
Вставка
  • Опубліковано 10 гру 2024

КОМЕНТАРІ • 142

  • @eduardoisidoro3957
    @eduardoisidoro3957 2 роки тому +2

    You are a jedi master Hugh Hou, I was having problems with the Mocha, but with this technique, although it takes a little more time, it was very effective, thank you very much for always sharing your knowledge, big hug.

    • @hughhou
      @hughhou  2 роки тому +1

      Glad it helped!

  • @OaklynMediaLLC
    @OaklynMediaLLC Рік тому

    Little tip for insta 360 users. Convert the .insv to a .mp4 or .mov if you want to dynamic link into after effects. Premiere has a .insv plug in but after effects doesn't

  • @theeditorrestrial
    @theeditorrestrial Рік тому +1

    Very slick...I forgot about the content aware fill..jeeeez. I'm a noob in the VR tech but learning more n more SUCH AS with the 360 sphere cam ya won't have to remove drone...but flight safety takes a lil hit. Appreciate the tute!

    • @hughhou
      @hughhou  Рік тому

      Glad you think so :)

  • @Evil-Druid
    @Evil-Druid 3 роки тому +1

    Друг. Спасибо тебе от всей Русской души. ты мне очень помог.

  • @OaklynMediaLLC
    @OaklynMediaLLC Рік тому

    My home editing machine runs the i9900 with a 2080Ti pretty similar builds we're using!

  • @simonbaxter5822
    @simonbaxter5822 2 роки тому +1

    Brilliant help, thank you, but I'm tearing my hair out because I press 'open output/render' and don't know what to do! I still appear in my premier pro clip even when I replace and render...

  • @Lykia32964
    @Lykia32964 Рік тому

    hiç sıkılmadan izliyorum

  • @bsuska
    @bsuska 3 роки тому +1

    Great tutorial, Hugh. I'm having an issue where when I add a 2D edit in After Effects my image still looks top and bottom? Any insight?

  • @ale4k545
    @ale4k545 9 місяців тому

    Hola hermano, exelente tutorial. me sirvio mucho para seguir aprendiendo de tí. te ganaste otro suscriptor. te hago una pregunta, que software utilisas para cocer los videos 360 ? yo uso mistika pero estoy teniendo problemas y nose si los hago mal o es la camara que se ve con baja resolucion. saludos coordiales desde Argentina

  • @LEXPIX
    @LEXPIX 5 років тому +1

    Content aware on moving objects is getting pretty sophisticated.

    • @hughhou
      @hughhou  5 років тому

      Yup! Use reference frame more often you can fix that. But is not moving causing the issue. It is lighting and reflection. Have you tried Mocha?

  • @eshu1023
    @eshu1023 3 роки тому +2

    thank you so much for your tutorials! you're a total life saver. although it's taking forever for my content-aware fill to render a 3-minute video. is there any way I can make it faster? :-)

    • @hughhou
      @hughhou  3 роки тому +2

      Try the After Effect 2021 in beta right now on Creative Cloud - it use GPU accelecrated render so it is a lot faster - it is still in Beta so might crash but so far working like magic on my end on my spec

  • @MatternjPhoto00
    @MatternjPhoto00 5 років тому +2

    Magnificent, thank you very much! Some day you make us a tutorial of your computer and the configuration of it. To go as fast as you in the editing of 360 videos. Since the same exercise, I have taken 3 hours in mine, to do 10 seconds of sequence.

    • @hughhou
      @hughhou  5 років тому +1

      Yes. it will release soon! I have too many backlog video and tutorial request ATM. But this is def something I want to share as there are lots of options and pretty confusing (I also waste lots of money to get my current setup...)

    • @MatternjPhoto00
      @MatternjPhoto00 5 років тому

      @@hughhou It would be very helpful, especially with the imminent arrival of Instan360 Titan. How will we move that ????? ..... Ufhhh!

  • @neorage30
    @neorage30 5 років тому +1

    Really good tutorial. I'm not really good at editing software, I only use healing brush for photo while wondering how they remove it in video. Thanks

    • @hughhou
      @hughhou  5 років тому

      Thanks! This is easy tho. If you can use healing bush - you can use this!!

  • @moxx
    @moxx Рік тому

    if the video is too big, it takes too long time for analysing. shall I create an proxy before using the content-aware fill tool?

  • @sosavage360
    @sosavage360 3 роки тому

    Just made my purchase using your code.

  • @visionmagenta
    @visionmagenta 2 роки тому +1

    Hey nice content thanks so much! i have a project but i dindt find a content that show us how to erase Speed Rail in a Stereo 3D 360 :(

    • @hughhou
      @hughhou  2 роки тому

      Have you try this Resolve tutorial: ua-cam.com/video/ZwojozYr68M/v-deo.html

  • @maratov_f
    @maratov_f 4 роки тому +1

    Thanx bro for info. I need your help. where i can find rover for qoocam 8k? Thanx in advance

    • @hughhou
      @hughhou  4 роки тому

      Any rover or RC Cart. I don't think you can buy one just for it. You can build one from any RC shop - the one you saw in my video is very expensive prob not what you need.

  • @gxi3602
    @gxi3602 3 роки тому +1

    Great Video thanks! So am I correct in saying content aware is best for removal of tripod and shadows as well. In your opinion which is the best method this after effects technique or creating a plate and masking via photoshop. I've seen in some of your other videos you've mentioned that photoshop is not best, but then also use it frequently when editing. Please explain your thoughts on this. Especially if subject is moving across tripod shadow :S

    • @hughhou
      @hughhou  3 роки тому +1

      I will make a indepth on coming up soon - this is a little old as AE has some new development on this AI removal thing.

    • @gxi3602
      @gxi3602 3 роки тому

      @@hughhou Thanks a lot! I'm looking forward to it. Keep up the great content

  • @gidas360
    @gidas360 5 років тому +1

    Very usefull as allways. Thanks!

  • @360vroomers
    @360vroomers 5 років тому +1

    Great job Hugh!

  • @SamaraMedia
    @SamaraMedia 5 років тому +1

    Great video tutorial. I see a couple different rovers in your vid's, what size are you using in the second part of this tutorial? What do you recommend for the Insta360 OneX. Thanks! Look forward to the next video.

    • @hughhou
      @hughhou  5 років тому

      Rover for ONE X? One X do not need a rover - just handheld on top of your head and use the same technique to remove it.

  • @erictao7538
    @erictao7538 5 років тому +1

    Thanks Hugh! So great as always. What would the process be for stereoscopic content? Would you consider a video that covers that?

    • @hughhou
      @hughhou  5 років тому

      Yes when I figure out a repeatable workflow myself. Right now the only way is do left and right eye and them merge them again. Not ideal...

    • @erictao7538
      @erictao7538 5 років тому +1

      @@hughhou I eagerly await it then! Also, do you have a Patreon? I would support you in a second for all that you do Hugh.

    • @hughhou
      @hughhou  5 років тому

      Thanks, Eric. I don't. But I should really start one lol.

    • @borisfxlearn
      @borisfxlearn 5 років тому +1

      Eric Tao Mocha Pro can do stereoscopic tracking, masking, stabilization and object removal.

    • @cadrevr1260
      @cadrevr1260 5 років тому

      @@hughhou Has there been any updates about VR180 object removal in After Effects without Mocha? I'm trying to take out feet at the bottom of the frame and unwanted background objects and still searching for a solution with Adobe. Thanks!

  • @CapitalCraig
    @CapitalCraig 4 роки тому +3

    How crazy, I was actually going to do a shot where I walk out the lincoln memorial with a 360... you already did it.. haha

    • @hughhou
      @hughhou  4 роки тому +2

      You can still do it! I did not publish that shot - it is for a client.

    • @CapitalCraig
      @CapitalCraig 4 роки тому +1

      @@hughhou nice! we can have both! lol thx great shot.

  • @clausli9138
    @clausli9138 4 роки тому +1

    This is amazing, thank you for your great tutorials.

    • @hughhou
      @hughhou  4 роки тому

      You're very welcome!

  • @csdl910
    @csdl910 7 місяців тому +1

    Amazing! Where did you buy the remote control car :D?

    • @hughhou
      @hughhou  7 місяців тому

      This one I made it but here is another option : ua-cam.com/video/m_mpR6oBNYM/v-deo.htmlsi=ljBL8POAq5GAOjhu

    • @csdl910
      @csdl910 7 місяців тому +1

      @@hughhou wow! Thank you so much, another question, I’m confused, how do you take off the tripod in a 3D over/under shot? Or do you make it first left eye and then right eye? I’m stucked. Regards

    • @hughhou
      @hughhou  7 місяців тому +1

      I also have a tutorial on this topic on Resolve here: ua-cam.com/video/KSpML98x-6c/v-deo.htmlsi=mBPZiO3UzZpa3Drd

    • @csdl910
      @csdl910 7 місяців тому

      @@hughhouThank you so much!

  •  3 роки тому +1

    Simply fantastic, Your tips are exceptional,
    I speak from Brazil I am starting my English course, to have a face-to-face course with you!
    Waiting for a video talking about your machine you bought at MainGear with i9 and gtx 2080ti, my processing lasted 90 minutes for a video of 1h15, I have an i7 and an rtx2080.
    Is it normal or should I better change processors?
    Thank you very much, you are an inspiration, one day we will do a job together!

    • @hughhou
      @hughhou  3 роки тому

      Yes it is normal - 360 take more power to process in general

  • @madcorp206
    @madcorp206 Рік тому

    Thanks for the demo, however it's way too slow to be helpful. I wanted to test the "object removal" feature of Davinci to compare, but I didn't find a way to apply it to a 360 video. is it even possible ?

  • @fresheyes3609
    @fresheyes3609 5 років тому +1

    Hi Hugh, I want to ask about the Mocha VR removing car, what is the purpose of BG remove in this video? I watched a tutorial of BorixFX, it only shows the car-remove and BG-track. The background after car-remove in that case doesn't look as clean as yours. Could you please share a little more about the intention of each layer and how to track it in your way? Thank you!

    • @hughhou
      @hughhou  5 років тому

      Yes I will. My technique is a lot more involved compared to BorisFX official tutorial - it might take a long video for this.

    • @fresheyes3609
      @fresheyes3609 5 років тому

      @@hughhou : Thank you a millions. I stay tuned for it. You do a wonderful job sharing your knowledge. May you have a great day!

  • @finesaerialimagingllc9804
    @finesaerialimagingllc9804 5 років тому +1

    Cool! What pole / camera did you use?

    • @hughhou
      @hughhou  5 років тому

      First is ONE X, second is Insta360 Pro 2, third is GoPro Fusion.

  • @Daveperso66
    @Daveperso66 4 роки тому +1

    Hi Hugh, can you point me to a tutorial or software that you would use to create simple 360 cartoon or rendered panoramas to use as a backdrop or menu for a series of 360 photos or videos? I am finding some that I think that would do the trick but they are really complicated, I am looking for a simple non-animated backdrop. Could be a classroom or a street scene, or even just an empty field or beach but not a photo.

    • @hughhou
      @hughhou  4 роки тому +1

      I don't have one on this channel - this require some C4D or Unreal magic which is out of my specialty

    • @Daveperso66
      @Daveperso66 4 роки тому

      @@hughhou Thanks for the really quick reply. Appreciate it!

  • @SimiTravels
    @SimiTravels 5 років тому +1

    interesting video and good way to explain things, thank you Hugh ✌️

  • @derekmedeiros
    @derekmedeiros 5 років тому +1

    This is awesome! Thank you!

    • @hughhou
      @hughhou  5 років тому

      glad you like it!

  • @VRNomad
    @VRNomad 5 років тому +1

    Hi Professor Hugh! Thanks for the lesson! I tried this myself, and for some reason After Effects won't use my GPU (2080 Ti). I made sure CUDA was enabled and all that... can't figure it out. Have you had this happen too? Perhaps after an update?

    • @hughhou
      @hughhou  5 років тому +1

      Content Aware Fill is not a GPU accelerated effects yet - not like Mocha. But I am pretty sure that will be an announce in Adobe Max that this feature and many others will use GPU.

  • @davidsebastianlopezrestrep6396
    @davidsebastianlopezrestrep6396 4 роки тому +1

    Hello Hugh , how can I remove the tripod from a 3D video? I film with the 360 pro.

    • @hughhou
      @hughhou  4 роки тому +1

      Right here this tutorial: ua-cam.com/video/iroPydRv378/v-deo.html - little old but the workflow did not change.

    • @davidsebastianlopezrestrep6396
      @davidsebastianlopezrestrep6396 4 роки тому

      @@hughhou Oh Thank you Hugh, I was just wondering if you know if it is possible to do it in After effects, like in this video, it works perfectly with mono, tracking the changes of light, but I can´t find a workflow for stereoscopic. do you know how to do it in After E????

  • @JD-lb8np
    @JD-lb8np 5 років тому

    at 4:49 you say go and click mask but you click the pen, how do you get it to draw that boarder around you?

  • @sksblake1235
    @sksblake1235 5 років тому +1

    Can you use these techniques to remove underwater housing from your shot?

    • @hughhou
      @hughhou  5 років тому

      Yes. ONE X?

    • @sksblake1235
      @sksblake1235 5 років тому

      @@hughhou Thanks for getting back! Yes it's the Insta 360 One X with the One X dive housing.

  • @MiquelParramonCamps
    @MiquelParramonCamps 3 роки тому +1

    The result of the first video, of the girl walking, once the result is obtained and processed, can the video be uploaded to Google Street View? It is compatible if we have it recorded at 5 frames per second.

    • @hughhou
      @hughhou  3 роки тому +1

      Yes, render out as 11fps to upload on Google Street View.

  • @360id
    @360id 5 років тому +1

    Nice..great job dud🤓👍

  • @kberwager
    @kberwager 5 років тому +1

    Hi There! What do I do when I use Content-Aware Fill and I get an orange "This project contains expression errors: errors 1 of 6. I did a lazy (by accident) Stitching job with the Insta360 Pro II I didn't manually stitch and I don't know how to fix the expression error so I can SEE how my Content-Aware Fill worked using the reference frames. I'm freaking out because the client is waiting fo their video. Any help would be appreciated! Awesome Video!!!!!!

    • @hughhou
      @hughhou  5 років тому +1

      Sorry just saw this. Expression error might caused by your other plugin? Bad stitch will not cause expression error.

    • @kberwager
      @kberwager 5 років тому

      CreatorUp I found my original unstitched panos, restitched them and now the error is gone. Thank you!

  • @caoscorp
    @caoscorp 5 років тому +1

    Dud, you are the best :D Thanks

    • @hughhou
      @hughhou  5 років тому

      Awww thanks!!

  • @360Serbia
    @360Serbia 5 років тому +1

    cool Hough

  • @lasemelleverte
    @lasemelleverte 5 років тому +1

    How can it work with stereo 360?
    Need a tutorial for that too!!! Pleaseeeeee!

    • @hughhou
      @hughhou  5 років тому

      Right now stereo tracking you need to do separate left and right eye and put them back together or use Mocha Pro for tracking.

  • @vrg1337
    @vrg1337 5 років тому +1

    Is this technique usable for longer clips? My PC keeps crashing or running out of memory. Trying to remove myself from an 8k 360 video. I7 8700k with 16Gb.

    • @hughhou
      @hughhou  5 років тому

      8K?! You might need to downsize it to 5K - 8K with your setup is too taxing...

  • @bertrandlevet4477
    @bertrandlevet4477 5 років тому +1

    Hi Hugh, the problem for the drone method is that color of the sky doesn't loop from left to right, so in 360 a lign appear... If you have a solution, I get it.

    • @hughhou
      @hughhou  5 років тому +1

      I will first - make sure the patch is horizonal around both side edges. I use Mocha VR to patch all my drone: ua-cam.com/video/zXQdven-m1I/v-deo.html - when reframe with Mocha it is edge awared. Another way to do is to just replace the sky completely - usually it is the easiest and cheapest way to go: ua-cam.com/video/mdBK8CinbdI/v-deo.html

  • @brodwardz
    @brodwardz 5 років тому +1

    hello, after I get an error that says: Content sensitive fill error. Library call error. Do you know why this happens?
    and if it is not that error, another one says: There is not enough memory to complete in composition! Could you please help me. Thank you

    • @hughhou
      @hughhou  5 років тому

      You need to allocate more memory to your After Effects application. This is a very CPU and memory intensive operation. What is your PC spec?

    • @brodwardz
      @brodwardz 5 років тому

      @@hughhou 16 ram and 120 solid state hard drive. What specification do you recommend so that it works well, or better to work with Mocha Pro for postproduction and to be able to eliminate?

  • @telly5373
    @telly5373 5 років тому +1

    You da best! 👍

  • @oonaghq3530
    @oonaghq3530 5 років тому +1

    Does this also work with 360 3d footage shot on the insta 360 pro? when I import the stitched clip into after effects, the screen displays as over and under so it's difficult to see the object clearly to mask it out.

    • @hughhou
      @hughhou  5 років тому

      You will need to pipe that into left and right eyes separately and then remove and merge them back in.

  • @dreamchaser3342
    @dreamchaser3342 4 роки тому +1

    Hi Hugh,
    You have never added the link to your PC build from the video :(

    • @hughhou
      @hughhou  4 роки тому

      Oh forgot - the video is here: ua-cam.com/video/D9oiutI5Va0/v-deo.html

  • @MiquelParramonCamps
    @MiquelParramonCamps 2 роки тому

    Does anyone know how to remove the car or the person from under the camera when recording kms of road or, you are traveling trails in the mountains. How does Google Street View do it? does anyone know? We use an Insta360 Pro 2. Thanks.

  • @JD-lb8np
    @JD-lb8np 5 років тому +1

    how to you keep your mask from not coloring in what you masked?
    idk why this isn't working its like missing a bunch of little steps

    • @hughhou
      @hughhou  5 років тому

      Sorry, I don't quite understand your question.

  • @HakanKorkmaz
    @HakanKorkmaz 4 роки тому

    Hi Hugh, I choose VR comp editor but my view is not changing. Whatever I tried did not happen. I even updated my driver. Can you help me with this, please?

    • @hughhou
      @hughhou  4 роки тому

      After effects? What version you are on? 2020?

  • @hutchery3609
    @hutchery3609 5 років тому +1

    I find this is taking all the memory and harddrive space on my 16gb Ram macbook pro. I had more than 100GB of HD Space, suddenly, AE crashed saying its run out of Cache. I'm not sure if this can be achieved without a GPU or lots of HD space also. I am now afraid try again.

    • @hughhou
      @hughhou  5 років тому

      You actually need at least 200G space and decent GPU card - I will make a Mac setup soon which rely on eGPU and SSD.

  • @360vroomers
    @360vroomers 5 років тому +1

    Will content aware fill work for 3d 360?

    • @geoffreyoxholm2159
      @geoffreyoxholm2159 5 років тому +2

      It does not yet specifically take into account 360 or 3D, so you'll need to be diligent. I hope it helps though.

    • @hughhou
      @hughhou  5 років тому +1

      Not really... but Adobe has plans for it. But prob 3D first then 3D 360... different projection.

    • @borisfxlearn
      @borisfxlearn 5 років тому

      360Rumors Mocha Pro can do stereoscopic 360 object removal

  • @ChristiaanRoest79
    @ChristiaanRoest79 3 роки тому +1

    Hello Hugh. I have a fast computer. Specs i9 11900 processor with 128gb of RAM and a geforce rtx 3090. Is it normal that after effects is so slow while using content aware fill to remove the drone in my 360-video? According to my computer most of the time the cpu is 100% used. Sucks a lot. Mocha pro doesnt support my rtx 3090. It crashes a lot. Little bummer :(

    • @hughhou
      @hughhou  3 роки тому +1

      Wow that is crazy spec! Content aware fill right now it is only CPU not GPU - use Mocha Pro instead. I don't have RTX3090 - But Titan seem to be fine.

    • @ChristiaanRoest79
      @ChristiaanRoest79 3 роки тому

      @@hughhou thanks buddy. Its an amazing new pc i bought last week. Very expensive, almost 6k but worth the investment. I removed the drone with mocha pro and clean plates (edited in affinity photo) made every 250 frames. Gpu acceleration works but i have noticed that the cpu removal comes with less artifacts in the sky. The cpu removal in mocha pro is very slow. When choosing gpu tracking i sometimes get weird lines and stripes in the sky. Havent you noticed this also? I guess i needed mocha because it was a long horizontal flight with some slight rotation of the drone. The background and sky was constantly changing. Making one cleanplate to replace the sky for premiere pro or resolve (fusion) didnt work. Sometimes i am kinda searching for the best workflow depending on the footage. I will share the video when its ready :-)

  • @challengerapp3953
    @challengerapp3953 3 роки тому +1

    Hi man! Great video! Two questions: 1) what is your preferred vehicle mount? (Excluding rovers of course) I think the only way to get a good 180 degrees horizontal view and a 140 degrees vertical view is to mount 130cm the GoPro Max ahead of the car (so that you can rotate then the pan from +90 to -90 without framing the car), but that’s unfortunately illegal... And I don’t like very tall mounts on the roof (like google street cars) 2) how can you limit the field of view when exporting from Premiere? I guess that could be another way of not seeing the rover or the drone correct?(if possible) Thank you in advance

    • @hughhou
      @hughhou  3 роки тому

      I am actually making a tutorial on car mount - should be out soon :)

  • @capts3052
    @capts3052 3 роки тому +1

    can we do this using davincci ?

    • @hughhou
      @hughhou  3 роки тому

      Yes! Check my resolve series

  • @Jgungz
    @Jgungz 5 років тому +1

    what if i want to remove the background instead?

    • @hughhou
      @hughhou  5 років тому

      The background of what? Keying?

    • @Jgungz
      @Jgungz 5 років тому

      @@hughhou randon video background and replaced with what ever background i want. Its possible?

  • @mirinaeman
    @mirinaeman 5 років тому +1

    Good!!

  • @Kerolosnan
    @Kerolosnan 4 роки тому +1

    from whrer i can ship this rover or any small rover please ?

    • @hughhou
      @hughhou  4 роки тому

      Where?

    • @Kerolosnan
      @Kerolosnan 4 роки тому

      @@hughhou yes man...from Where?

      thank you

  • @JD-lb8np
    @JD-lb8np 5 років тому +1

    when I put my after effects in 2d mode it says this effect requires gpu acceleration?

    • @hughhou
      @hughhou  5 років тому

      Yes, did you turn on GPU acceleration of your project?

  • @dmitriylukin7409
    @dmitriylukin7409 3 роки тому

    Replace with After Effects - is not active. why?

  • @JD-lb8np
    @JD-lb8np 5 років тому

    how do you draw the mask?

    • @hughhou
      @hughhou  5 років тому

      In AE? There is the masking tool - it is a pen tool for it.

  • @PandorasCrate0
    @PandorasCrate0 5 років тому +1

    Here's the problem I'm having: I sent my footage from Premiere to After Effects in the same way, follow the same procedure as in the video, but when I go back into Premiere, none of my changes show up on my clip even after rendering. I'm loosing my mind. Please help.
    Please? :'

    • @hughhou
      @hughhou  4 роки тому +2

      Dont use dynamic link for 360 video - render it out from after effects in ProRes and import it back in Premiere.

    • @PandorasCrate0
      @PandorasCrate0 4 роки тому

      @@hughhou omg...I don't know how to thank you, you've alleviated such a headache...if I could subscribe ten more times, I would. Thank you, thank you.

    • @PandorasCrate0
      @PandorasCrate0 4 роки тому

      Also I feel like a dum dum because that was so simple a fix (I am not well versed in After Effects).

  • @BDLabs2
    @BDLabs2 4 роки тому +1

    Wow

  • @Ryudon13
    @Ryudon13 3 роки тому

    Hmmm... anyone used this technique to remove an obvious stitching on a 360 shot?

  • @naha5100
    @naha5100 2 роки тому

    I CAN NOT FIND VR CAMP EDITER

  • @JD-lb8np
    @JD-lb8np 5 років тому +1

    Mocha pro is so damn pricey for only needing it for object removal

    • @hughhou
      @hughhou  5 років тому +1

      You can always use AE content aware fill which is free. Just need to have more interframe using photoshop for removal as the tutorial pointed out.

    • @JD-lb8np
      @JD-lb8np 5 років тому

      @@hughhou ✊🙏 hell yeah haha commented too soon thanks for your replies love the content you out out!

    • @JD-lb8np
      @JD-lb8np 5 років тому

      @@hughhou just got premiere and after effects haha so confusing, glad you have this tutorial! Helps sooo much 🙏