Motion Extraction
Вставка
- Опубліковано 1 гру 2023
- With a very simple trick you can extract the motion of a video. All footage was shot by me, as usual...
Music*: posy.bandcamp.com/
* When requested a lot I'll add a single of the end song.
Support my projects on Patreon: / posy
Tutorial attempt: • Motion Extraction tuto...
Posy on Spotify: open.spotify.com/artist/3zkrm...
Or on Apple Music: / posy - Розваги
You could've made this a plug in and charged €89 for it, but you just told us how to do it for nothing. Fantastic work as always.
there’s a company that charges several orders of magnitude more for a service that looks very similar to this
I mean, if the concept is known, then technical side isn't really that hard, someone would do the same thing but cheaper, eventually someone would make something like this but open source
The concept is absolutely simple and one of the most basic effects, subtract one image from another. This is what the inversion at half opacity technically does.
I think similar technology used in motion amplification cameras, and yeah, they cost a fortune, but you basically can do the same with regular video editing software
@@llMarvelousim guessing those are also high speed cameras, which justifies a higher price range a bit. High speed cameras are marvels of engineering, to me anyway.
This video is both a tutorial, a demonstration, and a work of art. Bravo.
Tutorial? Really?
No math, no code, no explanation on computing. Just nice video - nothing else
my thoughts exactly
agreed
@@TushhsuT he explains how to do the effect in the video... 1:15
@@arcadeprism I don't follow the explanation because I don't know what he means by "invert" can any one help me out.
'And just like that, seven minutes go by.' Those effects were mesmerizing. What a great seven minutes indeed.
The fact that you don’t use stock footage in these videos is simply mid blowing you most definitely should have more subscribers
Nicely done! Thanks for sharing how to do the effect. There's a paper from some years ago that used motion analyzed footage from high frame rate cameras to extract audio from the video of resonating objects. Seems like this method might simplify DIYing that process. There's also software that amplifies motion to detect unwanted vibrations and loose connections in machinery. That would be really useful for home auto and appliance repair. This might get the job done for that purpose as is. Maybe you could sweep through camera shutter speed in the footage to detect particular vibration frequencies, doubling this method with a stroboscopic effect.
Cant wait to see that video 😊
I saw a Steve Mould video where he talked about it.
I was also reminded of the vibration detection software - I think this looks cooler. As for somehow mixing it with stroboscopics, well, I might just buy my own camera if it's as cool as it sounds.
Fireworks might look cool with this too... gonna try making it myself
I remember that Ted talk! I always thought it sounded kinda suspicious but this video has certainly convinced me.
My mind immediately went to home surveilence/hunting cameras. For hunting, write a script to find a path of detected motion of a minimum pixel area (this limit perhaps modified by the Y position if the camera is observing a wide shot). Similar for home surveilence. Either of these could then trigger high intensity scrutiny via AI object detection. Another novel use would be with the chroma channel shifting he showed later... an augmented reality live feed from an external camera would be a very aesthetic way to have a security feed visible in a public space.
~PS: love your content
As a compositor I have used motion extraction often for separating parts of an image or removing snow/rain. I never really tried to use it as it's own effect in such an artistic way. So cool!
how do you remove rain with motion extraction :o
Would you use it to add FX such as rain/smoke/distortion to an existing video?
I just thought about using this to make a mask to extract elements from live action plates. Particularly things that are almost impossible to roto like smoke or semi-transparent cloth.
I suppose you can just use a difference map if you've got a static camera locked off shot, where the element you want to roto comes in after the shot starts, but this also works even if you never get a single clean plate of your background.
@@Somerandom1922 you can also just stabilized that part of the image with a planar track if you have camera movement and use motion to extract the rest
I was left in utter shock watching this video, totally speechless but then 6:55 happened and it brought me back
Same LOL
*"And ofcourse you could also use color, if you're into that kinda thing"*
05:48 * Blows my mind
I think your editing and your narration on top of this “motion extraction” is what made this video really great.
also the music
So what made the video great was… the video?
@@bacherfkinmcskiddlywop2491yes
@@3RR0RNULLpretty much
The narration was super annoying
I did _exactly_ this about 25 years ago ! This was before progressive footage was widespread, back then I was looking for a way to de-interlace interlaced (50i PAL) footage, but I didn't want to lose too much vertical resolution, so I ended up extracting the motion, using that as a matte so I could de-interlace the moving parts of the image (where interlacing showed the most) and leave the more static areas (where interlacing isn't visible) at full resolution, it worked pretty well !
Wow! That's so cool!
I also made a similar filter several years ago but did not upload the results (yet). But Posy's results are really beautiful I must admit!
that's pretty much how modern "smart" deinterlacing algorithms work
As an amateur video editor I really appreciated this video. Not only did this unlock a whole new world of creativity, it was also quite beautiful. Thank you.
I am also quite armature but this is crazy. Also Who do you think would win in a fight: John Wick or Harry Hart?
Videos like this will help so many people have a wider perception towards how not only is video the medium most art is made through but it can also show us details we can’t see ourselves
I always loved posy's videos. They're just masterpieces.
every video is like a damn fine art masterpiece and it's always worth the wait.
omg. it's the real egg. no, like, for real.
His movies are education art works.
I loved them as well. I still do too
It's the real youtube premium.
You just blew my mind,
I'm a graphic designer and I worked on video footage a lot, even composing abstract video clip for music artists and other projects. I've never seen something like this.
This will for sure inspire me for the future compositing and video projects, thank you !
That sounds amazing! Good luck!!
I laughed out loud when you said, "And just like that, 7 minutes go by!"
This is an amazing contribution!
I laughed out loud when Posy cut cheeze @6:55
Guy talking about his latest breakthrough in a serene voice while showing you the impressive results is my favorite genre of video
This should definitely be one of your top videos, it could inspire so many art projects
I'm wondering if this would be useful in forensics. To make it easier for people to spot things in footage which they might not have otherwise.
its used in factories to spot if screws are loose or if equipment is resonating@@zemja
Nothing beats his VFD videos 😇
i could imagine this being in some sort of surreal animation project
I read this comment just as Posy played a fart noise at the end.
This is the only channel that can bring back that childlike wonder and amazement Vsauce videos used to make me feel as a kid
o:
"...as a kid."
siiiighhhh.... and now I feel old.
thank you ghettosmosh
Lol you're young. (alternative comment: lol I'm old)
celebrities shop too...
I have never once been interested in photography or videography but this is one of the most interesting things I have seen in months. The ability to spot that deer is really what hit me, it's application can be both useful in that way, or beautiful if used like the rain drops one nearer the beginning
Woop woop that's the sound of da military industrial complex. WOOP WOOP
I feel like the magical energy of the world has been captured. This is so calming and beautiful
Excellent! This reminds me of the "motion amplification" process, that is used to survey the mechanical vibrations. By changing the framerate of the recorded footage, the surveyor can tune in on the resonant frequency of the device/structure, and then the motion amplification visually amplifies the movement, usually completely imperceptible by a naked eye. This allows to see the wobble that will in time damage the components, or even whole buildings - and prevent that by highlighting the areas that need attention/fixing.
I was just about to bring that up myself :D
Perhaps a video from Steve Mould?
A lot more goes into motion amplification than changing the frame rate. They do some frequency domain boosting.
the windmill shot at 5:41 blew me away. incredible work, and thank you for sharing!
That and the ferns one are art, they would be great looping GIFs
That shot convinced me I had a dangerously high fever and had just had "special" mushrooms.
I want to recreate it because it’s so pretty
I don't know much at all about video production, cameras, photography, or editing but in 7 minutes, you've made my brain create hundreds of ideas. Bravo, an excellent piece of art and an informative video.
Math explanation! You have managed to calculate the approximate time derivative of your video in one efficient step! Your video is a signal f(t), adding the inverse to it gets you f(t) - f(t), then shifting the additional part gives you f(t) - f(t + dt) for a small time change dt. This expression is proportional to the first derivative in time, which corresponds to first-order change, i.e. things that have a "velocity" in the video. By changing the time shift, you are effectively looking at different scaling of the first derivative. Really great stuff.
This channel is a hidden gem of youtube.
Yeah I know right, I find everything posted here extremely enthralling.
You took a very simple thing, that a lot of editors have probably played with at one point or another, but then went to the moon and back with it. Absolutely love the results.
It's just a difference mat and used all the time for all kinds of things.
A boring approach is used for comments like that all the time, just different opinion about other people's learning. I think calling things "just a common quality" is a common quality of comments that approaches boredom for me. This is just a difference sentence ;) Learn on everyone @@oBCHANo
this is amazing yet so simple to do. edit: make sure to use linear light blend mode if in premiere pro
W comment
I wish more videos were as good as this one: no bs, good vibes, educational, fun to watch, eye opening.
Its absolutely criminal that you don't have more subscribers. This was sublime.
he has quite a few
@@zanaisuAnd he needs more
Agreed! This video just earned my subscription.
Why do people always say this stupid line? Some dude could litearlly post their first video, it is amazing, and an oaf like you will be like "Why don't you have more subs?!??!?"
And he has 295k, which is a decent amount, so I don't even know what you are talking about.
@@pyropulseIXXI well, thank you for calling me an oaf I guess. That's a cool thing that happened today.
i feel pity for all the people who still didn't discover this amazing gem of a channel.
I was already enthralled by the effect but the aplication at 2:52 completely blew my mind. You're truly one of the most ingenious creators in this platform. Love to see your work
Classic Posy. Needs to add a disclaimer saying it's not stock footage because the footage is so good; it's hard to believe he took it.
He knows how competent he is. This footage is GORGEOUS.
So amazing how you combine art, science and playfulness, and something enjoyable comes out! Keep up the good work! :)
This is amazing! Holy cow, it scratched itches in my brain that I didn't even know about! That was some amazing complex use of simple tools and I am blown away! Thank you! Thank you! The shots of the rain droplet ripples gave me goose bumps!
This is one of the most beautiful tools Ive ever seen
I said it before and I'll say it again - The most mesmerising channel on YT! The knowledge and versatility forged into bitesize chunks which will inspire and encourage you to try and look differently on things around. This process was impossible to replicate from Steve Mould's video, Posy on the other hand - 4 steps! Duplicate, Invert, Shift, Change opacity to 50% - as simple as that. And the quality of his footage - absolutely new level. I want to see this on trending as I saw the LCD Display video which made me watch every content of his in one go. Absolute legend!
Awesome demonstration! That principle is used in most video coding algorithms and called DPCM (in interframe codecs). So only the moving parts of the image have to be encoded while the still parts are only encoded in certain intervals. Together with motion prediction it saves a ton of bandwidth at the cost of higher codec complexity and latency. H.246, MPEG4, HEVC or VP9 are just a few examples here.
When reading about how video codecs work, I had always wondered "but how do you track motion?" It seemed so complicated to analyze objects and track how they moved, vs. just new or even existing visual detail. And then I see this, and it gets 100x easier to see how it would be done.
Which seems really obvious now, as inversion and summing are essential building blocks of audio manipulation (M/S, surround decoding, glitch removal, changes in phase -> EQ, etc.)
the way you made an analogy between the visuals and the music at multiple points was impressive
Desperately need the ending song as a single on Spotify
This is actually really cool for making particle effects, for example with the fireflies. You can overlay it on something else with a additive effect
I can't believe I never thought to do this! Those black backgrounds on particles like pollen, bugs, rain, snow, ect. are perfect for compositing, it's insane to me that I never thought to do something like this to extract those particles. I do it the hard way and simulate them with CG!
It's incredible how consistent the quality of your work is, i love this channel and helping me look at graphic design and interprétation differently
Nice footage and showcase of a technique that's well known in the medical imaging industry since decades, where it's called optical flow and mainly used for image registration.
you can also just use the difference blend mode at 100% opacity. I use this all the time, it's great for lining things up in space and time
I've said it before but you are genuinely one of if not the best creator on UA-cam. No other creator gives me such big feelings the way your visuals and music have. You are a massive inspiration. I appreciate your hyperfocus on the little things and it makes me feel a little less alone. Thank you for sharing this stuff with us
Wow, what a beautiful effect. And meaningful -- pointing out nature's creative energy.
Wow, this has to be one of the most amazing things I've seen for taking normal footage and making it like Art. The effect can teach you what changes are relevant to express motion. Thankyou!
Truly fascinating. My jaw dropped when you started shifting the color channels! This is such a well made video. The shots, compositions, effects, music, narration, the creativity. Incredible. Thank you for making this!
we need a full tutorial on this, incredible
I've got a github repository with a python implementation if you want. Not sure i can link it here
@@K4leidosif you’re serious maybe you could give it a try and paste a link - after all links do work in the video notes? Or maybe just give us the name of the repo? (a quick search on your name didn’t find it, but if you give your GitHub username and repo title that would work..
@@K4leidos Could you please tell your github username? I'm very interested in trying!
Absolutely amazing.
This is incredible but I am still lost a little at how you isolate the motion and colors so well. Could you show how you do this in more detail? I want to use this in “haunted” locations
You basically have multiple videos half-see-through, like looking at a picture through a picture
You then shift the colors of each one, and make it so there is a delay on one of them
The parts that arent moving are the same in the time 15:45 in a video and in 15:46 but the parts that are moving will be changed, this means any motion will desynchronise the colors between the videos making those results
@@eeeguba432 I understand the basic concept, but when I did all that it does not look as good as he demonstrated in the video. I am requesting a video with more detailed steps. Thanks though.
@@carlcrusher ahhh, thats what you meant, whoops
Well, i guess if someone is more confused they will have an explanation there lol
He has a tutorial on his second channel if you're still looking for more info.
Try using the "difference" blend mode on the second layer while keeping it 100% opacity and positive colors.
You can then add another "original" layer beneath these two. If you want to have the movement over the original layer, and then select "lightness" as a blend mode for the middle layer. It would work better maybe if you export the movement layer beforehand. But might still work. Haven't tried his "inverted + 50% opacity" solution though.
This effect is awesome, and some of those shots are breathtaking even before it was applied. The quality of your videos continues to amaze me.
I love this. Thank you for genuinely great content with zero fluff and zero clickbait!
I already thought this was cool but seeing the steps on the stone path completely blew my mind.
Some videos shouldn't stop. Brilliant subject with quite intriguing visuals as always! Awesome!
Posy I'm so grateful that you document the destinations that your curiosity takes you. I've never seen better use made of a good video camera. Fantastic work as always 🎉
this is mind boggling. so simple but effective
This is the most beautiful and unique concept I think I’ve ever seen honestly
Fantastic video! The technique you've shown for isolating the moving parts in a video has several practical applications, including in the field of video compression. In many compression algorithms, the focus is on capturing the differences between consecutive frames. This approach ensures that only the changing elements in each frame are stored, leading to more efficient data usage. What's particularly fascinating is the evolution of these algorithms. While early methods relied on basic difference extraction, modern algorithms employ sophisticated prediction techniques. These advanced methods not only identify changes but also predict them, leading to significantly more efficient compression. This evolution marks a remarkable progression in our ability to handle video data more effectively. Great work demonstrating this concept!
Yeah, the example where he first shows how to do it and the motion appears, it looks exactly like a playing a video file with corrupted keyframes
It is actually used for industrial equipment to see if everything is in phase and not moving to much. I was mesmerised but thought it would be much more complicated. 🎉 Thanks!
You truly are an artist. I could just watch this on and on. The endless visual soundtrack to life. And it ends just like life often does. Exceptional observational skills.
You’re easily one of my favorite creators I’ve ever come across on UA-cam. Each of your videos is fascinating and unique. I come back to rewatch frequently and am ecstatic whenever you post. Thank you so much for all the time and effort you put into your work :)
I understand that a form of motion extraction is used in forensics to detect and display footprints on carpet, long after the perpetrator left the scene. The fibres slowly return to their original position after having been walked upon. All the best, Rob in Switzerland
this is one of the most fascinating effects I've ever seen and I can't believe I can just replicate it myself for free because you told it to me rather than sold it to me
Imagine the world if everyone put this much love, effort and ability into their work with a sprinkle of talent
This video is absolutely incredible.
The shot composition, the soundtrack; it evokes something.
And on top of that you just taught me to do one of the coolest video tricks I've seen in quite a while.
absolutely mind-blowing
Posy your videos are always so incredible, thought provoking, and usually also a visual spectacle; thank you for what you do.
06:04 Aurora Borealis? At this time of year! At this time of day! In this part of the country! Localized entirely within that clearing?
This is actually amazing, an immediately jumps out to me as something that could be insanely practical for use in home security.
This is truly one of my most favourite videos on UA-cam and I love to come back from time to time to enjoy this pearl
Finding this absolutly incredible channel was one of the best things i have ever done, the professionalism behind this videos is just wow 😦
I've saved this to my favourites... This is ABSOLUTELY incredible. Thank you for your art and creativity!! I am so inspired now.
There are so many beautiful ways to look at our world, I can't believe I hadn't thought of such a simple yet elegant way through image processing!
I have never been more enchanted by the simplest edit with imaging before.
I've been into video editing for years but this really is divine.
Y'know the dear thing makes me feel like this could be a really useful tool for crime scene analyzing
You make PERFECT videos. As always, I LOVE the music as well. I can see from your videos that you truly approach life with a curious and creative eye and each of your videos is very inspiring to me. You are my favorite creator on UA-cam, 100% thank you for all the effort that goes into making these. The passion shows!
Excellent vibes - instantly subbed! The wooden example and the rainbow glimmer amongst color footage was sublime - something straight out of Annihilation
Can't even begin to describe what this video made feel.... It's just amazing.... We are nothing but a constant state of change, and I find that so beautiful.
Asides from the sheer beauty of those images I have to say the music and your voice is magic also! 🫶🏼
Another way to bring out the motion is to try and generate motion vectors from the footage. They are harder to control visually, but could produce interesting patterns that might be useful.
Very creative and beautiful video effects! I noticed that you can see this effect with your own eyes if you patiently sit very still and don't move your eyes for about 5 minutes. Then most of the visual field goes grey, except for moving things. Try it! I discovered it years ago while sitting on a hilltop and staring at a distant object, when I noticed I could see every ant moving in the dirt near me in my peripheral vision. (You have to resist the urge to move your eyes at that moment and just move the focus of your attention.) I would guess that some raptors use this to find rodents moving in the fields below.
Yes! I often did this while I was in school
the trick with the gravel path feels like magic!!
I was told, frogs can only see motion. I tried to imagine how it would look like so many times, but was lack of imagination. Now I finally understand how it works for frogs: how they are orienting themselves or how they hunt those insects, and why they attack little moving things. It is so amazing! Like I really looked through the frog's eyes!
That is a very interesting comment. I never knew that about frogs. The world is a wonderful place.
Phenomenal video!! When you split the RGB channels, it very much reminded me of a process in black and white photography called "trichrome." Essentially you can take 3 black and white photos with corresponding red, green, and blue filters and use each of the photos to stack into a single color image. The neat part is any movement between each of the frames will be highlighted by the filter color!
Not only is this artistic and beautiful. It seems like it would be useful for motion detection or making the detection more accurate by removing the unwanted sensor data. Maybe even be an aid for people visually impaired?
This video is a masterwork. Visuals and sounds, the whole world melted away. I was entranced in the motion of small things.
These modifications just reminds me that all is light and we are all just gods sparks.
This is very inspiring art! it's so simple but so versitile and you can probably make so much more stuff with it! Maybe a music video, maybe a movie, maybe just a compilation of cool clips! I'm really impressed that you keep finding these seemingly simple things and turn them into mindblowing experiences!
Your videos are always so calming and informative, you deserve recognition for your fantastic work
It's insane, it could have interesting applications if a program could do this live: hunting, tracking, etc..
It reminds me of this one video about motion amplifying cameras
What an incredible way to extract meaningful information from a video
the photography, editing, and sound design are beyond incredible
Always great to see a video notification from Posy. Imma go now and get some snacks to eat while enjoying this video
edit: Just watched the video and damn, such an interesting concept. It's so easy to achievable and looks very pretty too. I would love to see more videos like this lol
did you bring enough for the whole comment section?
you just perfectly captured my last acid trip. Amazing Video
This is insane. What a gem of a channel. I will be using this technique for understanding motion in animation, especially ambience. Thank you
genius. can't believe i haven't seen technique before. so simple, but powerful
I’ve known about this for a long time through code with processing but you’ve done an amazing job of showing and extending its use- thanks for the great video. Beautiful examples ❤
I've seen a similar effect on video games using the ReShade Post-Processing Injector (a tool for graphics programmers to create and apply "shaders" for video game software, it is a truly nice, quite intuitive and very fun tool) it's a breathtaking effect.
Anyways this video was great and also very interesting to watch, I've always loved this effect and this video covers it perfectly
The footsteps are some Batman Detective Scifi Stuff. Love it!
Truly beautiful stuff, this video brought me more genuine joy than anything I've seen on UA-cam in a long time
I like the potential military uses of this neat trick!
I am actually flabbergasted and started crying due to how beautiful this is.