Her parents wanted Caroline to be a dancer. To their disappointment she became a ML researcher. But she had a plan and her parents are proud. Movie coming this summer.
Now to sound racist but.... She is Asian. Here parents would have probably wanted her to become an Engineer/Researcher. But she may have had a passion for dancing. So she made an algo to pursue her passion and please her parents at the same time.
From the paper: " Since our pose representation does not encode information about clothes, we had our target subjects wear tight clothing with minimal wrinkling" It seems like the wrinkle generation may not be as decent as appears in these short samples. They did however provide significant generator improvements focusing on the face region, and I assume that similar targeted improvements could work for the clothing. Future work perhaps.
Shooow, isso vai viralizar e muito... Ainda tem imperfeições, mas imagine daqui a uns tempos o quão difícil será distinguir a real da edição, com um programa tão "simples".
It's impressive, but the motion quality does give it a wholly unnatural feel to it. But that's progress. All it takes is the right tool with the right algorithm to come along and they crack the final touch to perfect it.
It seems that the current algorithm just stitches in pieces from different photographs. You can improve the visible quality if input were higher resolution (e.g. 8K video) and you can afford enough processing power. However, for real motion blur, one would need to detect the actual 3D model of the inputs, re-render in another pose and the compute the motion vectors for each part. On the other hand, many people seem to be happy with the motion compensation used in modern TV sets which do this kind of stuff in purely 2D domain without detecting the actual objects and many still fail to notice the problems caused by the missing 2D->3D->2D processing. Motion blur can be easily created from those artificially computed intermediate frames if the generated frames are good enough (that is, it's enough that the end result looks believable instead of looking real because multiple frames will be mixed together for the motion blur effect).
...and now, ladies and gentlemen; for your delight and delectation...welcome to the uncanny valley! Seriously though, guys; great work! Can't wait to see the final version :D
little did the researchers know that the footage of nonstop aka marquese scott dancing was already artificially generated because that guy is an actual robot
That's really amazing but you can tell that it's morphing animation by watching gestures closely you can see the blurring through transitions. Still it's pretty incredible and another AI could probably be used to clean up even those parts. The more AI can understand how to use pixels, the more amazing things it will be able to do taking what's already there and making lifelike changes to it.
I think some of this type of technology is being used in the new Last of Us game. The recent gameplay video is just jaw dropping in how everything looks scripted but it's actual dynamic real gameplay. The way transitions can suddenly morph into new transitions based on reactions to the player and what's happening at that sudden instant is just unbelievable.
is very impressive in addition to full body tracking, transform other videos to 3d and inject those movements, how many gtx 1080 ti do you need for that? xD
Her parents wanted Caroline to be a dancer. To their disappointment she became a ML researcher. But she had a plan and her parents are proud. Movie coming this summer.
Now to sound racist but....
She is Asian. Here parents would have probably wanted her to become an Engineer/Researcher. But she may have had a passion for dancing. So she made an algo to pursue her passion and please her parents at the same time.
Danish Joshi That reversal is part of the humor of the original post, I think
Not to sound racist but...
Hopefully that movie will be directed by Clint Eastwood
hahahah
What always gets me about this video is the reflections in the glass.
This is auto-tune for dance
1:59
ya 😂
Auto-pose
Lol
Whoa this is amazing! I think I'm most impressed with details like the wrinkles on the guy's shirt and pants
From the paper: " Since our pose representation does not
encode information about clothes, we had our target subjects wear
tight clothing with minimal wrinkling"
It seems like the wrinkle generation may not be as decent as appears in these short samples. They did however provide significant generator improvements focusing on the face region, and I assume that similar targeted improvements could work for the clothing. Future work perhaps.
carykh should we be expecting a follow up to your dancing video then? :P
wrr
omg carykh
The reflection is cool!
I agree with Andrej Karpathy's tweet "That's the only way I can dance " :) Awesome work guy :) Its even generating soft shadows correctly!
Goosebumps!! Deep learning is REAL!
The shadows, the reflections in the glass... woow. I'm impressed
This is actually amazing!
YOU ARE AMAZING !
Thank you for doing this research ! It's fantastic !
Wow! This is incredible!
Ohh god. This will revolutionize EVERYTHING!
Wow that`s amazing! Congratulations.
2:57 I love her face and attempt at ballet
Target 2 is just t posing and spinning
Shooow, isso vai viralizar e muito... Ainda tem imperfeições, mas imagine daqui a uns tempos o quão difícil será distinguir a real da edição, com um programa tão "simples".
Thanks for sharing! Everybody be dancing now 😁
absolute mad lads
Nice to see you here😃
Sup bro how you doin
Nerd sat around computer room "I can't dance"
Second nerd: "I can fix that, with my computer, computers can fix everything"
Good work lol
Third nerd: I hold the camera
And the non-nerd, I need a job.
This is really impressive. Very good work
That was very cool. Amazing job! ;)
This is amazing !! Great work.
Impressive work. Congratulations!
That is a great job. Congratulations!
The cristal reflex! Amazing
This is really amazing!
This is pretty wild. Well done 👍
incredible work
Amazing work!
The subtle jitter and absence of motion blur makes this seem like stop motion animation
Yeah, they need to make it smoother. Maybe that's why they're doing dances similar to the robot
It's impressive, but the motion quality does give it a wholly unnatural feel to it. But that's progress. All it takes is the right tool with the right algorithm to come along and they crack the final touch to perfect it.
It seems that the current algorithm just stitches in pieces from different photographs. You can improve the visible quality if input were higher resolution (e.g. 8K video) and you can afford enough processing power. However, for real motion blur, one would need to detect the actual 3D model of the inputs, re-render in another pose and the compute the motion vectors for each part. On the other hand, many people seem to be happy with the motion compensation used in modern TV sets which do this kind of stuff in purely 2D domain without detecting the actual objects and many still fail to notice the problems caused by the missing 2D->3D->2D processing. Motion blur can be easily created from those artificially computed intermediate frames if the generated frames are good enough (that is, it's enough that the end result looks believable instead of looking real because multiple frames will be mixed together for the motion blur effect).
Thank you for this video. it looks great
¡espectacular me leere el paper! ¡gran avance, algo escalofriante tambien!
This is amazing!
This is amazing! :0
...and now, ladies and gentlemen; for your delight and delectation...welcome to the uncanny valley! Seriously though, guys; great work! Can't wait to see the final version :D
Really see a huge impact in the film industry
Awesome guys keep it up. hope to see more realistic ones soon :)
That's incredible. They still move with a bit of jerkiness, like stop motion people, but that's crazy impressive.
My professor pointed me to this, really awesome work!
Hilarious and impressive, amazing work!
This is crazy! So good
Impressive!!!!! great work!
Ждём в массы!
this is just amazing....
This is incredible but terrifying at the same time
Amazing Good work
Amazing! Please make more.
this is really amazing
Вы в танцах!!!
cool. great work!
We need more projects like these! Let the creativity flowwwww
Next level mischief.
awesome! nice work
Amazing!
2:24 jump in the CAAC
AWESOME!!
little did the researchers know that the footage of nonstop aka marquese scott dancing was already artificially generated because that guy is an actual robot
What Suprises Me More From The Video The Shadows Of The People Dances Too
This is amazing
Finally, I'll be able to do fouette turns.
Amazing! :D
Waoh.. Got to read the paper
hehehehe is very impressive. There is still a lot of room for improvement, but it is something very interesting. It opens up a lot of ideas
This is amazing!!! Incredible work, Bravo!
That's really amazing but you can tell that it's morphing animation by watching gestures closely you can see the blurring through transitions. Still it's pretty incredible and another AI could probably be used to clean up even those parts. The more AI can understand how to use pixels, the more amazing things it will be able to do taking what's already there and making lifelike changes to it.
I think some of this type of technology is being used in the new Last of Us game. The recent gameplay video is just jaw dropping in how everything looks scripted but it's actual dynamic real gameplay. The way transitions can suddenly morph into new transitions based on reactions to the player and what's happening at that sudden instant is just unbelievable.
2:57 I feel your pain :) Nice work
What amazing!
great research
this is so cool but at the same time terrifying
I wonder how long before we start seeing this tech in films? Might help with reshoots for example.
Filed under "Snapchat's next feature"
Haha, just amazing!
かがくのちからってすげー!
Nice!
interesting work!
First song in the video isn't listed, but it is Voyageur - Tear My Heart Out.
Was looking for this! Thank you :)
thank you my friend
Thanks but he needs to learn how to tune his guitar
Thanks are given to you.
Can't wait to see Trump dancing the default Fornite dance !
This is insane technology
The unsettling body movement reminds me of Jacob's Ladder.
the jiggly effect and kinda magnetic/robotic feel made it look a bit weird, but this is big!
Ah so fun! Your face correction is a good idea.
wow, imagine the posibilities, we will have more arnold movies in the future ☺
What is that first acoustic guitar song?? I can't find it anywhere.
Wow, it also got shadows alright! Looking forward for some open source resources!
Epic!
holy shit over 2 years old
Friends: how u suddenly became so good dancer?
Me: oh it takes a lot of smart work
wow. Got to check this technology out.
真厉害！希望能参加到你们组的项目进展中来
It's so lifelike [eye roll]
You can't even tell the difference! Just like Jar Jar Binks!!
Woah this is wild
Wow! So fun
love it
How can I find the exact version of the first song being played?
Increible :)
Robots learning to make humans do the robot. That's meta as fuck.
3:00 this actually made me laugh, it looks so goofy
That first source dancer, Marquese, is one of the best dancers I've ever seen. Go check out his UA-cam page for some mindblowing stuff.
Wow, this is fantastic.
Wow wow wow wow.
is very impressive in addition to full body tracking, transform other videos to 3d and inject those movements, how many gtx 1080 ti do you need for that? xD
It took me half the video to realize the source to target video was not a person just dancing along.