[DEEPFAKE] ROGUE ONE: MOFF TARKIN - IMPROVED AGAIN!
Вставка
- Опубліковано 4 жов 2024
- Seven months after I uploaded my attempt to "fix" the look of Moff Tarkin in Rogue One, I am back with another video trying to apply everything I have learned in these seven months. I am aware that applying deepfake to a CGI animation is not the best approach for this project but I have not been able to access Guy Henry's CGI-free footage. I hope you enjoy it.
Many thanks to my Patreon supporters for helping me to support this channel.
Please consider supporting this channel on:
/ jarkan or www.paypal.me/...
Thanks for watching!
Tool used:
Deepfake: github.com/ipe...
Twitter: / jarkancio
Email: Jarkancio@gmail.com
#Rogue One #deepfake
Christ, you actually raised this man from the dead.
@Jaeger19Ultima Are you kidding? The only difference is the lines. I've compared Guy Henry's impression and Cushing himself. They're pretty much identical.
@@GROENAASMusic He sounds like he’s doing a very bad impersonation of Peter Cushing and not good enough.
Meh... the movement is still off-putting.
I think the weirdest thing-in both versions-is seeing Cushing onscreen, but with more modern-styled cinematography, direction, and lighting.
I remember seeing that for the first time and cringed in the theater. It was really unsettling but also very impressive at the same time. It’s amazing how just a few years later it already looks dated and bad
@@guyswithnothingtodo it looked dated then since without deepfake, we're just not there yet. Put CG characters next to CG characters and it's fine, but next to real humans for now it always looks fake.
@@DOSkywalkR if there were only CG people it would still look kind of uncanny, but seeing CG Cushing next to real actors definetly makes his face's fakeness more apparent.
@@ginogatash4030 yeah, I didn't say "put him next to CG characters and he looks real", what I meant was the human eye gets used to CG characters when all of them are CG (or when they look different enough from humans it's ok to put them next to one like in Avatar or so).
@@DOSkywalkR yeah, I was just adding to your argument
The eyes look alive now.
Never understood why they didn't keep Guy Henry's eyes!
It looks better and it is very impressive, but it is still not quite there
I thought it looked "ok", until you showed the side by side. You just added a huge step up
This is nearly perfect. It didn’t look cg to me anymore. Looked like the same living breathing actor from A New Hope returning to the role.
I swear people are being a bit too choosy now. This is near Perfection.
The absence of perfection is a toe in the Uncanny Valley ;)
The shape looks better. The shadows and highlights don't write match the people around. Better than the original film though!
And he's not as shiny.
The face does look way better but the animated character still looks unnaturally stable and robotic compared to the real actors. Not much can be done about that I think.
Well, it's not due to a problem of the actor himself. The actor that played this Tarkin was present, looked quite similar, but, I think what causes the unnatural stability is just how the face is done, and maybe how the actor moved. He may have been told to move in a way that was a bit too stilted, but for a first attempt, I think they got it more right than wrong, but still in the uncanny valley. With the touch up, it does look far better.
@@Stargun-vj1uh Yeah, I wonder if they told him to keep his face relatively still to make the sfx job relatively simple.
The body is actualy an actor
That would be because motion capture isn't sophisticated enough to be used raw - a large part of the cleanup process is smoothing, which gets rid of many of the smaller movements alongside the tracking jitter.
@@gentlebabarian the lips not the body
The shadows and lighting were so off with the Original.
You nailed it.
I agree if I was Disney I would’ve given this guy the original footage with the original actor to use as reference points but he did an amazing job
Are you saved? If you died tonight will you go to heaven or will you go to hell?
Acts 16:30-31 KJV
...what must I do to be saved? And they said, Believe on the Lord Jesus Christ, and thou shalt be saved, and thy house.
God Almighty, the Creator was manifest in the flesh. He came into the world to take away the sin of the world. He gave up his own life to save yours. His sacrifice on the cross paid the price for your redemption with his own blood. On the third day he rose from dead and offers the gift of salvation and forgiveness to those that repent and trust in him.
This is the Gospel which means the Good News. Turn to Christ and live.
John 1:1,14 KJV
In the beginning was the Word, and the Word was with God, and the Word was God. [14] And the Word was made flesh, and dwelt among us,
Isaiah 9:6 KJV
For unto us a child is born, unto us a son is given: and the government shall be upon his shoulder: and his name shall be called Wonderful, Counsellor, The mighty God, The everlasting Father, The Prince of Peace.
John 1:10 KJV
He was in the world, and the world was made by him, and the world knew him not.
John 20:28-29 KJV
And Thomas answered and said unto him, My Lord and my God. [29] Jesus saith unto him, Thomas, because thou hast seen me, thou hast believed: blessed are they that have not seen, and yet have believed.
ua-cam.com/video/14y_VIJ2ZbM/v-deo.html
@@jesusisgod2953 im saved
@@jesusisgod2953 Okay...What does the Bible have to do with a deepfake video? No offence, but, there's a time and place for everything, and this isn't the place for talking about religion, you know? Wouldn't it be better to talk about that stuff on a video that's about religion? Just saying is all
@@XephThePanda
Mark 16:15-16 KJV
And he said unto them, Go ye into all the world, and PREACH THE GOSPEL to every creature. [16] He that believeth and is baptized shall be saved; but HE THAT BELIEVETH NOT SHALL BE DAMNED.
John 3:18 KJV
He that believeth on him is not condemned: but HE THAT BELIEVETH NOT IS CONDEMNED ALREADY, because he hath not believed in the name of the only begotten Son of God.
Beautiful! Gone is the dead, waxy look! I am shocked that Lucas doesn't go back and re-do it like this!
Cause Lucas no longer runs Lucasfilm.
I feel like you with a Disney budget could achieve some great things in the realm of Star Wars effects
I don't think so.... You realize he used the original footage ... From the movie
Youve given the character nuancical wrinkles and dimples and micro-expressions that have made the face far more human. The difference is phenomenal. Excellent work.
On the flipside, we are all about to enter a whole new phase in The Age of Fraud.
The original looked damn good and I had chills in the theatres....but if I saw your version in 2016 then I would have been floored! The lighting and touches you've added have brought Peter Cushing out of the shadows....
Seriously you have raised Peter Cushing from the dead, Perfection!!
The biggest problem with Tarkin in Rogue One, and something that no one has pointed out, is the fact that Guy Henry is way taller than Cushing. His body type is different as well. So it's not just the weird CGI animation, it's also the fact that this Tarkin doesn't look consistent with the one in Star Wars.
Great job on the deepfake though, I also noticed you brought the pink back in their skin, which helps sell the 'realism'.
Take a shot every time he says 'I'm afraid'. Whoever was writing his dialog really liked that expression.
There is still an uncanny valley feel because of the animation.
I would love to see a Sebastian Stan as Luke Skywalker
Well Luke DID come back, but it wasn’t Sebastian Stan however.
Much better. You fixed his eyes. Now at least they are looking at each other. Bravo
Absolutely fantastic!
Wow! Would it be possible to get a high res version so I can add it to my Rogue One Edit when it's done?
Amazing work! Absolutely amazing.
whats it gonna be called
@@kennethnorth7018 haven't got that far yet. Still working on the sequels.
Where can I follow this project??
@@dustinakadustin click my name
I wanted the same thing, I would like to see ROGUE ONE and the end of The Mandalorian without feeling that uncanny valley.
Hasn't he answered you?
I don’t understand why this isn’t utilized more in movies. It would be way cheaper to do and looks way better. Is this technology not for sale or something?
The technology isn't for sale - it's free. The problem with deepfakes is a) they're difficult to control - you never quite know what the neural net will plop out - and b) while they are good in aggregate (major facial features, contours, etc) they are bad in the details; the skin loses detail and gets smoothed out. You can easily see it even in this clip. That looks fine on a small display watching UA-cam, not so much in the cinema on a giant screen. I'm sure ways of fixing both those flaws are being investigated though.
@@KillahMate I agree with your last statement, they can easily do a deepfake, and easy fix whatever small flaws seem to pop out here and there (would be much cheaper than doing it the normal way IMO)
@@KillahMate I’ve never used or created a deep fake but from what I understand I thought the ‘smoothing’ was a time problem, given more time and detailed reference for the ai to learn from it gets better, or is there an upper limit?
@@Doiknowyou566 there isn't an upper limit theoretically - but it's both a time and complexity problem. Recreating more detail requires both more video for analysis as you say, and also a more complex neural net (and therefore more processing power) the more precise you want it to be. A less advanced model will never recreate very fine detail regardless of how much video it's fed. And a more complex net isn't strictly a matter of more power, usually a real jump in quality requires a whole new neural net design (like what the move to GANs was), which of course somebody has to invent first.
@@KillahMate Thanks for taking the time to explain.
Flabbergasting how the improvements have been done - it’s a credit to Cushing
You should overlay this with the original and set the layer transfer mode to "difference". It would show exactly what the deep fake targeted.
@Adam Haywood Subtract, divide, or exclusion then? It's definitely a cancellation operation.
@@SaltyViper Ignore him, he's stupid. Difference would work fine.
This version is the best so far! I think the structure of his his actual face really helps the deepfake, though the poor mouth animations hold it back. In future the ideal setup would be to makeup the actor with prosthetics to look as close to the deepfake actor as possible. Then it will look more natural.
I’d buy this version if you sold it
You have succeeded to bring him to live. It is all in the eyes. Wish someone would redo these scenes in the full film.
You make difficult cgi look easy, keep up the good work !
Yeah this is a lot less uncanny and doesn't feel out of place anymore, nice job
I guess we still can’t get rid of the uncanny valley, but damn, this looks much better. This one even lacks the dead eyes that deep fakes like this usually have.
Upper lip and eyes still in the uncanny valley
We need a version of the movie including this stunning fix!!
The only problem of using deepfakes over (or I should say above) CGI Footage is that it also uses the horrible CGI captured face motion, but yes, this looks WAY BETTER than the CGI face.
The original doesnt look like a human being. You fixed it.
The fact this is so well done supports what some others have said. It’s the body motions that are off, not the ‘look’.
You can't complain about this. It's pretty much perfect.
Brilliant job, mate! I can't imagine how long it took to get these results! It looks infinitely better than the movie does... so, maybe, Disney should've hired you? Hopefully your work reaches a bigger audience, because this is great!
Yes, this looks way better than ypur first attempt.
Very well done. 😊
This is perfect. Espc the rubbery mouth movements from before are fixed. You should be hired by a major studio, im serious.
WOW! the features look so much better! The colouring in his face is much more like the original trilogy Tarkin as well
You just nailed it! Awesome! Far better than the original!
This is the perfect fix!! More natural and realistic than ever! There are 2 another problems with -TARKIN CGI in Rogue One:
No accurancy of Tarkin's Hair with ANH footage.
-Stature of both actors don't seem the same, in Rogue One Tarkin looks taller than ANH.
Hopefully Disney could edit the film and fix Tarkin and Leia CGI wirth deepfake and other details with CGI.
Ok Georges has to re do EVERYTHING AGAIN now
Now I'm not jarred out of the story. As Yoda says, "Do or do not. There is no try." Applause, my friend. Now you need to put Christopher Reeve in Superman Returns, with Margot Kidder inside the helicopter scene. That's the first one. Second one is Gene Hackman and Christopher Reeve chatting on the new continent filled with Kryptonite where Lex shoves Superman down the stairs.
I mean, please, can this not be incorporated into the actual movie? It's perfect.
You NAILED it. The key is the eyes and skin texture.
You know what we wait for now, dont you? There is a certain tv episode of a star wars series, wich offered a cgi face that needs to be fixed....
Cushing himself as a normal person is already intimidating enough, they really didn't need to make Tarkin look "meaner" in rogue one like they did. So glad your deepfake fixes this.
Wow, when Tarkin turns his head at 0:39, he looks real. Awesome job!
I found myself trying to follow the dialog and story rather than glare at the effects, which is a sign of good effects.
This looks so much better than the original.
I hope Disney consider editing this deepfake onto the movie on Disney+
The only jarring thing is when he's facing away and turns around and he is the CG model and the deepfake texture suddenly snaps on.
Makes me want to see a brand new Dracula film with Cushing and Lee...
It might sound strange, but your approach managed to reintroduce some face movements and emotions, which were present with Peter Cushing image in A New Hope, and were absent from Rogue One.
it certainly isn't perfect, especially up close, but this is MUCH better than the movies! Incredible!
I have a request - As a tribute to the late David Prowse, are you able to put his face in the reveal of Anakin Skywalker, when Luke takes off Vader's mask AND when he is seen as part of the Force with Obi Wan and Yoda??? Poor David Prowse was tricked into NOT being used in the scenes and was heartbroken. It would be a fitting tribute to the man.
I would actually love to see both versions!
Looks great, the problem with the old one was they didn't correct the fact that he also looked much older because they took his cast from a later movie. In yours, the movements are more real as well as the texture and coloring.
THIS IS GOING IN MY EDIT OF RISE OF THE REBELION THNK YOU
This looks much better! I still kind of wish they had just put Guy Henry in makeup to look more like Cushing instead of using CG. It worked with Mon Mothma, and I think Henry looks enough like Cushing for it to be close enough. The original scene took me out of the movie because of the extreme uncanny valley effect.
This looks much better than the theatrical version
you know, if they ever wanted to get a live actor to play Tarkin, they should get Charles Dance. Tarkin screwing Krennic over on the Death Star to his face is such a Tywin Lannister move.
Personally, I think both look absolutely magical. I'm enthralled by both.
Now what I really want to know is: How can we get this fantastic piece of work into a full cut of the movie? I can never bring myself to watch Rogue One with it's original and inferior Tarkin (and Leia) scenes again knowing that better ones exist!
The best. Jarkan to ILM. 👏🏼👏🏼👏🏼👏🏼
And your work is big improvement on the original, even atop the CGI animation.
The skin looks great. The head movements are still a little weird, especially when he first turns around while watching the super laser dish being installed through the window. I wonder if the height difference is playing a role too. He seems way taller and bigger than the actor tarkin, maybe we're just not used to seeing him filmed from the lower angle and so it doesn't feel real.
What is it about the eyes of the original that make them look lifeless? It's so hard to put my finger on it. This looks fantastic!
Crazy how deep fakes look more realistic than the original
Thank you, I hope they fix this and release it again. I don’t know why a major corporation like Disney couldn’t get this simple thing right. If you’re going to bring him back do it right. It’s the only thing about the movie that didn’t work.
Impressive. Most impressive. Makes it more natural looking.
Superb work. It now looks like Peter Cushing was actually there. Well done.
Nailed the lighting. You fixed the unnatural feeling for sure this time. I think that's is one mistake with deep fakes is the lighting and color. You killed it!!!
I have nothing new to comment about your very well made deepfake but I can say that I never realized Krennic had a lisp...
I actually prefer the original Tarkin,,,CGI ,,, but it was a thrill when I watched Rogue 1 to get more of Tarkin,,,he is just so ruthless...I got goosebumps when I saw him in the reflection of the Stardestroyer window, before he verbally laid into Krennik about losing a very vocal cargo pilot! 😅
looks so much better. When was Deepfake tech invented?. Surely they could have done a better job in the movie. It's one of the main things that hurts the film.
MUCH better than the last one but there are still moments where the mouth looks wonky.
Excellent work.Disney should employ you to upgrade a new cut.
The original finished product really upset me (and still does). One of the biggest effects companies in the world and the end result looked like a video game cut scene character. Really took me out of the moment when he was on screen which annoyed me as it was a great concept to have Tarkin back and Guy Henry is a fantastic actor.
Coming from someone who knows nothing of the technicalities of computer generated imagery:
That wrinkle in his eyebrow on the right makes the extra difference. Makes him look more skeptical with Orson. In some shots, the one on the left looks a bit better due to facial angle/shading definition, but again I think the one on the right looks more expressive.
Wish you were in the industry working with the big heads. Good job during these past months of analytics.
Why do large film studios not employ this technique more often, if at all? It looks to be incredibly reliable and manages to cross the uncanny valley, unlike some computer-generated renderings of human faces. It puzzles me.
The voice actor is perfect
Because we _know_ Peter Cushing is dead, we also know that any modern scene he's in would have to have him be computer generated, therefore we (the audience) are going to be automatically very critical. If one of the 'unknown' extras in the scene was also CGI, even if featured in a closeup, an audience likely wouldn't notice, because we wouldn't be familiar with every nuance of their face, etc. As many others have pointed out and even Jarkan acknowledges, movement is the issue. As stills they may look great, but temporally the movements are not what we are used to seeing in humans. (Especially the eyes and the lips!) I appreciate Jarkan's redo, for he strives for perfection. I believe it can be achieved, it's just not there yet. I shall stay tuned!
Grandisimo trabajo. Parece el Tarkin real de Una Nueva Esperanza
These are amazing you did a phenomenal job! If you’re ever looking for another idea, I recommend doing doc brown from back to the future. Since 4K format has shown all the bad make up affects for aging. Deep faking his face with his actual face what he look like in 2015 would be perfect. Another one in that same movie would be Biff and Marty McFly in Part 2. I know all these actors were really filmed well during that time and you’d have a lot of data footage to work with.
I never really understood all of the hate CGI Tarkin got. Before this movie something like this had never been attempted (as far as I know of) and for a first attempt I think they did a pretty good job. Yes, it’s not perfect and does look a bit uncanny, but still a pretty good job for the first try. This deepfake though is phenomenal! Now that looks like if Peter Cushing was alive and actually present on the set, well done!!
I’m not trashin’ it, but it looks like a very very very good video game cutscenes. Like the cinematic trailers for the assassin creed games.
Hopefully in the future there will be better technology to improve facial movements for these scenes. (Yes, I'm hoping for a new Star Wars special edition)
He looks absolutely fabulous for a dead guy of his age. WOW.
this is the best deepfake and beautiful. If Disney apply what you fix for these to the Star Wars character, it would be definitely real to see on the big screen.
The lower body movement always seemed fluid and animatronic in relation to the head. I often wonder if it’s less about the quality of the CGI face and more to do with there’s something wrong with the overall movement of the character. If you don’t nail the subtleties of overall movement, it will make the face stand out more in an otherwise negative way. It was always a package deal problem for me personally.
The only problem now is the lip synching looks a tad off like a videogame cutscene that has to make broad strokes with the mouth movement to accommodate for alternate language tracks. You can tell by watching actual footage of Cushing regarding how animate his face is as he talks and how wide his mouth moves even with simple statements.
3:32 sums it up
I just don't understand why Hollywood aren't implementing this technology enough. Rogue One looks trash, the Irishman looks trash. And Superman's moustache look like a joke. Yet there are so many creators, usually just one person out there that bring the original effects of a whole team to another level where it looks waaaay more better. What if this tech could go back and forth between different people and departments and people keep itererating. The effects would be fucking flawless. When are they going to use this technology more and actually seriously include it as something integral into the production pipeline. It makes no sense at all.
Yes, it's beyond me :(
You can redo this as many times as you want, it would still look like a Pixar character in a live environment. They should have stick with a silhouette.
Woow! I hope one day they fix this in the movie and the deaging in the irishman.
Truly excellent work!! Well done!
That IS Peter Cushing!
-The problem with shots like this is that you're applying the deepfake on top of the cgi. It helps the likeness, but if the performance was off then it can't do anything about that. It's was the same with Cavill in JL and Clu in Tron.-
It's a real shame we can't get hold of the original footage as shot.
Edit: Nvm, read the description. My bad.
I'm always impressed that people are able to do stuff like this. I've never understood how, but boy is it cool.
That being said, I think there might be something broken in my brain, because while I certainly can see the differences between the two, I never experienced the uncanny valley stuff that other people did. The original never looked bad or fake to me like it did for others. Even in this one where I can literally see the side by side comparison, they look different, but my Fake Human Detection System is never set off.
They should have just cast Charles Dance. Great work
As much as i would've liked to see that, Charles Dance has a much deeper voice, it wouldn't fit the character.
@@victhebric66 Well they recast Han Solo and he barely looks or sound like Harrison Ford, so why not Tarkin.
This is far better than what ILM did.