Heroine's Theme - ft. GFPGAN Face AI [Tactics Ogre Knight of Lodis🎷📖]
Вставка
- Опубліковано 7 лип 2024
- As a solo performer who wants to play music and tell stories that are bigger than myself -- but is too socially awkward to actually collaborate with other musicians, what is there to do?
For a long time, we have had virtual studio technology (VST) instruments, so we don't need to hire session players and so on. Thanks to MuseScore 4 and Muse Sounds, I can arrange and have something I am pretty happy with and really stick to live recordings of sax and vocals.
Normally, I play all the parts of the story myself, and this was no different, but I thought -- instead of just seeing my face, what if I made up a few actors and actresses to sing along?
It's not perfect. I definitely ran into things that made the various AI tools come up with very weird results. And yet...I also feel strangely enamored by this as a first attempt.
0:00 Intro
1:42 The Musical
🎵 Song: Heroine's Theme
🎮 Game: Tactics Ogre: Knight of Lodis
🎼 Composer: Hitoshi Sakimoto
Things I used here:
1. Muse Sounds from MuseScore 4 for all instruments other than sax and vocals
2. MidJourney to create AI characters based on sprites from the Tactics Ogre Knight of Lodis game
3. @ProductionCrate 's Image Motion extension for After Effects to make animations from the AI-created characters based on my performance. Major thanks to Nater Crater on Discord for helping me troubleshoot this extension! ( www.productioncrate.com/archi... )
4. RealESRGAN and GFPGAN to upscale the Image Motion output with particular training on faces ( github.com/xinntao/Real-ESRGAN & github.com/TencentARC/GFPGAN )
5. @bycloudAI 's tutorial on installing RealESRGAN since I'm not a techie guy!!! • Real-ESRGAN Tutorial
6. Splice of all the Ogre Battle Saga maps from here: ogrewebbook.web.fc2.com/kyotu/...
7. High quality Ovis map from HighLordAnduin www.deviantart.com/highlordan...
*****
►SUBSCRIBE TODAY - support #TheCoverStory!◄
ua-cam.com/users/subscription_c...
►Take my video game music familiarity quiz!◄
bit.ly/VGMFamiliarityQuiz
►Discuss on the #subversiveasset Discord◄
/ discord
►Pledge on Patreon!◄
/ subversiveasset
Thanks to everyone who has ever contributed via Patreon, whether currently active or not:
JazzPunker | Crescendo | Daniel Short | Levi Bechtold | RhythmJigoku | Timothy Ball | | Richard Vs the Dark | zeppelin03 | Andrew | Banjo Guy Ollie | KcHecKa
----------
►EQUIPMENT◄
🎷 Instrument : Yamaha YAS-62III
Mouthpiece: JodyJazz HR 6M
Ligature: Rovner C1RL MK III
Reed: Legere American Cut 2.25 (old: Vandoren Java 2)
🎤 Mic: Electro Voice RE-20
📷 Camera: Samsung Galaxy S 22 Ultra (or Canon EOS SL1/100D)
🎛️ DAW: Reaper
🎞️ Video Editing Software: Adobe Premiere Pro CC
![The Mermaid Legend [Tactics Ogre Knight of Lodis🎷📖]](http://i.ytimg.com/vi/AluraQv42ys/mqdefault.jpg)
Really like how you're trying to push new limites everytime! Neat arrangement too.
always subverting!
love video
Wow, that went a lot better than I would have guessed based on the title. I've seen people mess with AI mostly for fun before, but I think this is the first time I've seen it used so creatively.
Great song too, Eleanor's theme was one of those childhood BGMs that just stuck with me and automatically plays in my head sometimes, so seeing it matched to matched to such thoughtful lyrics and writing was a real treat.
Thank you so much for this comment! I still feel like there is so much that could be improved upon, and putting such experimental visuals with such a sombre/touching music piece feels like a dangerous choice even now!
This is really friggin neat.
Thanks so much for checking out :D
what a quality video, it is truly astounding what you have done here well done!
the animation is really something else
on the one hand, running head first into limitations was disappointing, but it was also really interesting to see how far things got despite the limitations.
Thank You, man. Your work really means a lot to people.
Glad that you're back in control :)
Well done! Incredible showmanship put to work
Thank you sooo much!
Great work as always ! It's not peeerfect, obviously, but it's astounding what one man can do now with the tools we have.
That's definitely the way I'm thinking of it -- I'm really thinking about how tools can further empower us, not necessarily replace us.
This is so freaking cool
Glad you liked it!
Considering how much it took to do this animation without actual motion capture or video based tracking it's kind of insane how well this worked! You acted out everyone and vastly different characters and at worst everyone has Wiggly Jaw syndrome
Although trying to get some of the technical aspects working was a bit annoying for a layperson (i had to learn command line stufffffff), it ABSOLUTELY was in the territory of, "this is convenient enough that I could see myself putting it in my workflow."
And now I also have a vibe of what sort of things I can and can't do to avoid some of the bigger issues with eye and mouth movements.
i love this! you have a very cool style, and the AI stuff is crazy cool! you've inspired me to do some covers myself. i've only posted one (and it's definitely not as good as yours) but you've convinced me to keep at it haha. keep up the awesome content!
Really glad to hear any time I can inspire anyone. I'll definitely check yours out!
Wonderful as always my man!
I gotta say though, the characters aren’t perfect, bit with how fast AI seems to be advancing i’d wager we’ll eventually see a movie made with just one person acting
There are definitely a few things that have been recently announced/released that I wasn't able to use that already would push this a bit forward:
1. ability to deepfake the voice and animate face based on the text
2. ability to correct eye contact/gaze.
Lyrics:
Prelude
Am I beyond redress?
Main Piece:
Eleanor:
I must atone
Bear life alone
Carry the guilt mill stone....
Might I confess?
My sins profess?
Am I beyond redress?
With fury unknown
the necklace had shown (/shone)
Vengeance and spite of my own!
The worst part was I did not lament that boy's death...
I prayed with all my heart he would take his last breath...
Does that expose a man-hating monster in me?!
They said I should join the merfolk into the sea...
Father Hamen:
You had just cause
You broke no laws
in eyes of men and God.
Rest in the church...
far from the lurch...
Let our Lord guide your search...
War tests us all
The Wheel -- it calls!
Will you stand strong or fall?
It was a case of trauma I had never seen....
Obsessed with mythic merfolk and the far off sea!
Could there be something more to the necklace she wore?
Could it have been an artifact of vile sorcery?!
Eleanr:
I must atone
Bear life alone
Carry the guilt millstone...
Very PS1 style graphics!
Hey my friend,
I have a suggestion for you for your next video to improve it. Can you put the text higher ? The UA-cam bar is always on top of it.
I'm one of those who rely a bit more on subtitle since English is not my language.
Still thumbs up :)
AI is theft