- 34
- 58 740
Matthew Taraschke
Приєднався 9 бер 2012
I am a science, technology, and AI research enthusiast. This channel aims to provide understanding and example driven analysis, mostly in the field of ai video generation.
Hit subscribe to dive deeper and join a like-minded community. I value your perspectives and invite you to share your thoughts and questions in my video comments.
Hit subscribe to dive deeper and join a like-minded community. I value your perspectives and invite you to share your thoughts and questions in my video comments.
Freejack II - Alex and the Immortality Megacorp (movie pitch)
Alex Furlong is about to retire... and enter the year 2029. After his tumultuous experience as a freejack, Alex legally assumes the identity of Ian McCandless and marries Julie Redlund, who becomes Julie McCandless. Disinterested in the prospect of running a mega corporation, Alex hands over all corporate responsibilities to Julie and embarks on a moderately successful acting career. Victor Vacendak, now retired from the bonejacking business, remains friends with Alex and they keep in touch. Alex is irritated about a new and wildly popular generative AI technology that is stealing his image and becomes increasingly frustrated with retired life. Meanwhile, Julie, near death, faces her own existential crisis. Corrupted by the power she wields within the McCandless Corporation, she uses its vast resources to pursue a new body for herself-a Bollywood actress who tragically died in a car accident in the 1950s. Alex, being a former freejack, decides it's time to step out of retirement to confront the new reality.
Production details: This video was made using a combination of AI and traditional techniques. 64 keyframes were generated using Juggernaut XL and then fed into Stable Video Diffusion 1.1, resulting in just over 90 usable clips for the video. 6 secondary overlays were also generated in Juggernaut XL. The clips were enhanced with a technique called "Real-Time Intermediate Flow Estimation". Suno generated the music and singing, using modified AI lyrics and style prompting. A few short voice samples were taken from the original movie. Asset editing was done with GIMP, Audacity, and FFmpeg. Several minor edits were done to the keyframes before processing. Everything was arranged for the final video, resulting in around 5,600 frames of AI generated animation. All work was completed in 4 evenings in my spare time, using freely available software on a Fedora Linux workstation.
Production details: This video was made using a combination of AI and traditional techniques. 64 keyframes were generated using Juggernaut XL and then fed into Stable Video Diffusion 1.1, resulting in just over 90 usable clips for the video. 6 secondary overlays were also generated in Juggernaut XL. The clips were enhanced with a technique called "Real-Time Intermediate Flow Estimation". Suno generated the music and singing, using modified AI lyrics and style prompting. A few short voice samples were taken from the original movie. Asset editing was done with GIMP, Audacity, and FFmpeg. Several minor edits were done to the keyframes before processing. Everything was arranged for the final video, resulting in around 5,600 frames of AI generated animation. All work was completed in 4 evenings in my spare time, using freely available software on a Fedora Linux workstation.
Переглядів: 25
Відео
Dieselpunk + Caribbean Pirate Style Test
Переглядів 90519 годин тому
Dieselpunk Caribbean Pirate style test in Luma Dream Machine. All 1shot generations. The 33 clips making up the video were generated with prompting only, no keyframe input from other models or real world sources. The music was generated using Suno with lyrics from a sea shanty called "Fish in the Sea", set to a heavy metal musical style. Basic asset editing was done with FFmpeg and Audacity. Al...
Agent Smith Fu: Martial Arts Test in Luma Dream Machine!
Переглядів 1,7 тис.14 днів тому
For this Luma Dream Machine test, I created 54 martial arts related fight scene clips using only prompting and no key frame input what so ever. Mostly kung ku is depicted and the scenes are arranged in no particular order. The music is 4 drum and bass clips created in MusicFX. The dubbing samples come from 3 movies, comment below if you can guess what they are!
Demon-Haunted: A Luma Dream Machine Test
Переглядів 15321 день тому
This is an AI-generated music video based on a single paragraph from "The Demon-Haunted World" by Carl Sagan and Ann Druyan. For this test, I bought a one-month subscription to the Sora rival, Luma Dream Machine. Forty-one 5-10 second clips were generated. Some of the clips were generated from only prompts, while others were generated from key frames and prompt combinations. The key frames were...
The Evil Tooth Fairy (Anime Animation Test)
Переглядів 203Місяць тому
For this test, I decided to take a step back and use an older and less accurate model. I rapidly generated 45 keyframes in about an hour using Stabile Diffusion XL, which were prepared for video processing in GIMP. I then fed those keyframes into Stable Video Diffusion 1.1 and accepted the first animated result that wasn't a simple pan or zoom effect. About 66% of the attempts produced some for...
The Boy Who Cried Wolf (AI Music Video)
Переглядів 121Місяць тому
The classic Aesop's Fable set to AI generated music and animation. With the exception of some key frames made with Bing Image Creator, all visual assets were made locally on a Fedora Linux workstation and server using both traditional tools and open source AI models. 52 key frames were extrapolated into about 7,000 frames of animation. The music and voice was generated using Suno and MusicFX. T...
H.U.G.H. - The Blanks (Cyberpunk)
Переглядів 234Місяць тому
H.U.G.H., Virtual Labor, and The Blanks are fictional elements in a video game I designed from 2017 to 2021, but never completed. As one of the commentators astutely inquired about in the Virtual Labor PR video, economic conditions are not as rosy as the environmental ones. To see the original PR video for Virtual Labor, click here: ua-cam.com/video/DF3e318W-Zw/v-deo.htmlsi=gZrgSablrnpy6XQv Wit...
Virtual Labor PR Video (Solarpunk)
Переглядів 3872 місяці тому
Solarpunk style test, mostly 1shot generations. I limited myself to a production time of 5 hours. The video uses 22 key frames which were generated using Stable Cascade and Bing Image Creator. Those frames were then manipulated with various tools and models, including Stable Video Diffusion. The music was generated using MusicFX. The resulting assets were then stitched together and arranged to ...
Queen of Hearts (Alice's Adventures in Wonderland Prequel Trailer)
Переглядів 4472 місяці тому
A science fantasy concept trailer for a Queen of Hearts origin story, based in part on the 1865 novel, Alice's Adventures in Wonderland. I limited myself to a production time of 10 hours. The video uses 33 key frames which were generated using Stable Cascade, then manipulated in various ways with an assortment of open source editing tools and AI models. The resulting assets were then stitched t...
Retro Futuristic Racer Style Test
Переглядів 1353 місяці тому
A quick motion test for racing scenes. The video took less than 2 hours to produce. The key frames were generated using Stable Cascade. Those frames were fed into Stable Video Diffusion, which extrapolated them into more frames. The music was generated using MusicFX. Basic asset editing was done with GIMP and Audacity. All of the resulting assets were stitched together and arranged using a free...
The Lost World Novel Trailer (Arthur Conan Doyle)
Переглядів 2403 місяці тому
A silent film style trailer for Arthur Conan Doyle's The Lost World, written in 1912. The video uses key frames which were generated using Stable Cascade and Bing Image Creator. Most of those frames were fed into Stable Video Diffusion, which extrapolated them into more frames. The music was generated using MusicFX. Basic asset editing was done with GIMP and Audacity. Text for dialog boxes come...
Retro Futuristic 1938 (Dieselpunk)
Переглядів 10 тис.3 місяці тому
Dieselpunk style test. All 1shot generations. I limited myself to a production time of 3 hours. The video uses key frames which were generated using Stable Cascade and Bing Image Creator. Most of those frames were fed into Stable Video Diffusion, which extrapolated them into more frames. The music was generated using MusicFX. Basic asset editing was done with GIMP and Audacity. All of the resul...
Hugh: Command Line LLM Chatbot
Переглядів 1893 місяці тому
Hugh is a command line chatbot I wrote in Python3, built on the Microsoft Phi-2 research model. It's designed to assist you with any queries or tasks you propose, providing a seamless blend of question-answering, instruction-following, and creative command execution capabilities in a single conversational interface. With Phi-2 being a 2.7 billion parameter model, Hugh has a relatively low memor...
Retro Futurism 1959
Переглядів 8 тис.3 місяці тому
Retro futurism / scifi style test, part 2. All 1shot generations. I limited myself to a production time of 3 hours. The video uses 22 key frames which were generated using Stable Cascade and Bing Image Creator. Those frames were then fed into Stable Video Diffusion, which extrapolated them into more frames, resulting in 22 short video segments. The music was generated using MusicFX. Basic asset...
Billy and the Diamond Bullets (conceptual trailer)
Переглядів 1973 місяці тому
Billy and the Diamond Bullets (conceptual trailer)
BERSERK: Cinematic Fantasia Arc Trailer
Переглядів 6414 місяці тому
BERSERK: Cinematic Fantasia Arc Trailer
Final Fantasy VI Cinematic Characters
Переглядів 8125 місяців тому
Final Fantasy VI Cinematic Characters
Peter Dinklage as Simon Belmont (whip test)
Переглядів 1216 місяців тому
Peter Dinklage as Simon Belmont (whip test)
Jennifer Lawrence is Samus in Super Metroid: The Motion Picture
Переглядів 8 тис.7 місяців тому
Jennifer Lawrence is Samus in Super Metroid: The Motion Picture
Harry Potter 2077 (stylistic crossover)
Переглядів 1017 місяців тому
Harry Potter 2077 (stylistic crossover)
A Brief Conversation Between Isaac Newton, James Clerk Maxwell, And Albert Abraham Michelson.
Переглядів 8711 місяців тому
A Brief Conversation Between Isaac Newton, James Clerk Maxwell, And Albert Abraham Michelson.
Awesome 😎
this goes hard
The indistinct, nonsensical and constantly shifting nature of the people's movement and apperances feels like I am watching a recording of someone's dream.
Indeed, Luma Dream Machine is shockingly adaptable, but at the expense of some realism. The rapid pacing of the clip generation causes errors to be less noticeable. I expect Sora to be a considerable improvement, once it's freely available. Also, Google's video generator in the ai test kitchen looks like it has potential.
Goes very hard.
🤘
Nice, algotythm brought me here, already liking it;)
Thank you for your feedback, I appreciate it! 😄
I like it, please make more music
Thank you! I do plan on making more videos with this musical style in the future.
This reminds me of some Playstation games way back that had weird hit-detection. Bizarre indeed.
Track id???? Sick!
Track? Hehe it's 4x 70 second song clips generated in Google MusicFX, part of the ai test kitchen.
Woah....
This is incredible bro wow
Thanks man!
The world is a weird place. This video is weird. I see how they fit together.😀
Thank you kindly. ☺️
That flyover the sheep goes hard 1:11
Wow you are getting some amazing results!
Looks like an appropriate setting and possible future. What does H.U.G.H. stand for? Did I miss that part?
It stands for Hybrid Universal Goal Humanoid. It's the type of robot the guy in the blue jacket is, as well as his name. And no, nothing was missed!
I like how it goes from some fairly depictions of ww2 era technology to a dude sipping coffee near his BFG 1945
0:25 if ever you start to worry that advances in AI will lead to a 'Skynet' future any time soon, realize that AIs don't really understand what guns are, or even that they're rigid.
Indeed. And trying to get it to do convincing fire or cigarette smoking is difficult, no ability for proper physics in general.
💯❤❤❤❤👍
Love this green world you created and well done for pulling it off in 5 hours! Is it just me or does that one actress who comes up after halfway look like Anne Hathaway 😍
To be fair, Virtual Labor comes from a video game I designed as a hobby from 2017~2021, so I had some inspiration on the background material. Also, I was anxious to test out some recent frame rate improvements in my pipeline!
@@matthewtaraschke Awesome. Would be interesting to learn about any future plans!
Cool designs, I can kind of see another name being GreenPunk with the focus on trees, plants, vegetation within a future environment. I think there would be a gap in the psychological need to produce some sort of contribution to society though, we tend to enslave ourselves in our own minds. I'd be curious to see how 'sense of purpose' would be addressed, especially for dominant personalities.
Awesome.
Great vid!!!
The fun thing about these AI videos is spotting in the same well known people or things morphed into the same, in this case Emma Roberts, Brendon Frasier and Sir Douglas Haig.
Great. work! I can see this going somewhere!
Big advances in mouth movement when speaking! 👍🏽💯
Lots of twists make the story interesting, dialogue is a big help. Feeling a lot of 80's throwback dystopia paired with the modern a.i. quandry.
Wow this is awesome
Thank you! In retrospect I got a few of the characters wrong, but I think I did okay given the time constraints! 😁
@@matthewtaraschke give your self more credit than that man you did better than just ok this is really good man
i LOVE IT!! with Aubrey Plaza one-liner if I'm not wrong....;o)
It's actually a uniquely generated composite voice made using a text to audio model called Suno Bark. 😁
fallout 76 )))
Very good.
Resemble Tyrah the modeling show host Actually was one of the show that actually the host did more in making sure lady's look nice helping her own self
0:27 look like Angelina That might be how. Or better the Watchers of sky live come from But Men kind never
Classic tale that could definitely make it in modern cinema with the right writing, acting, and director I'm sure.
kinda cool
This is Really great.
Where is the rest?
I'm building up to longer and longer videos. My original videos were only 30 seconds, but now I'm hitting 2 minutes in some cases. As I get better with the tech, I anticipate 3-5min videos in the near future, and perhaps whole episodes of something on the horizon.
@@matthewtaraschke Looking forward to it. Thank you for your effort!°
Great aesthetic. Thanks for the info in the description! Really inspiring to try out similar techniques. 🙏🏻
Hey that's great! Would make an awesome Heavy Metal episode!
Excellent. Well done.
found it cool
Face detail and motion keep getting more awesome!
I love all the retro futurism; I've been trying to do the same thing with DALL-E 3; great work!
Great work on this!
Cool, very strong ShadowRun vibes. Informative too. Glowing eyes are a wild touch.
😮the woman with flower's in her hair
Nice!
Nice bro!
I love how she is a Samus just as much as Mystique. She seems as a different version of Samus for her suit not having the blaster for her laser and missiles. I love to see more of this, Jennifer Lawrence as Samus.
Technology has improved since I made this, I may make a new video soon that is more faithful to the true video game appearance and addresses some complaints I've heard.
Nice!
Cascaaa! ♥️
timothee chalamet would actually be a good griffith I think.