amazing video! I cant wait until more tools are out that can use character sheets to make a character (for example, using a character sheet to make an consistant anime character to make an ai anime show) i hope if you find some of these ai papers that you could maybe feature them in a future video
@@DracoTheNinja Seems like ACE can easily create a character sheet. (Character sheet it typically refered to as a sheet of mulitple views of a character to then create a 3d model from) If your talking about something to manually create a high res mesh from? Also the latest Runaway and changing camera angles may help fully realise characters.
I just tried it, it's not very good. And don't even think about using it for upscaling. I mean.. I guess it's OK for turning some tiny, blurry thumbnail mess into an almost OK 1024x1024 square image, but you can't use it to take a decent image, upscale and unblur it like I was hoping.
Impressive compilation! And what I like about your channel is the lack of ego. This is a faceless channel, straight to the point, unlike other UA-camrs putting their faces everywhere, in desperate need to become famous. You’re doing a pretty good job, congrats!!!
I am really exited for X-potrait 2. One of the disadvantage of live potrait is that it can not move the head. It seems like this one will solve the problem.
I'm wondering if X-Portrait 2 works with initial faces in the images NOT facing the camera head on. In just a few demos on their preview, that seems to be the case when the videos start, however, we can't tell for sure if that's cherry picked and/or edited to begin on a later frame. But it is rather exciting that it works on different styles. Usually drawn hair in other portrait animators alike really broke apart with motion. In my opinion, portrait animation will really take off when we can plug in a side view of a face as the input and start working from there, or at least when slight side angles are reliable.
Always grateful for your videos. I really appreciate how you add a lot of open source and locally run AI. Have you managed to compare this AI upscaler compared to the dream one from your last video?
The reason they do such many videos because they can't earn on that, only paid courses and youtube. Fiverr and Upwork are not working platforms just a scam. So only one way make feel people they will earn a lot of money on that after buying their courses. UA-cam is a fucking scam.
Really keeping an eye out for Recapture if it turns out to be something I can play with myself. I can see some very useful use cases with some stuff I am working on, but it's hard to be sure without testing.
That joke at 7:52 makes you one of my heroes. Also, that GIMM-ick at 18:31 sounds cool, right? More frames equals smoother video. Except, humans have a limit as to how many frames per second we can see. So jumping from 30 to 60 is just going to explode the file size and do very little for your enjoyment.
while its true that we start having trouble getting the full use of framerates greater than 60, we still find good use of 120+ frame per second video. Yeah you're not going to get much benefit out of seeing some fast moving hair follicles, but any large object moving at considerable speed, or even small jostling movements in the camera will be considerably smoother
@@Misaki896 Important to note that modern monitors and televisions operate at 60Hz (exactly 60 frames per second). So anything north of that is highly impractical anyway because the machines literally can't display it--unless you were looking to do a "slow motion" effect by reducing your 120+ down to 60, in which case that's genius. My concern is that an obsession with "high-resolution" or "super-smooth" video may lead to needlessly high file sizes and bandwidth consumption where information is literally wasted.
@@dirtydevotee It's not common now until it is. Just like 4k video or 8k video. Insanely massive in size even before bumping to 60+ fps, until it becomes the standard.
@19:51 Would be interested to know how it compares to time remappling AE plugins like Twixtor & Bullet time and such - are there any comparisons to those as I'd love to know how this stacks up!
17:21 the problem will always be “batch sequencing”…..we’re still gonna need controlnet for while until someone comes with something better (hopefully for Flux Dev)
Is MVP paint textures are colors or also I don't know how you call it Basically does it also add texture maps like grooves and imperfections to make the object more realistic sorry English is not my first language
MVpaint will be the Kling, Sora and Minimax killer. Soon it'll be able to create whole scenes and only extra processing time for keyframes. You'll be able to make a 30 minute clip that can render in 30 minutes with better coherence than any model out there using a game engine running of a normal PC. No more huge amounts vram and multiple GPUs just to be able to render
I noticed on the second racecar example of GIMM-VFI that the video seemed to speed up and slow down - is that due to inconsistent framerate in the source? I’ve got some content with that issue that has no other known source that I’ve been trying to fix for a long time, wondering if I should try this tool (even if it’s inconsistent, I’m wondering if I can increase the framerate enough that when I sample back down to 24/30 fps, it’ll smooth out)
Mureka does not generate music, it does generate songs. What I mean, you can’t just create instrumental music, you have to write at least 50 words of lyrics.
Imagine a guy trying to render a video on blender or otherwise as a passion project without access to some massive render farm and he can only pull a couple frames an hour. Then you pipe it into 19:35 and interpolate all the extra frames that would take forever to render.
be so helpful if in the notes you had link to huggingface/source code or NOT AVAILABLE... Main thing most of us want to do after viewing is trying these out
32:30 - I would have to disagree about her face looking too polished. One thing that's always annoyed me about Flux are the plastic faces, but I'm not seeing them as much in the Ultra models.
Thanks to Mureka for sponsoring this video, a versatile AI platform to create music! bit.ly/4ehrdaq
amazing video! I cant wait until more tools are out that can use character sheets to make a character (for example, using a character sheet to make an consistant anime character to make an ai anime show) i hope if you find some of these ai papers that you could maybe feature them in a future video
@@DracoTheNinja Seems like ACE can easily create a character sheet. (Character sheet it typically refered to as a sheet of mulitple views of a character to then create a 3d model from) If your talking about something to manually create a high res mesh from?
Also the latest Runaway and changing camera angles may help fully realise characters.
Please consider ethical approaches to promoting these tools. Many men will use these things to harm and sexually exploit women and children.
how do i run the frame interpolation locally... its a 4090 so it should have enough vram
Yeah we can make a Kpop Idol realistic animation for monetize! 🎉
1:20 ENHANCE is going from a meme to reality
it's actually more like "imagine"...
AI hallucinated information gonna be real useful to CSI investigations
now every nerd could do it
Except the details are made up
I just tried it, it's not very good. And don't even think about using it for upscaling. I mean.. I guess it's OK for turning some tiny, blurry thumbnail mess into an almost OK 1024x1024 square image, but you can't use it to take a decent image, upscale and unblur it like I was hoping.
7:53 ayo what
thats true though
It's what everyone is thinking. That's the future.
lmao, that shit caught me off my guard.
Just straight up facts
He just said what we were thinking 😂
Impressive compilation! And what I like about your channel is the lack of ego. This is a faceless channel, straight to the point, unlike other UA-camrs putting their faces everywhere, in desperate need to become famous. You’re doing a pretty good job, congrats!!!
Thanks!
I can't wait to make and print 3d models from video
X-Portrait 2 is gonna make me go grab a 4090. One of the coolest things I've seen.
7:57 for por..trait video right?
he said porn videos, dont be shy we the adults say it as it is
HAHHAHAH
Pork videos
poiseex
cringe
I am really exited for X-potrait 2. One of the disadvantage of live potrait is that it can not move the head. It seems like this one will solve the problem.
7:55 Let be honest this is the main reason we look for new models upcoming and which one we can use locally
Where would you tell a noob to start? - Asking for a friend
@@mikol0070 right here
@@mikol0070 ciivitai
X-Portrait 2 face animator.... Yes! A tutorial as soon as it is available :D
GMM VFI + DINO + SAM 2 + PaintsUNDO = the BEST AI speedpaint
I really like how the InstantIR model added nipples to the statue on the right...
좋은 정보 너무나도 감사합니다 :) 매주 소식이 엄청나네요 >
7:55 easy, we've already thought about that before you said it.
The video is very detailed and clearly explains this new AI technology! Thank you
You are welcome!
I'm wondering if X-Portrait 2 works with initial faces in the images NOT facing the camera head on. In just a few demos on their preview, that seems to be the case when the videos start, however, we can't tell for sure if that's cherry picked and/or edited to begin on a later frame.
But it is rather exciting that it works on different styles. Usually drawn hair in other portrait animators alike really broke apart with motion.
In my opinion, portrait animation will really take off when we can plug in a side view of a face as the input and start working from there, or at least when slight side angles are reliable.
@7:56 That's the first time an AI News video has made me LOL 🤣
Always grateful for your videos. I really appreciate how you add a lot of open source and locally run AI. Have you managed to compare this AI upscaler compared to the dream one from your last video?
That 2D to 3D thing reminds me of that new Adobe Illustrator feature that can convert a 2D vector graphic like a person into proper 3D.
I'd LOVE to see a hands on for installing and using Consistory it so far seems AMAZING
*Few days later* :
Today we have a new ai for breathing.
The reason they do such many videos because they can't earn on that, only paid courses and youtube. Fiverr and Upwork are not working platforms just a scam. So only one way make feel people they will earn a lot of money on that after buying their courses. UA-cam is a fucking scam.
Few milliseconds later:
Today we have a new ai for teleporting.
Few nanoseconds later:
Today we have a new-
It me. God.
Excellent video, as always.
Thank you, your channel is one of the best!
Thanks for the awesome AI tests and reviews 👍👍
Great vid, lots of tools that aren’t mainstream. Thank you!
Amazing times and great vid!
Really keeping an eye out for Recapture if it turns out to be something I can play with myself. I can see some very useful use cases with some stuff I am working on, but it's hard to be sure without testing.
That joke at 7:52 makes you one of my heroes.
Also, that GIMM-ick at 18:31 sounds cool, right? More frames equals smoother video. Except, humans have a limit as to how many frames per second we can see. So jumping from 30 to 60 is just going to explode the file size and do very little for your enjoyment.
while its true that we start having trouble getting the full use of framerates greater than 60, we still find good use of 120+ frame per second video. Yeah you're not going to get much benefit out of seeing some fast moving hair follicles, but any large object moving at considerable speed, or even small jostling movements in the camera will be considerably smoother
@@Misaki896 Important to note that modern monitors and televisions operate at 60Hz (exactly 60 frames per second). So anything north of that is highly impractical anyway because the machines literally can't display it--unless you were looking to do a "slow motion" effect by reducing your 120+ down to 60, in which case that's genius.
My concern is that an obsession with "high-resolution" or "super-smooth" video may lead to needlessly high file sizes and bandwidth consumption where information is literally wasted.
@@dirtydevotee It's not common now until it is. Just like 4k video or 8k video. Insanely massive in size even before bumping to 60+ fps, until it becomes the standard.
Love your account man!
Thanks!
Cool stuff. Can't wait to try some of the stuff. 🎉
amr?
@shmebuloc huh? 🤔
Merci beaucoup...... I learned a lot with this video..... The World is changing.
You are welcome!
Can't wait to see ai + lidar
Flux has been a game changer. I'm at the edge of my seat wondering about their progress with open source text to video.
Really appreciate your videos mate, however can you make a video on how different companies are using these intelligent AI models in their workflow
You where going to say POGGERS clips
right
Portrait is cool for movie projects to get a story board across super fast
Can you make GIMM-VFI interpolation installation tutorial ?
ask Kijai, he built a wrapper on COmfy already
Really hoping they make X-Portrait 2 open source
When might we know if 2 is open source?
yep...now we can remake "culture" anime easily and cheaply. hopefully more tools will be develop in the future. haha
It would be a game changer for sure. I'm excited for UA-cam to have a lot high quality AI generated content.
Virtual keynote event video! Promising!
*Me at the beginning of the video:* 🐴👍
*Me after the video:* 👏🗿
thanks 😃
Boi went from a Hee-Haww Horse to Medusa's Boyfriend
What the hell does this mean 😂
@@eccentricballad9039yeah
I don't fucking understand either
@@upsidedownhorrorI understand. He’s just describing emojis but the emojis literally have no meaning
I like how OmniParser got the icon understanding wrong because it’s an image of an X, it thought it was a delete or remove function.
Definitely videos will be amazing soon :D
Too many cool things I need to add to Melies AI
CSI had this 15 years ago, remember that zoom into the license plate?
Finally InstantIR something that can compete with Topaz
"This is going to be a total game changer for po...videos" crept up on me hahahah
This is why i love this channel. Very educational😂❤
thanks!
X Portrait 2 seems like a perfect tool for memes. Hope they do release the code! Keep us posted.
@19:51 Would be interested to know how it compares to time remappling AE plugins like Twixtor & Bullet time and such - are there any comparisons to those as I'd love to know how this stacks up!
Imagine how good an AI based video compression coded could. be. 5x-10x. This would revolutionize the internet. 82% of internet traffic is video!
07:23 It looks like every character has the same tooth structure, meaning it replicates the tooth details from the input video exactly
17:21 the problem will always be “batch sequencing”…..we’re still gonna need controlnet for while until someone comes with something better (hopefully for Flux Dev)
Is MVP paint textures are colors or also I don't know how you call it
Basically does it also add texture maps like grooves and imperfections to make the object more realistic sorry English is not my first language
Diffuse map only. PBR is still inaccurate for AI to generate consistently.
Waiting for AI to be able to figure out 2D photos and build a VR setting with characters moving from it.
What a time to be alive
MVpaint will be the Kling, Sora and Minimax killer. Soon it'll be able to create whole scenes and only extra processing time for keyframes. You'll be able to make a 30 minute clip that can render in 30 minutes with better coherence than any model out there using a game engine running of a normal PC. No more huge amounts vram and multiple GPUs just to be able to render
Can you make a full video showcasing useful tools . Each for a short time and showcase most of the useful tools you know about. Thanks
I'm waiting for a real 3D model generator tool that is actually high quality enough to make final models, or close enough to final models.
I'm sure it'll get there. Eventually.
X-potrait 2 looks fantastic.
For InstantIR with a 3080, on average how long should it for an upscale like the provided "dog" example?
Great video
Thanks!
7:55 I was wondering the same xd
I noticed on the second racecar example of GIMM-VFI that the video seemed to speed up and slow down - is that due to inconsistent framerate in the source? I’ve got some content with that issue that has no other known source that I’ve been trying to fix for a long time, wondering if I should try this tool (even if it’s inconsistent, I’m wondering if I can increase the framerate enough that when I sample back down to 24/30 fps, it’ll smooth out)
it's probably due to the source. from their page, it seems like you can do up to 20x interpolation. doesn't hurt to give it a try!
my god i cant wait for xportrait 2
Am i wrong to feel terrified about all of this new tech?!?!?
Mureka does not generate music, it does generate songs.
What I mean, you can’t just create instrumental music, you have to write at least 50 words of lyrics.
i cant wait for recapture
I am an Ai generated profile mimicking a real person profile in YT comment section
this is an AI generated reply mimicking a real person
I'm Bert
@@MooseKnuckleWarrior hi bert
My name is Jeff
22:50 i wonder how did that big thing come out of that little body?
You will be successful in life
ca you run the InstantIR on cloudcomputing platforms ?.....
thanks for the video.how do i install instant ir?
Thank you
Welcome!
do a video on flux v1.1 ultra and show us the prompts
A.I really is going to be a game changer for "videos"
We can download it and run it locally. What does this really mean? Does it use any online service or works offline?
it works offline
@theAIsearch thank you
33:05 so no one gonna mention that everyone HAS THE SAME FACE??
I knew I wasn’t being racist
It's scary 😮
Imagine a guy trying to render a video on blender or otherwise as a passion project without access to some massive render farm and he can only pull a couple frames an hour. Then you pipe it into 19:35 and interpolate all the extra frames that would take forever to render.
I hope we can convert 2D Movies into 3D Movies in the future.
All 3D movies are 1080p, because they are not using 4k Blu rays.
I've never expected that the "enhance" bullshit on movies that we all laugh to is now a reality
be so helpful if in the notes you had link to huggingface/source code or NOT AVAILABLE... Main thing most of us want to do after viewing is trying these out
thanks😊
Welcome 😊
7:59 caught 😂😂 and agreed 😅
Great 👍
Thanks
32:30 - I would have to disagree about her face looking too polished. One thing that's always annoyed me about Flux are the plastic faces, but I'm not seeing them as much in the Ultra models.
According to the video introduction, in this program we will solve a mysterious question about the Loch Ness dinosaur
Bro please tell me what was your profession before entering on youtube, please bcz your knowledge and research are always fabulous,
7:56
only real legends know the sauce 😤😤😤😤😤😤
7:20 why bytedance ever released anything? x-portrait 1 for example?
MoGe 3d just need ai to generate the background and texture behind the models
Consistory has been around for a while
7:57 what the heck!!😂
thank god for chapter markers
i wonder how gmm-vfi would handle anime / cartoons
MVP is not yet ready for movies or games, but for fun maybe!
That ace ia ceazy
Gooner and corn addict
Hi, can you compile a video in which you use a.i tools to make money...like creating a cartoon using a.i and trying to sell it or some other ideas
This tool will be game changer 🎯 for .... 7:55