DS9 Intro in 4K | Remastered using Machine Learning
Вставка
- Опубліковано 26 сер 2024
- NOTE: Please see this video for a much improved AI upscaled DS9 intro (4K):
• Video
As a little side-project, I have been working on putting the artificial neural networks of AI Gigapixel to the test and having them upscale another favorite thing of mine... Star Trek: Deep Space Nine (DS9).
While I can upscale the image to a 4K resolution, I don't have a TV or monitor with a 4K native resolution to see if it looks better.
I have nonetheless made this video and I am interested to hear from people with 4K equipment if it looks better.
For more information head to:
captrobau.blog...
✨ Want to upscale your own videos?
I used Gigapixel AI to manually upscale each frame of this video. These days Topaz Labs have a special upscaling program just for video: Video Enhance AI. You can try it out yourself for at:
topazlabs.com/...
You can use coupon code CAPTROBAU15 at checkout to save 15% on all Topaz Labs products, including Video Enhance AI.
By purchasing a Topaz product using this code, I will receive a small affiliate commission.
![АЛАУДИНОВ у Скабеевой: эти их ВСУ нас НЕ ДОГОНЯТ 😁 [Пародия]](http://i.ytimg.com/vi/an0anqU4WGQ/mqdefault.jpg)
That makes a big difference, additional color correcting and enhancements could help further. Eventually the tech will probably make it possible to restore DS9 without pulling the original film.
Hm, you lose still too much information. I think that comparing this interesting attempt with the really remastered materials from the What We Left Behind documentary would clearly show that it is way too much of a compromise to the original quality possible to make.
Another thing is that part of the DS9 footage is 16:9 and proper remastering could add literary more to view...
Pulling the film isn't the hard part in case of DS9, the low res VFX-effects (like every space scene) used from season 4 onwards is. That would have to be remade in modern CGI ... or with AI Gigapixel. I would prefere that to not having a remastered version.
I'm not sure there is film of ds9 ... Things went digital.
@@cavaronev4869 The original files for those models still exist.
You know it's 10x better when you can actually see the Defiant turning into the Wormhole.
Amazing job! I played this side-by-side with what is available on Netflix, and asked my kids for their opinion. Everyone was impressed.
Good first attempt.
But I think the sharpness needs to be better to clear up the image along with color correction.
DS9 always had a bit of an 'bloom' to it that never sat quite well.
That is most fantastic! I played it side-by-side with a second monitor playing the netflix version. Huge improvement in clarity!
Gosh darn that's an upgrade. That'd make me sit through the DS9 intro more often.
This is one of the best Opening credits I've watched from Star Trek series, which gives me hope for a brighter and STELLAR future, where one day Mankind will finally explore the stars. Space: the Final Frontier. 🚀🛰️🛸
Even at 4K this just doesn't quite have the crispness of the TNG HD Blu-rays unfortunately.
I wonder if these AI engines could be trained more accurately to work specifically on DS9 content once we get some matching HD footage from the "What We Left Behind" documentary. Is that how these things work? If specific training works, CBS might be willing to spend a couple months to rescan and rebuild a few dozen strategic clips in 4K for AI training and then use the new AI to upscale the rest of the series.
A common concern is that this will cause a lot of inconsistency of quality between the rescans and the machine upscale. But I think, along with some manual touch-ups, it could work quite beautifully. Not perfect, but good.
@@poisax - Agreed, and although it would be tempting to include the rescans in the new product, I would suggest they be used only to train the engine.
@@jjones2582 Oh I'm sorry I read it wrong, that sounds like a great idea actually
I would never buy a product falsely marketed as "remastered". If paying for something, I expect the original negatives to be scanned in HD (or preferably 4K or even 8K like Baraka) and the CGI re-rendered (yes, many assets still exist: trekmovie.com/2017/03/01/ds9-clips-in-hd-cgi-re-rendering-next-on-wish-list-for-documentary-exclusive-details-video-sample/). Don't be fooled - this isn't AI. www.gbgplc.com/inside/ai/
The problem with the first few seasons of DS9 is that they were post produced in D2 composite instead of D1 component/Digital Betacam. The color difference is tremendous between D1 and D2 video!
Yeah, on a macbook pro retina screen, it looks a lot better than the blurry mess we're getting on Netflix, which is eye-watering. It's more HD resolution than 4K though. The slight jitter others are discussing might be due to a frame rate conversion (3:2 pulldown).
This is really impressive, I feel there is some kind of jerkiness in this video that doesn't seem to be there in the full HD version, but still impressive, I would really like to see more...
Yes I noticed that too. Perhaps in the upscale he also went from 25hz to 30hz and introduced frame stuttering
It makes me feel sad that the real high-quality film is sitting rotting in storage somewhere gradually deteriorating with time... Paramount could offset the cost by coming to an arrangement with Netflix or something to share the cost of restoring this series before it's lost forever. Hell, even a Kickstarter and let the fans decide how much we want it. DS9 is a masterpiece and it deserves to be shown in all its glory rather than the grainy mess it is now. They could really, reword the battle scenes as well with modern tech instead of reusing so many scenes as they did in the original run. Honestly, this show deserves it.
A kickstarter should raise a bunch
This is good. If I'm assuming a fan can do this, then CBS should get off their complacency and get this done, at least for the streaming versions. One thing I've wondered about ship and special effects: I wonder if it is technically possible to give the computer or AI engine detailed 4k models of ships, planets, station, etc and have the old version used as motion reference. Then the AI could literally rebuild the fx with new assets but still retain the blocking and motion of the original. A person would need to keep an eye on it, but not need to keyframe animate new fx. Just curious if the tech is there yet. A lot of properties could benefit from that. EDIT: and to be clear, this idea is thinking of a way for studios to HD a show without the overhead. Though the AI wouldn't be cheap, either. And that's assuming it'd put ships, etc in the right place, orientation, lighting, etc.
Lots of the detail preservation seems to have really worked, especially in the station detail.
The ship flying away at the end has some moments with real issues though, and the panning star field shimmering shows the weakness of the single frame approach. It looks like the idea has promise!
I'd love to see what this would do with the B5 panning over the station intro.
The system breaks down when it has limited data. That's it's biggest weakness. That's why the ship at the end looks so weird.
Can you please upload the footage so we can download it without UA-cam compression.
Machine Learning can do everything to upscale the image resolution.
This is my favorite Star Trek as well, the characters and writing are better.
Bravo!
Big props on the your work here, I am very much enjoying following all the niche uses for AI and the obvious benefits it presents at such an early stage, looking forward to following your progress, great job (:
I actually studied audio engineer years ago and fell away from it, but I am curious turn my hand at applying machine learning to audio. Are you aware of any projects going on in regards to AI/Audio? and do you have any suggestions of where I may want to begin my experiments?
Looks great, there's some jitter in some frames but it's good. It would be great to train the AI on the show.
How do you account for the loss of picture quality due to MPEG-2 compression and low bitrate (assuming it's a DVD rip). I'm sure the master tapes would provide even better results.
I can't really compensate for it. A DVD Rip indeed does not compare to the master tapes. With the same tools, CBS would be able to do a much better job than I can. It's a test, hopefully, in the future, the tech matures enough for it to be up to CBS' standards (my example is pretty rough). That combined with the better source could mean a DS9 1.5 for a fraction of a price compared to the too expensive DS9 2.0 (a true remaster).
CaptRobau By the way, how does the upscaling work on the earlier seasons - the first couple of seasons always looked way fuzzier with washed out colours and all sorts of videotape anomalies. The later seasons looked considerably better, I wonder if the rise in quality was due to the editing switching from analogue to digital SD video. Anyway, I can’t imagine even AI upscaling doing much for the early DS9 seasons, or even worse, the early TNG seasons (SD versions). TNG S1 in SD looks like it was shot with what I like to call a chicken soup filter, but thankfully we don’t have to worry about that anymore.
@@theemrpoint123 havent ttried but I imagine it would have issues like you describe
oh man... you made my day
Imagine If we could all donate compute power to this through BOINC and get the whole series fixed in a week... I'd be happy with an episode a week tbh though
UA-cam slaughters video quality.
It just looks like you've applied a warp sharpening filter.
Come on man, it's a little better than that. Besides, it's a proof of concept and the UA-cam compression isn't favourable either
amazing!
Looses so much detail in order to try and smooth things. This looks worse than when I turn on my TV's enhancements. The vid you link the description looks a bit better. But there is simply no way to "fudge" all the missing data of a 4k image from an SD image.
not bad!
it honestly doestn' look very good. i tried upresing video frames with topaz as well, and the distortions in the places where the AI gets it wrong are too bad. AI video upscaling won't be useful until we have plugs designed to learn from previous and subsequent frames.
some frames have too many noise and digital grain. but good attempt
HOE LEE CRAP. Impressive. Good work mang, keep this shit up.
this is not 4k its not even 1080 p there is another similar video look at this and compare
it is sharp, but I wish there was an fps upscaling ai to make video smoother... my eyes die when watching for example the voyager intro right here: ua-cam.com/video/Z_OylbFmMJU/v-deo.html (look at the white windows)
I don't think it looks all that good either, if you had higher resolution like HD to start, maybe you could do something (speaking of which maybe try to upscale some of the HD sample footage from "What We Left Behind: A Deep Space 9 Documentary" into 4K)... For the intro, I think the best bet would be to replace it with NeonVisual's 4k rendered CGI which is pretty outstanding... see ua-cam.com/video/mLmiz-Bs8ZQ/v-deo.html
maybe you could team up with these guys, who created this:
ua-cam.com/video/AtUmm5mTehM/v-deo.html
they could remaster the CGI things, maybe. I've seen some scenes from Voyager they re-did.
It would be the most awesomest thing ever :D
Oh well shut up and take my money 😍
I have to ask: please do the Toto music video for Africa. Please.
Please?
**NOT 4K*
This is upscaling, but not up-rezing :) It's not true native HD or 4K obviously... it's algorithms to enhance a sub-HD image with advanced sharpening, filtering, and playing with lighting and colors
Фуфло! Картинка дерьмовая. Японцы на своих мультиках такое уже давно применяют, и результат такой же - шлак.
My TV can do this by its own with his motion features. Sorry. This is Bullshit work
So your TV can also use a neural network and render the footage that takes a full day to render on a good PC in real time and have it look this good, I think you're the one bullshiting.
@@svenzo1199 jep. Because it has a build in processor that improves the picture quality on the same level. Because the improvement here is almost nothing.
@@Mister__Jey That's upscaling it only increases the number of pixels without increasing the image quality, hell it makes things blurier, this on the other hand is a neural network trained to recognise things in the picture and replace them with HD versions increasing image quality. So no your TV can't do this and it certainly can't do it in real time, I saw a huge difference here vs the original so maybe you're watching it on a shitty screen and can't tell a difference. I suggest you learn what you are talking about first since no upscaling method like bicubic, lanzacos, mozaic etc. can ever hope to match this even if they rendered the whole day let alone in real time. And stop being an asshole towards the guy he is doing his best to improve low-res 480p footage, this is probably the best it will ever look unless it was completly remade.
@@Mister__Jey And do you know how much effort he invested in this, he ran EVERY FRAME through the neural network individualy and then put them back together, and this video alone has like 5000 frames.
@@svenzo1199 and so what? still looks bad af and still looks the same as the processor does in my tv on real time. so total useless this thing here