BAD AI Commentary!
Вставка
- Опубліковано 4 вер 2024
- I'm finalising my AI commentator to be released soon to anyone who wants to tinker with it. This video shows it working about 90 percent autonomously.
The previous version was using text based inputs to generate the output and while this gave very creative and exciting commentary, this needs to be 100 percent autonomous.
So now, this version is using game telemetry data instead. It still has some bugs such as being repetitive, but I'm figuring it out.
If anyone is interested in the app, pop me a message and I'll add you to the list of people I'll share it with to test.
What is currently can do:
Commentate on overtakes on the protagonist.
Commentate on overtakes on the top 10.
Recommend camera focus car for the replay.
Sending the data to Claude and Elevenlabs for commentary and audio generation.
What still needs to be implemented.
Identifying collisions.
Identifying attempted overtakes.
Identifying corner names for the commentary.
Being less repetitive.
Better handling of positional changes and identifying of important focus points in the race.
AI commentator fights his demon possesion throughout an entire first lap.
When the A.I. starts that weird growling/screaming noise, it sounds like Anakin burning on mustafar😂
As much as the demonic possessions, I am going to have to refine the voice sometime as its messing with the timings. But, it's one of the last things I'm planning, so no exorcist just yet
Couldn't stop laughing, especially when the AI starts screaming. Can't wait to test this in my own races.
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
@@DanielBORN394 Already had joined, would recommend to put the link in the description.
3:33 a miniature brewery, bubbles causing micro vibrations? oh god i'm in tears
I love the randomness of it. I have pushed it that direction, so each driver has a random backstory that's stereotypical of their nationality, but I still think it's very funny
@@DanielBORN394 So you came up with the brewery or was the prompt to generate a "believable" stereotypical backstory?
By the way, I'd love to join the testers as well (Discord link expired again :( )
@@davidkoall2284 The entire stories of the drivers is made up by the AI as well as how they are using it during the race. So Germans are have breweries, Americans are in a space race etc. I'll send the link when I'm at a computer.
Eager to see this develop more. Would love to utilize something like this simply for internal league highlight reels, but I know you've mentioned it's only working in ACC right now. Would be so cool to see something like this come to iRacing - this is just fantastic. Hope to join your Discord when you're able to get invites sent out again to keep tabs on things!
Thanks. I'm back home again so will post my discord link a bit later. It should work for iRacing once I can make the conversions in the UDP data. I think it works pretty much the same as ACC, so shouldn't be much of a hassle to have it work on multiple sims.
Can't wait to have it released! I'm an experienced CTO and I'm working with AI too in my projects. I'm an admin of the Raptor Racing Team, that's why I'm always searching for new opportunities to join those two things in my life.
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
"THE GAP ~ah~ah~ah~ah~ah~ah~ah~ah~ a mere 0.3s"
Terrifying... and hilarious. It even stutters better than I do!
Lol. I am in two minds whether I should train it better, or leave it as is.
6:43 ngl sounds like a legit Ferrari radio message. Maybe add "we are checking" and it would be perfect 😅
Lol. In one of the earlier videos it actually came up with that line :-)
commentator being stabbed in the battle of hastings?
Absolutely love this and see the potential to add even more craziness to my community. Please add me to your test list. Thank you.
I'll post the Discord link in a bit. Sorry for the late reply. I've been away the past month, so haven't had a chance to do anything with this.
This is hilariously awesome
The AI seems to be getting worse and it's losing its shit over it screaming and growling much more than usual.
I think Eleven labs changes their recipe occasionally as the settings haven't changed. But, I'm going to retrain it soon as the growling and possessions are fun at the start, but actually get a bit irritating after a while. I want the same enthusiasm in the voice, just a little toned down.
I must say, I really like the spontaneity of the comments from this commentator. Especially the brewery backstory. Does this also work in practice and qualifying?
I haven't set it up yet for practice and qualifying yet. Currently because it's using Claude and Elevenlabs, it can become quite expensive to run for a long session. When I'm happy with the current version I'm looking to move the commentator over to Llama and a different voice model which are free. It'll take a lot of local processing though and might take a little step back in the voice itself, so I'd prefer not to for the time being.
yes, ready to test this on my own races ! :D
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
disturbing on one side but this was freaking hilarious with the weird noises it did.
I'm in two minds whether I should fix the sound coming from the commentator or not. I am always taken aback when it starts becoming possessed, but the extra weirdness sometimes makes the timing go off in the output.
I want!! ready to test this on my own races TY
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
I'll try post on here each time there's something new to report. It still has quite a bit of a way to go before I'll be happy sharing it, and then it will still need further fiddling by much smarter people than I to convert it to an exe file. Right now it's in python, which isn't the most user friendly language for the end user
4:44 bro start speaking Chinese lol
Funny as hell mate, keep it up*
Thanks. Its getting there
will happily test, would love to see how you achieved it.
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
Urghagh uuuur and we’re off 😆
:-)
What the heck is going on this time 😂😂
No idea. I think the commentator needs to tone down it's 'creativeness' now 😁
Happy to help this is great lmao
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
up for test here.
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
Please leave this mode as an option even once you get it 100% working 😂
5:05 Has he lost control? NO!
I think this is actually going to be the whole core of the AI going forward. People will soon come up with a much better version, but I like this janky version more.
I don’t know wtf this is , but it’s Hilarious.
Could it work with Ams2 ?
It should work the same, but there would have to be quite a bit of changes to to variables and structures of what's coming from the shared memory and UDP data. I am still learning how to program, so I've messed up a bit already by not making this more modular, which would have made it easier to swap for other Sims. But when the ACC version works 100 percent, I'll fix it to make it easier for other Sims. I'll also send the code out to anyone who wants to make an AMS2 version when this version is done.
@@DanielBORN394 I know a smart chap that has made a functional auto director for ams2 , so he would no doubt be able to get it working well as is probably based off the same output rules for automating car in view selection .
Would you be able to put me in touch with him? I'd love to pick his brain about it. ACC has a broadcast app that I haven't used before, but will be using when the commentator part of this works 100 percent, so the camera will automatically switch to the correct position.
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
would love to test out your new app if possible!! i play gran turismo 7
Right now it's getting data from ACC, so won't work with GT7. But, when I'm happy with it, I'll start making it work with other games too. It's also done in python, so I'll probably have to learn another language to make it more user friendly
@@DanielBORN394 ah cool, i hope a iRacing version will be availible too
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
would this be able to work on an F1 24 league race?
Hey! In it's current form it wont be as it's fetching the data from Assetto Corsa Competizione. But, once I've ironed out the issues I'm having for it, it should be quite simple to use it for other sims as well. As long as the data is sent from the sim through UDP or a shared file which I think F124 does.
Hey Dan, is your discord still up and running? Cheers
Hey. Yes it is. I havent been at home since setting it up and won't be for another 3 weeks so nothing much has been posted. I don't have access to discord on my work computer so can't send out the invites again when I'm back.
I died. 🤣
Did you end up posting your discord or anything in the video comments or a way to get in touch? - Alan from Sim Racing Nation
Hey not yet. I only really get a chance to go on my PC once or twice a week. When I have a moment I'll make a discord and will send the link
I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
Would this work for any game?
In it's current form it only works in ACC, but it will be expanded once ACC works 100 percent.
@DanielBORN394 this would be awesome for our league streams. Please let me know if we can test it out, would be awesome. Thanks!
Sure. I've set up a discord for updates. Here's a link - discord.gg/RQfdDyWQ.
I try once a week to do a bit of fiddling before my race so it's slowly getting updated. I'll post how far I am there each time there's something to report on.
@@DanielBORN394 just joined, thank you! Looking forward to it. Let me know how I can help.