Linesight
Linesight
  • 9
  • 1 975 768
I Trained an AI for 2 Years on Trackmania. It's Breaking Records.
I trained an AI that plays Trackmania with reinforcement learning. It's getting good enough to challenge Official World Records. This is the story of how my AI reached such an incredible level.
Link to raw run playlist: ua-cam.com/play/PLZ-JKrjYnD1GBlp-WS3Mr8bKmqsqSSO-U.html
Link to replay pack: drive.google.com/file/d/19p10V3g4RfFUoUUdVWNN2RXwJmcXfHC2/view?usp=drive_link
Link to input files: drive.google.com/file/d/12Jfp6nDNhAb7vQIeUIao_VU0W8652s_r/view?usp=drive_link
Project Github: github.com/Linesight-RL/linesight
Game: Trackmania Nations Forever
Buymeacoffee: buymeacoffee.com/linesight
00:00 Intro
00:43 map5 (v1 and v2)
03:58 A01
05:10 map5 (v3)
07:27 Official Campaign intro
08:42 A02
11:11 D06
14:22 Official Campaign
15:59 vs TAS
17:14 Minitrial
22:04 Method
23:14 Zero-shot
24:03 Next steps
25:38 Finale - Hockolicious
27:04 Credits & Times
#AI #reinforcement #learning #trackmania #world #record #official #campaign #tmnf
Music Tracks:
Luge - Geographer
Instant Crush - Corbyn Kites
Subway Dreams - Dan Henig
Hall of the Mountain King - Kevin McLeod
I got a stick - Kevin McLeod
Envision
Arp Bounce - Geographer
Up the steps - Geographer
Shitsubo Shita - Josh Lis
Just Breathing - NEFFEX
Tinker Time - Nathan Moore
Contact us:
First join the TMInterface Discord discord.gg/PvWYGkGKqd, then head over to the #programming-talk channel discord.com/channels/847108820479770686/885481860539498508
This project would not have been possible without the awesome TMInterface tool, provided by @Donadigo.
Переглядів: 1 575 657

Відео

Trackmania AI Learns To Drift and Beat Pros ? | Hockolicious
Переглядів 351 тис.Рік тому
We trained an AI to play Trackmania on Hockolicious, one of the game's most prestigious tracks. The AI set a strong time, beating the 2012 World Record previously set by CarlJr. Link to map: tmnf.exchange/trackshow/414041 Link to replay: drive.google.com/file/d/1b0p2QSXAea1v7lVCGuWkNr-5xQ6PdqHo/view?usp=drive_link Game: Trackmania Nations Forever Project Github: github.com/Linesight-RL/linesigh...
Superhuman Trackmania AI Demo | map5
Переглядів 29 тис.Рік тому
Linesight project. We used reinforcement learning to train an AI that plays Trackmania. On its training track, the AI is faster than the current human world record. We put this video out as a challenge: can a human still overcome our AI? Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245 Replay (.gbx file): drive.google.com/file/d/1jfOyhRQCvOC5XSEhhajE2OvmJcCHKDjR Wir...
AI Plays Trackmania - Bloopers
Переглядів 3,8 тис.Рік тому
In this video, and AI is trained with reinforcement learning to accumulate speed and finish a map as fast as possible. The AI learned a behavior where it turns around right before the finish line. This is not a one-off mistake, the AI repeatedly did similar things in back-to-back runs. Can you guess why ?
AI Plays Trackmania - Map5 2:04:91
Переглядів 9 тис.Рік тому
The AI is trained via reinforcement learning. Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245 Replay (.gbx file): drive.google.com/file/d/1hp1Mz0ooR2YBNpqNjvvxjFrBOGXs8DYD/view?usp=sharing
AI Plays Trackmania - Training Progression Side by Side
Переглядів 3,5 тис.Рік тому
In this video, an AI is trained via reinforcement learning. In order from the top left corner, top right corner, bottom left corner and bottom right corner the AI has received progressively less training time. The video compares the lines taken by the various AIs in different parts of the map. Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245
AI Plays Trackmania - Map5 2:07:00
Переглядів 1,2 тис.Рік тому
The AI is trained via reinforcement learning. Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245
AI plays Trackmania - Map5 2:09:12
Переглядів 1,3 тис.Рік тому
The AI is trained via reinforcement learning. Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245
(Teaser 01) AI learns to play Trackmania with reinforcement learning
Переглядів 2,5 тис.Рік тому
This video is a recording of an AI currently training to finish a custom map as fast as possible with reinforcement learning. This run was played on Trackmania Nations Forever, with TMInterface to link the game and our AI. The run was played on a custom map. The .Gbx map file is available for download here : tmnf.exchange/trackshow/10460245 The AI took 2mn12s25 to complete the map during that t...

КОМЕНТАРІ

  • @anto_hms
    @anto_hms 12 годин тому

    Awesome video ! I usually don’t comment but this time I find it necessary that you see appreciation for what you do

  • @frammo5896
    @frammo5896 3 дні тому

    Love how the Nascar guy used a real life wallbang to good effect.

  • @najeebshah.
    @najeebshah. 4 дні тому

    train it to play CSGO

  • @JenosIdallian
    @JenosIdallian 6 днів тому

    This is not AI. You claim that you believe this is closer to RTA than it is TAS, and that is categorically wrong, on every level. This is brute force TAS clip building with rules. The only thing that sets this apart from a TAS, is you seem to eliminate things like track-length nose-slides and the like, which makes it appear closer to RTA, but is still tool assisted. This is not a 'learning' AI. There is no AI on the planet that 'learns'. All we have is iterative brute force computing bases that mimic language and input to create an artificial response within a set of restrictive rules and guidelines. If you believe your AI truly 'learns', then remove the neutral network rewards. That which learns is self-determinate enough to set it's own goals.

  • @subject7325
    @subject7325 7 днів тому

    bro heard of Roko's basilisk and said 'hold my beer'

  • @fun-Darius
    @fun-Darius 7 днів тому

    you should make a video of how are you doing this. Lot of things I do not get. Like when AI is controling the care after it learned - does he react live or he has key press combination already before the game? Or actually is it controlling with virtual wheel or keyboard? How do you even make it control the game? Game does not have API for computer program to control it or does it? And lot of those technical things are interesting. How the AI is trained?

  • @fun-Darius
    @fun-Darius 7 днів тому

    but slacilng down resolution and colors - colors are clearly enough info for AI . Now resolution - does it matter? and I did not even think it sees it like human. I would imagine it see some coordinate points of the track and lines joining those coordinate points. Hmm, but actually if AI can beat humans visually then this could be used in war. Try making world of tanks AI player or call of duty :)

  • @fun-Darius
    @fun-Darius 7 днів тому

    if it is hard to discover it for AI, why not help him ?

  • @fun-Darius
    @fun-Darius 8 днів тому

    hitting the wall to keep speed and not breaking a car is like cheating. The game physics suck if that is how it works. Maybe AI did not assume he needs to win by 'cheating'

  • @mach5406
    @mach5406 8 днів тому

    Please make your AI do the Deep Dip track.

  • @UnimatrixYoutube
    @UnimatrixYoutube 9 днів тому

    This is very interesting. There should be an annual international TM AI competition where universities, private entities and whoever wants to compete can race each other with their AI for fastest lap like there is with Robocup football (soccer).

  • @FrcNeru
    @FrcNeru 9 днів тому

    Not an AI, take your clickbait elsewhere. Too bad you can't use middle-school bully level tactics with the "pin of shame" anymore.

  • @PSYbuse
    @PSYbuse 10 днів тому

    Interesting.. Great content. 👍🏻

  • @jamesray2465
    @jamesray2465 10 днів тому

    No! You're kidding! An air got good at something it was trained on?!? If you guys spent 1% of your time trying to safeguard Ali's THAT would be an accomplishment, but you don't. Have fun playing with your ai.

  • @mz3437
    @mz3437 11 днів тому

    Hey! Amazing video. I find it, at the same time, a very entertaining and interesting introduction to machine learning/AI.

  • @DoctorDustpan
    @DoctorDustpan 11 днів тому

    Close to yrs 3

  • @K162KingPin
    @K162KingPin 11 днів тому

    The fundamental issue is that the AI has no idea what a car is. What a road is. Or even what it is. It has no concept of the fact that it is being asked to play a digital game based on real work items and mechanics. Until we can start teaching AI what the non digital world actually is, it will never become general intelligence. So far the closest we have been able to come is to teach AI to make digital representations of the vast majority of the world and the things in it, but that still doesn't breach that gap of understanding. Its like trying to teach someone who has been blind from birth what a color is by converting colors from a camera into sound. Sure. They might start to comprehend on some level the variations, and combinations. But they will never really understand what color is, let alone sight.

  • @m.x.
    @m.x. 11 днів тому

    This should be "humanity" (whatever you think that means) VS "humanity", because AI is a human tool, not an independent entity with self-consciousness. Period.

  • @m.x.
    @m.x. 11 днів тому

    Anything that an AI does has no value for society if it's not for automating human tasks that nobody wants to do.

  • @tobias7475
    @tobias7475 11 днів тому

    this is actually terrifying.

  • @themanthemyththelegenda
    @themanthemyththelegenda 13 днів тому

    I’ve got an idea. don’t try and be as fast, be as OPTIMIZED and EFFICIENT as possible. Try to have behaviors like a TAS run. And maybe as fast as possible because it’s cool seeing the ai blitz maps

  • @mikethk
    @mikethk 14 днів тому

    For an AI to find shortcuts, you have to add "Try something new" function. Something that will trigger the luck. ??

  • @Thetitaniumsteppermotor
    @Thetitaniumsteppermotor 14 днів тому

    Im starting to get really curious.. what if the ai plays "TM 2020" im curious on how this advanced network would handle the boost tiles and hovering on water. Especially the random turbo pad and the new car modes with the desert snow and rally cars

  • @niannolan
    @niannolan 16 днів тому

    Please keep up making epic videos about your ai, even if it's just demonstrations, not improvements!

  • @weetikveelpik-wq5bx
    @weetikveelpik-wq5bx 16 днів тому

    would love to see this on a07

  • @Noicer_wastaken
    @Noicer_wastaken 18 днів тому

    .

  • @johnhancock1748
    @johnhancock1748 18 днів тому

    Love your content. Small complaint. The music is sooo loud and your voice is super quiet. Hear from you (hopefully more clearly) in the next one

  • @AGuyWhoDosentKnow
    @AGuyWhoDosentKnow 20 днів тому

    Can you make an TAS creating AI?

  • @AGuyWhoDosentKnow
    @AGuyWhoDosentKnow 20 днів тому

    THIS is what AI was MEANT for, NOT dumb low effort tiktok's

  • @Konrad-z9w
    @Konrad-z9w 20 днів тому

    23:10 so you're saying a fruit fly could play track mania :)

  • @ytubeanon
    @ytubeanon 21 день тому

    while watching this I was thinking about new Nvidia tools they released that use simulations and then sends the results to a real world robot... I wonder if the racing A.I. could be used to steer a remote control car on a racetrack or to participate in an annual competition where mini-cars race inside a maze, they use vacuum suction to stay on the track on tight turns

  • @AtomicSky1
    @AtomicSky1 22 дні тому

    Now all we need is an AI that can edit videos for you.

  • @cristianserrano8390
    @cristianserrano8390 24 дні тому

    Solo le podemos ganar con shortcuts

  • @bpbpbpbpbpbp
    @bpbpbpbpbpbp 24 дні тому

    Thanks for the vid! For future vids, the audio may be better balanced with louder voice / quieter music.

  • @K.-yv8tn
    @K.-yv8tn 25 днів тому

    How did he simulate independent input for each window of the game. 5:15 each window opens and the machine plays the game while he is still able to interact with the rest of the computer.

  • @staygreat3611
    @staygreat3611 25 днів тому

    A wall bang works but in a real track be literally suicide

  • @Yurex-the-Yurexy
    @Yurex-the-Yurexy 25 днів тому

    I don't really know much about it, but you talked about the rewards when the Ai is close to the line. Why not just a reward when it goes further along the line, not just close to the line but only when it goes forward along the line

  • @Vicvic3386
    @Vicvic3386 26 днів тому

    He just gave all track mania play a gut punch. This Ai brain no bigger than a fruit fly!

  • @connorogilvie3642
    @connorogilvie3642 28 днів тому

    If you have access to all these human runs, can you not train the AI directly on their data first before letting it then go on to learning through playing? Give the optimisation algorithm a warm-start basically rather than starting learning from nothing where it has to try everything before finding strategies that descend the gradient curve

  • @antonykanell1329
    @antonykanell1329 29 днів тому

    that one yellow orange and black car at 20:39:

  • @svenkruger4580
    @svenkruger4580 29 днів тому

    This video is so well made. Insane cropping, narrating and showing the AI do work at the same time is super entertaining. I don't even play Trackmania or have a bigger interest in AI. Well done Sir.

  • @SORA-hq7iy
    @SORA-hq7iy 29 днів тому

    Max Verstappen spotted 7:42

  • @webspreb
    @webspreb Місяць тому

    I had seen your video before the first one and I was so intrigued to know more about that but I forgot to subscribe to your channel.I m happy I get you in feed, nice to see the progress. Keep working and I just have a small question about the specs of your pc as I too want to start something like this.

  • @SuperSheepKing
    @SuperSheepKing Місяць тому

    train it on deep dip 2

  • @Kamaits
    @Kamaits Місяць тому

    AI using Naruto kagebunshin training technique 😂

  • @BigDickRand.y
    @BigDickRand.y Місяць тому

    Make it learn how to bug the game

  • @deshyvin
    @deshyvin Місяць тому

    Train the ai with TAS runs and see what it breaks to win.

  • @thephantom4847
    @thephantom4847 Місяць тому

    I want to correct something. The Neural Network doesn't "understand" a single thing it's doing during the game. Yes it might seem so, but it isn't. If you're curious why, this would probably be a good point to start: en.m.wikipedia.org/wiki/Chinese_room You can imagine it like an cracked version of word predictions. It looks at what has happened before and now, and then based on how it's trained gives out, what it thinks "should" come next. It is just educated guessing * 100.

  • @dusanbursac5012
    @dusanbursac5012 Місяць тому

    Eh Ai was fun at the start but it got lame over time. It's try and fail until you succeed. It's useless outside of that one part. Skill is not transferred to anything else other then that one path. Every record will fail if you give it enough time. Ai is just lame and that's about it.

  • @Hckr_pr_gmr
    @Hckr_pr_gmr Місяць тому

    COME BACK MASTER❤