AI Leela Chess Zero breaks Stockfish | TCEC Season 14 Superfinal - 2019
Вставка
- Опубліковано 29 вер 2024
- This is a round 11 game between AI Leela Chess Zero v20.2-32930 and Stockfish 190203. It was from the Season 14 Superfinal of the Top Chess Engine Championship 2019. Both Leela Chess Zero and Stockfish earned their way to this final 100 game match. The featured game demonstrates how exactly Leela earns that first full point. The opening played, French Defense: Tarrasch, Guimard variation with its early fixed pawn center, is in my opinion ideal for the neural network.
Specifications:
Current TCEC server
CPUs: 2 x Intel Xeon E5 2699 v4 @ 2.8 GHz
Cores: 44 physical
Motherboard: Supermicro X10DRL-i
RAM: 64 GB DDR4 ECC
SSD: Crucial CT250M500 240 GB
Chassis: Supermicro
OS: Windows Server 2012 R2
GPU Server
GPUs: 1 x 2080 ti + 1 x 2080
CPU: Quad Core i5 2600k
RAM: 16GB DDR3-2133
SSD:Samsung 840 Pro 256gb
PGN:
1. e4 e6 2. d4 d5 3. Nd2 Nc6 4. Ngf3 Nf6 5. e5 Nd7 6. Nb3 b6 7. c3 Ne7 8. h4 c5 9. h5 h6 10. Nh4 c4 11. Nd2 b5 12. Qg4 a5 13. Be2 a4 14. a3 Nb8 15. f4 Nbc6 16. Nf1 Na5 17. Be3 Nb3 18. Rd1 Kd7 19. Bf2 Kc7 20. Ne3 Kb7 21. Qh3 g5 22. hxg6 fxg6 23. g4 Ka6 24. Nhg2 Rg8 25. Bf3 Ka5 26. Bh4 g5 27. Bg3 gxf4 28. Nxf4 Ra7 29. Bh4 Bd7 30. O-O Qe8 31. Rf2 h5 32. g5 Ng6 33. Nxg6 Qxg6 34. Bg2 Qe8 35. Rf6 Bc8 36. Qg3 Rc7 37. Bh3 Bg7 38. Kh2 Rf7 39. Ng2 Ka6 40. Qe3 Ka7 41. Nf4 Re7 42. Rg1 Kb8 43. g6 Rh8 44. Rg2 Ka7 45. Qf2 Rb7 46. Bxe6 Bxf6 47. Bxf6 Bxe6 48. Bxh8 Bg8 49. Bf6 Nc1 50. Qe3 Nd3 51. Nxd3 cxd3 52. Qxd3 Rb8 53. Kg3 Be6 54. Kh4 Kb7 55. g7 Qd7 56. Rg5 Rc8 57. Rg1 Bf7 58. Qf3 Qe8 59. Rf1 Rc7 60. Qd3 Bg8 61. Kg5 b4 62. axb4 Rc4 63. Kh6 Qe6 64. Qf5 Qe8 65. Rf3 Rc6 66. Qxh5 Bf7 67. Qf5 Be6 68. Qg6 Bf7 69. Qd3 Re6 70. Kg5 Qc6 71. Rg3 Re8 72. Rh3 Rg8 73. Rh4 Qd7 74. Kf4 Be6 75. Rh7 Kb6 76. Rh6 Kb7
Software used in video:
Blitzin via www.chessclub.com
I'm a self-taught National Master in chess out of Pennsylvania, USA who was introduced to the game by my father in 1988 at the age of 8. The purpose of this channel is to share my knowledge of chess to help others improve their game. I enjoy continuing to improve my understanding of this great game, albeit slowly. Consider subscribing here on UA-cam for frequent content, and/or connecting via any or all of the below social medias. Your support is greatly appreciated. Take care, bye. :D
★ LIVESTREAM / chessnetwork
★ TWITTER / chessnetwork
★ FACEBOOK / chessnetwork
★ PATREON / chessnetwork
★ DONATE www.paypal.com...
Nobody does a high quality instructional walk-thru analysis like Jerry.
Maybe Daniel King?
If he's only body, where're his fingers?
@@NoNameAtAll2 haha, tragic
@@NoNameAtAll2 😂😂😂😂🤣if you have no name, what should we call you?
So long as you speed it up to 1.5x
Nh4 has one additional purpose Jerry didn't mention. In the Guimard line, black often plays f6 to break open white's centre, permitting a weakness on e6 but getting good piece play. Now, f6 would allow Ng6, pretty much forcing a knight trade, after which white would have a monster fawn pawn on g6.
Nice additional point!
👏👏
So awesome to see Leela have such success! Thanks for the vid
always nice to see leela videos from such popular youtubers, great video
I love your videos. They teach and taught me so much. And they got me really interested in Chess again.
I don’t know how to describe it, but this game was just so... cool
Hi Jerry, move 38 which black moved the rook was also for saving it from queen capture with a check.
12:15 did the black pawn go to g5 or g6? because you show the white pawn making an illegal capture move there
En passant
The knight on b3 is the hot girl during your group project. Looks pretty but does nothing beneficial.
27 moves into the game and only one capture so far.
Imagine when Quantum computers become a thing.
Chess itself will probably be completely solved.
Where did Stockfish go wrong? Was it strategically wrong for black to shutdown the queen side? It seems like black would have been better to gambit a pawn on the queen side to get some counterplay and at least force white to regroup.
Yeah, according to Stockfish 10 it was wrong. After 13...a4 Leela has a 0.8 advantage and never falls below that from then on (she does fall below it on the initial graph, but rises back up at higher depths). It's hard to say if it was a losing move, but it looks like it definitely turned losing after Stockfish wasted so much time moving his king to a5 and not developing his pieces.
@@lmabacus404 But why did Sf Dev (stronger than SF 10) play it then? I don't understand.
Yeah, 13...a4 seems to close down the entire queenside and deprived SF from any counterplay. b4 might have been the better move. As to why some versions of SF were able to point it out, could be many possible factors. Different hardware, time, contempt settings, etc.
@@lmabacus404 It's very easy to say that Stockfish should've developed its pieces, but it was very hard to see where the positions of the bishops and rooks could've been improved in the early mid-game. Stockfish's "mistake" was strategic, not tactical. It chose to position the knight down the board thinking that it could provide play, but Leela just moved everything to the other side of the board making it irrelevant. It turns out that the knight was necessary to shut down advance king side, but it was always three moves away from being able to help out and thus too slow. There were no tactical mistakes, Stockfish was just outplayed strategically.
SF did strategic mistake since after out of book. In reverse game, Leela defended as draw. Go and check TCEC archive and learn yourself. And dont do anlaysis with SF, it will be misleading, cos the SF that play in here was already 44 cores, and stronger than your PC.
Did Stockfish resign or run out of time? Why did the game abruptly end?
I believe that if both engines agree one side is ahead by a large enough margin for some number of moves, they adjudicate the game as a win and move on to the next game. A modern engine isn't going to lose in an endgame if it's evaluating at +16 so it's just a waste of time to play it out.
Am I the only one who has to crank Jerry up to 1.25 speed to make him sound normal?
I do it too!! But then again I watch everything in faster playback except songs
17:11
Why not Bxh5 here?
... Bh6! 2. gxh6 Nf4+ winning the queen. If 2. Qg4 or g3, Ne7 pinning the queen. If 2. Qh2, Nxh3 3. Qxh3 Bxg5 and white will be lucky to only lose the e knight with discovered checks and threats on the queen
Actually, I'm wrong because ... Bh6! would be met with 2. Bxe8. Better for black is ... Nxf4. If whites Bishop takes the queen, black picks up whites queen with check / fork. Black picks up knight, queen, rook in exchange for pawn, queen, (and if white grabs the black d Bishop, white obviously gets it back with the rook)
This game is identical to a game that (Ficher vs Petrosian)
how quickly are these games played out in real time?
Various time controls are used it depends on the event.
Stockfish doesn't play like stockfish in the opening moves. Something is off.
Wow!
all most an anti-engine line closing down all counter play so all that is left is a long term strategical advantage, that is beyond the engines horizon
I don't understand 20.Kb7
It's kinda just SCARY
Dude, stockfish 190203 sucks
Sucks what??😜
19:27 check with Qd6 to take the rook?
I was checking the comments for this. I don't see what's wrong with Qd6. I think the king moving to a6 was just to allow the knight on b3 to return? I'm not sure
Ugh the French should be an automatic loss.
Anyone else feel like something is just wrong with this game ? Seems like a lot of just awful moves. Probably because 2 computers are playing one another. Nice to see the French being used though.
I can beat stockfish a2 a4 h2 h4, hes screwed
:)
A very basic chess shown here. Developing pecies and castling.
This game reminds me of when Kasparov led Deep Blue to a very closed position and completely dominated with his ability to play strategically to win the match and the tournament. At the time, it was telling of how computers were limited creatively in closed positions and Kasparov took advantage of that. Except in this game, AI Leela plays in the role of Kasparov and teaches the same lesson to Stockfish!
Alex Cutrim Great observation!
History repeats it self huh
Stockfish 11 would disagree now
It's a flaw in the code where the engine wants to push for a win because it has a material advantage even in a completely drawn position. That's why self taught neutral networks won't have this problem because they don't assign value to pieces.
Uploaded on Valentines day, a love letter from Leela
an outstanding move from Jerry
Leela and AlphaZero agree: When the center is closed, H4 is your move.
They grow up so fast...
well leela has played centuries of chess
yeah and before you can look back the nn starts a nuclear clean-off of earth =b
Pretty clear these players should both be banned for using an engine. Leela may seem impressive, but it's obvious computer assistance was involved.
Boooooooooooo
Have u lost it??😕
@@Ronit_3025 Humor.
gFry65 r/wooosh
"I benefit from it and I want you to benefit from it" only Jerry can say it.
No. Anyone who's not a complete psycho can say it.
Alexandru Popescu can you say it Alex?
Expending all that structural effort to get the knight on b3 seems like a pretty typical heuristic-based mistake. If your evaluation heuristic says that a support knight forward in the enemy camp that cannot be attacked is good, then the engine will prefer this sort of position even though in this case it makes no sense and essentially kills the piece. That useless knight seems very "computer-like" to me, and the way Leela ignores it seems like what you might expect from a human player. Stockfish was just painting by numbers with that piece :)
Leela actually didn't 100% ignore it. The knight would've been a monster if it was allowed to go from d2 to e4, so Leela always made sure that a piece guards d2. A rook was always guarding d2, so it wasn't really a bad trade for Stockfish -- an inactive knight vs an inactive rook.
@@DraoxxMusic Another decent threat was c1->d3. Leela guarded against this later in the game with her knight on f4, which allowed the rook to leave the first rank. The number of squares available for that knight to escape was few enough that it was always possible to guard them while also making use of the guarding piece for other purposes. So, the guard pieces were doing something while the black knight was doing nothing but sitting there. Note that on g2 the rook was doing quite a lot while still guarding d2.
Lets say, Leela "Alpha Zero'd" that knight.
@@IschmarVI Yeah, it reminds me a lot of the games where A0 traps an opponent bishop behind an immovable pawn wall and basically takes it out of the game :)
@@DraoxxMusic Not only that, but a whole structure supporting the knight and the startegy, that didn't do that much else
Aw, no post-game smack talk from Leela to Stockfish in this one.
Stockfish won the 100 games competition with 50.5 to 49.5. Good job Stockfish... I guess.
Hey Jerry, it's everyone.
its full of stars (:
That one dislike is from Stockfish.
I realised how much I've missed videos like this from you. Agadmator is good but your style of explaining what goes on in the game is simply outstanding!
I find the two of them outstanding in completely different ways. Agadmator has a passion for the history and theatrics of Chess augmented by a loveable bro-lets-go-grab-a-beer charisma. Jerry's passion, I feel, is for the beauty of the game itself. The strategies, nuances, and subtle imbalances of Chess seem like a lifelong educational journey; a private journey which luckily he's willing to embark upon publicly. With all due respect to the top players, in my opinion, few people--if any--have done more for the game of Chess in the last few years than Agadmator and ChessNetwork.
What a time to be alive.
AIs teach us that we shouldn't always focus on theory a lot and on laws of development of pieces like we traditionally do, but be creative in our play, and looks like it values controlling of the center the most and not so much the fast development of pieces bla bla bla.
Wow. Absolute domination by Leela. She certainly has a definite edge when it comes to closed, strategic positions.
It was awesome seeing the white bishop and rook bail and escape while the knight was heading in only to find empty barracks.
I beat Leela early last year at a revision around 2000 estimated rating. I like to think I taught her a lesson. 🤣
What??!!😰
Whenever Jerry upload's a video, first I go make a peanut butter and Jerry sandwich and then watch the video 😋
Black is fortunate that there's no 9th rank on this board.
Seems, Stockfish will still barely win eventually. Still, it's astonishing, how fast Leela improves.
I have seen several games like this with one closed side, and every time Leela (or AlphaZero) just led Stockfish into playing random waiting moves or zugzwang and destroyed it. Crazy!
audio too soft. right click -> stats for nerds -> volume : -8.5dB. You'll want to amplify or normalize the audio in post processing so it is between 0 and -2 dB
audio is fine for me
I'm only a minute in and I hope this title wasn't as big a bait as "A Wounded Carlsen"... Jokes aside, I'm always here for some Jerry content.
Embarrassing Stockfish’s light square bishop... Leela really takes after AlphaZero!
Have you seen game 49? its an AI train running over Stockfish !!
I'm a big Stockfish fan and, for me, LC was a promise, but Alpha Beta engines (say brute force) will prevail. Seems I'm wrong. And LC plays very nice.
When you think about the branching factor in chess a standard a/b is getting less return on it's calculating time the deeper it goes. The smarter approach of neural nets will eventually overtake the a/b engines.
Thanks Jerry. We missed your insightful and instructional videos. How about some more analysis of Alpha Zero games now that more games are released to the public?
We have seen the best of them. Doubt there is anything worthwhile left. Probably a lot of draws with already seen concepts. And ofcourse Deep Mind has long moved on from chess.
Feedback:we need more videos!!!!
Ar 19:30 you can still move the queen with check to d6, no?
true. but i think its also a good idea to stay away from a pin, no?
Noobies!!
A. Aznadi
That’s an interesting find
I don't really understand all those moves by Stockfish with the King and the Knight: action was on the other side of the board! More, it was playing virtually down a piece. Anyway, lesson for me: in this kind of position, try to be White =)
Thanks for showing the hardware specs at the opening! But i5 2600k isn't a cpu. It's probably an i7 2600k 4c/8t, so apparently, Leela doesn't care much about RAM and CPU speed. Interesting.
Right, Leela runs on the pair of 2080 graphics cards. This neural network that runs on the GPU is an entirely new class of engine completely unlike the brute force CPU-intensive Stockfish (and basically every strong engine that preceded Stockfish). Leela looks at orders of magnitude fewer variations when it ponders and still ends up with amazing games like this.
the CPU used by leela in TCEC is i5-3570k
Am I missing something when I suggest a move like 18... Ned6? A second attacker on white's d-pawn (well defended, but still) and preps a move like ...b4 (which is now supported by bishop and knight) to break the queenside and get a deep passer. Obvious glaring issue is king safety, but the on-board game felt too passive!
Before this game if you told me that Stockfish would develop their third piece on move 18, and it's was the king, I don't think I'd believe you.
I love how the first time stockfish moves a piece besides their king or their knights (which were moved before the start of the game) was on move 24. Opening principles? Never heard of him.
I don’t really think the safest square for the white king is on a2. We are worthless trying to understand chess, but that’s maybe what makes it kind of beautiful.
sometimes the pauses when jerry stops talking gets pretty annoying if you could switch that that will be perfect this youtube chess channel is so good with teaching chess because it doesn't actually get help from the engine when analyzing,
Thanks for covering TCEC games! - careless25
Just wanted to know why did you put "I shouldn't have said Stockfish 10"
Because it's the latest, bleeding edge version of Stockfish, probably ~15 Elo higher than SF 10.
The stockfish playing is actually a development version not stockfish 10
Is it the same sf that lost to Houdini in the cup?? If so I doubt it’s better than 10
@@brianteskey2425 It was not (the superfinal build is a newer version) but take the TCEC cup with a pinch of salt, low number of games is just a coin flip.
@@nabildanial00 Ah, I see. Thank you for answering!
guy please apply to a job as a commentator at chessgames or elsewhere, i could listen to your voice and also your way of explaining all day. Maybe you should read sleeping stories.
A knight can't be Fianchetto'd because that means seeing the whole board and they can't do that. The queen can do that maybe but a knight can't.
Reminds me of some Bobby Fischer games. That pawn diagonal is very strong.
I wonder at what point we (top human players) will be unable to effectively analyze these games. By analogy, if you took a beginner player and asked him/her to comment on grandmaster games, they would not be able to do so with any sophistication. I wonder if the very best of humans willl eventually find themselves in this position?
We could certainly be at the point where humans can't analyse engine games in real time, but once the game has been played to its end, it's much easier to look back and spot the key moves (and use an engine to explore alternative lines).
John Davis Interesting .... at the limit what we are talking about is a ratio of contribution in analyzing the games. Part human with some degree of reliance on an engine. Over time this ratio will tip more and more towards us relying on the engine to help. You can imagine a situation where this balance shifts so much to the engine that the human contribution is little to none.
A thought experiment, add, say, 3 rows and columns to the chessboard with additional pieces. I would suspect our ability to “follow along” would diminish to a point where our relance on the engine would be total. What is important here is that Chess is a relatively simple ‘problem’, in a class of problems for which this argument can be applied. Interesting ... Thanks very much for the video post.
@@pspicer777 "You can imagine a situation where this balance shifts so much to the engine that the human contribution is little to none." - Perhaps in engine vs engine games, but human games have other elements - style, personality, history between the players - and a human is going to be able to analyse these better than a machine for quite a while yet.
John Davis Interesting. I was viewing the situation in a more absolute sense, as a zero sum game where the only important metric was win/ loss. Certainly if there are other elements such as you mention, then indeed those dimensions, in analysis, may not be available to machines. Here is a question somewhat related to the old Turing Test question .... If you were to play one of these engines ‘blind’, could you disern whether you were playing a machine or human? (I do not play chess at anything like this type of level, so personally do not have a feel for this).
Stupendous! Leela plays REAL chess!!!
all I thought while watching stockfish queen side play was: "too weak, too slow"
Who wants leelah vs alpha zero? Just tell leelah don’t use French defense though! Lol
2 GAMES AHEAD BOIS!!
Man, Stockfish tends to do poorly with the French defense, huh?
Jehrrrry💪
Boys and girls, leela is getting strong.
Leela maneuvered a positional advantage quite early in this one.
Look at how beautiful that knight is boys
on move 40 ka6 black still cant double take on f6 because of qd6+
Phenomenal analysis
Wonderful analysis!
A quick question if I may:
At 19:35 you said that there would be no way for the white Queen to place a check on the King after he has moved to a6 (move 39). But she could have used the 6th file for a horizontal check on d6, no? D6 being unprotected, I find it almost nicer of a spot, looking at the black d/e pawns.
This doesn't really matter for the game as a whole, since it developed otherwise, but I was just wondering if there is a problem with that strategy.
The Queen can't phase through her own pawns.
This is sick... beautiful game, total domination from the very beginning.
Thanks Jerry :) Sad to see Stockfish is beaten so easily.
Easily??
Seriously? 😕
the return of Jerry
Love your videos.
And Daniel King's.
Hate Agadmator.
Yes thank you! I knew someone else felt the same. His stuttering and long loading noises are just so unprofessional
Welp, in this SuFi, at least SF can show us how to win with the black pieces now and then ;-) Currently, Leela's wins have only been with white.
lol ! Leela also wins some games with black.
On move 17 would Ne4 not be a better move than Nb3? I feel like that is a better square for the knight.
I guess white could play Bf3 and if black doesn't move the knight white can capture to force the pawn recapture. I think white would be better from that position but I'm not sure.
Excellent video and instructive analysis.
I swear the arrow at 7:10 caught me so off guard
History in the making.
So you… at 13:02... would recapture the pawn on f4 and then be closer to advancing that pawn to f5? Yeah sure I gotta try that out at home sometime
JK, great video as always! Really instructive popquizzes!
how is it decided that these computer games end? it always seems to be a final move on the losing side and then Jerry says thats its loser lost
There’s some rule where if both evaluations are in one side’s favor by threshold X for Y consecutive moves, the game is adjudicated and a win is awarded.
#how to install leela chess zero on android phone
I initially thought that black knight on B3 was black's best piece, until you pointed out how it could actually be the worse. Seems like something stockfish did because it knows that a knight on a forward outpost is generally good, and didn't really consider the fact that action was taking place on the king side, and that no coordinated attacks could happen due to the locked down position. It seemed like stockfish wasted a lot of moves, especially compared to white. You could tell that the engine didn't have a plan of attack. It had plenty of time to set up an attack on the queen side, hoping to promote one of it's many advanced pawns.
One thought occurs to me ... the biggest thing here may not be the strength of this program but how quickly it became so strong, and the fact that the ‘algorithm’ used is flexible and adaptable to different domains. I suspect the techniques used to make Stockfish et. al. strong in the chess domain are not transferable to other domains whereas those used for Leela are. For analyzing such systems mot only should we compare their raw strengh but also some metric as to the ‘energy’ required for them to get to that strength, the time to do so, and their level of flexibility vis-a- vis other domains.
Once again pawns on e5 and h5.
Thanks Jerry!! Love your content!
10:10 best piece is probably one of the pawns b5 is holding a couple spots and is rear support for the b3 knight. At the moment though the Knight attacks nothing and best use would be to sac itself to open up pawn chain on d4.any other move would just get piece taken 3 spots from a bishop is a bad placing most of the time