Irrational computer decision I cant understand.
- MJMcCready
- Posts: 4418
- Joined: Mon Jun 24, 2013 2:30 pm
Irrational computer decision I cant understand.
Hi there, so after abandoning online chess for good because it allows too many bad habits to creep in, I just play against Lucus Chess now against the engine Cinimmon 1.2c rated 1930 or so it claims. I like playing sacrificial stuff against it as it makes it much more fun. So once again along came the kitchen sink attack played by me, but because I ran so low on material and couldnt force mate, I opted for threefold repetition. It only had to repeat the same move once more but instead resigned. I've ran it through the engines which estimated the final position as 0.00 and the next line being -4.7 ( I was white). So why would it resign? I cant understand it at all. Here's the game anyway. I don't think I missed a win at any point and the engines confirm I most certainly did not. Why did it resign when I was going for threefold repetion?
-
Roger de Coverly
- Posts: 22687
- Joined: Tue Apr 15, 2008 2:51 pm
Re: Irrational computer decision I cant understand.
Bad logic in the programming is an explanation. It may have been working under an instruction to avoid draws by repetition without having the caveat that the draw should be played when a loss is the alternative.MJMcCready wrote: ↑Tue Feb 11, 2025 12:32 pmSo why would it resign? I cant understand it at all. Here's the game anyway. I don't think I missed a win at any point and the engines confirm I most certainly did not. Why did it resign when I was going for threefold repetion?
- MJMcCready
- Posts: 4418
- Joined: Mon Jun 24, 2013 2:30 pm
Re: Irrational computer decision I cant understand.
Yes, there may be truth in that, it does give you the option to choose when the computer should resign, like early or late. But still, resign whilst playing along with threefold repetition?Roger de Coverly wrote: ↑Tue Feb 11, 2025 1:00 pmBad logic in the programming is an explanation. It may have been working under an instruction to avoid draws by repetition without having the caveat that the draw should be played when a loss is the alternative.MJMcCready wrote: ↑Tue Feb 11, 2025 12:32 pmSo why would it resign? I cant understand it at all. Here's the game anyway. I don't think I missed a win at any point and the engines confirm I most certainly did not. Why did it resign when I was going for threefold repetion?
- Joey Stewart
- Posts: 2176
- Joined: Wed Apr 11, 2007 2:35 pm
- Location: All Of Them
- Contact:
Re: Irrational computer decision I cant understand.
Reminds me of those rubbish old interactive chess boards in the 80s and 90s which would rather die then ever accept a draw and would force you to play hundreds of pointless moves at times
Any opinions expressed will not be held to account.
-
MartinCarpenter
- Posts: 3190
- Joined: Tue May 24, 2011 10:58 am
Re: Irrational computer decision I cant understand.
The weaker engines tend to be weakened - as far as I can see - by being programmed to 'blunder' roughly every X moves.
That's probably normally seen in their taking a suboptimal but not insane move, but could easily produce something like this too. It's frankly fairly annoying to play against, not at all human like.
That's probably normally seen in their taking a suboptimal but not insane move, but could easily produce something like this too. It's frankly fairly annoying to play against, not at all human like.
- Christopher Kreuzer
- Posts: 11033
- Joined: Fri Aug 06, 2010 2:34 am
- Location: London
Re: Irrational computer decision I cant understand.
So how are the stronger and strongest engines 'weakened'? Do they have some way of ranking their options so they can select a suboptimal move? I mean, you could go by centipawn assessments, but that can still produce moves that look strange. And how do humans select a suboptimal move when trying to weaken their own play? (I have tried this, in some positions the options are just not there.)MartinCarpenter wrote: ↑Tue Feb 11, 2025 3:31 pmThe weaker engines tend to be weakened - as far as I can see - by being programmed to 'blunder' roughly every X moves.
That's probably normally seen in their taking a suboptimal but not insane move, but could easily produce something like this too. It's frankly fairly annoying to play against, not at all human like.
- MJMcCready
- Posts: 4418
- Joined: Mon Jun 24, 2013 2:30 pm
Re: Irrational computer decision I cant understand.
Okay, the position had been repeated twice already, the same move played again would have resulted in threefold repetition and draw agree. The suboptimal move suggested was g4 but I looked into that in detail and saw mate was not possible and being two pieces and a rook down I went for the draw. I thought about Re3, picking up the Knight but Nc6 in reply holds the fought and runs me out of checks. It left me no option to accept I didn't have enough material left to deliver mate with the defensive reosources it had. There were other lines where black could have sacced his queen for my rook left me with no attacking chances, and it still ahead on material, so I had to go for a draw, but since the position had already been repeated twice, why did it resign why repeating its last move would have got the draw? All othe options left me at best -4.7? The last two moves it played stopped my attack, play it again and draw. Why resign instead when the draw is already in the bag?Christopher Kreuzer wrote: ↑Tue Feb 11, 2025 5:16 pmSo how are the stronger and strongest engines 'weakened'? Do they have some way of ranking their options so they can select a suboptimal move? I mean, you could go by centipawn assessments, but that can still produce moves that look strange. And how do humans select a suboptimal move when trying to weaken their own play? (I have tried this, in some positions the options are just not there.)MartinCarpenter wrote: ↑Tue Feb 11, 2025 3:31 pmThe weaker engines tend to be weakened - as far as I can see - by being programmed to 'blunder' roughly every X moves.
That's probably normally seen in their taking a suboptimal but not insane move, but could easily produce something like this too. It's frankly fairly annoying to play against, not at all human like.
- MJMcCready
- Posts: 4418
- Joined: Mon Jun 24, 2013 2:30 pm
Re: Irrational computer decision I cant understand.
Two more questions and do be please be honest, I won't take offence.
What strength would you say the computer was based on that game? It claims 1930. Sound about right? It doesn't to me.
Also what strength did I play at about (all honest answers unoffensive). I've played very little competitive or chess indeed for over.a decade now so it's hard assess roughly where I am abouts.Around 1900?
What strength would you say the computer was based on that game? It claims 1930. Sound about right? It doesn't to me.
Also what strength did I play at about (all honest answers unoffensive). I've played very little competitive or chess indeed for over.a decade now so it's hard assess roughly where I am abouts.Around 1900?
- Christopher Kreuzer
- Posts: 11033
- Joined: Fri Aug 06, 2010 2:34 am
- Location: London
Re: Irrational computer decision I cant understand.
I am not strong enough myself to assess your play there.
Maybe the computer program is not programmed for 3-fold repetition?
Interesting point found here:
https://www.cs.vu.nl/~wanf/theses/vrzina-bscthesis.pdf
Section 5.4 'Draw detection' is relevant.
Turns out it is far harder than you might suppose to detect 3-fold repetition. Requiring the program to keep track of positions in the game and in its search tree and 'detect' the three-fold repetitions seems to impact on performance.
Maybe the computer program is not programmed for 3-fold repetition?
Interesting point found here:
https://www.cs.vu.nl/~wanf/theses/vrzina-bscthesis.pdf
It seems that some computer engines are programmed to avoid 3-fold repetitions. Not quite sure why.Finally, there were some left-over steps to make the engine playable, such as a communication protocol, time management, and draw detection. The UCI standard was adopted to communicate with the engine, and time management was solved in a simple yet effective manner by taking 1/20th of the total time left. Draw detection was partially solved by preventing the engine from voluntarily doing three-fold repetition in a winning position. However, it remains unable to detect potential forced draws from the opponent. This leads to weaker engines capitalising upon this by forcing a draw while Tesseract is in a winning position. By testing Tesseract against other engines that were rated by CCRL, an estimated ELO range of 2400-2450 was deduced.
Section 5.4 'Draw detection' is relevant.
Turns out it is far harder than you might suppose to detect 3-fold repetition. Requiring the program to keep track of positions in the game and in its search tree and 'detect' the three-fold repetitions seems to impact on performance.
- Christopher Kreuzer
- Posts: 11033
- Joined: Fri Aug 06, 2010 2:34 am
- Location: London
Re: Irrational computer decision I cant understand.
I would have paid more attention in computer science classes 35 years ago (oh dear, tempus fugit) if I had known how relevant it would be to chess! I am not sure whether it is encouraging or worrying that people are writing (undergraduate) theses in 2023 titled 'Piece By Piece: Building a Strong Chess Engine'...
Pithy summary of computer chess:
Pithy summary of computer chess:
The first chess engine dates back to 1957 when Alex Bernstein created an engine that runs on the IBM 704 [1]. Since then, major engines have shown up or fizzled out again, like the famous Deep Blue, Fruit, AlphaZero, LeelaZero, and the current best engine Stockfish.
- MJMcCready
- Posts: 4418
- Joined: Mon Jun 24, 2013 2:30 pm
Re: Irrational computer decision I cant understand.
I suppose that may be possible yes especially since computers can't care whether they win, lose, or draw. I'd like to know who was aided and abetted with coming up with that one, since it's a normative aspect of the game, and chess is generally drawish anyway.Christopher Kreuzer wrote: ↑Tue Feb 11, 2025 6:50 pm
Maybe the computer program is not programmed for 3-fold repetition?
It seems that some computer engines are programmed to avoid 3-fold repetitions. Not quite sure why.
Turns out it is far harder than you might suppose to detect 3-fold repetition. Requiring the program to keep track of positions in the game and in its search tree and 'detect' the three-fold repetitions seems to impact on performance.
-
MartinCarpenter
- Posts: 3190
- Joined: Tue May 24, 2011 10:58 am
Re: Irrational computer decision I cant understand.
I think they do what they can by limiting search and so on, but it's still too strong.Christopher Kreuzer wrote: ↑Tue Feb 11, 2025 5:16 pmSo how are the stronger and strongest engines 'weakened'? Do they have some way of ranking their options so they can select a suboptimal move? I mean, you could go by centipawn assessments, but that can still produce moves that look strange. And how do humans select a suboptimal move when trying to weaken their own play? (I have tried this, in some positions the options are just not there.)MartinCarpenter wrote: ↑Tue Feb 11, 2025 3:31 pmThe weaker engines tend to be weakened - as far as I can see - by being programmed to 'blunder' roughly every X moves.
That's probably normally seen in their taking a suboptimal but not insane move, but could easily produce something like this too. It's frankly fairly annoying to play against, not at all human like.
So you just have a random number generator trigger off every X moves on average. When it does it plays the second, third, whatever best move. Sometimes that's just slightly suboptimal, sometimes it's an absurdly crude blunder because there was only one halfway decent option.
At least that seems to be what the lichess SF levels do, I might be wrong and there are obviously many options!
- MJMcCready
- Posts: 4418
- Joined: Mon Jun 24, 2013 2:30 pm
Re: Irrational computer decision I cant understand.
Well it certain does play some very odd moves sometimes. I put that down to gamesmanship because it lulls me into a false sense of security and makes think I can punish it and win but do more than once in a blue moon, that I cannot.
- IM Jack Rudd
- Posts: 5183
- Joined: Tue Apr 17, 2007 1:13 am
- Location: Bideford
- Contact:
Re: Irrational computer decision I cant understand.
The way Chessmaster 2100 used to do it, back in the day, was to add noise to every position evaluation.
- MJMcCready
- Posts: 4418
- Joined: Mon Jun 24, 2013 2:30 pm
Re: Irrational computer decision I cant understand.
The principle difference between computers and humans regarding my foray into pitting my wits against my electronic friend is that computers don't give up and throw the towel in if they start losing. Instead, they are resourceful and focused solely on the position at hand rather than the result they anticipate the most. But then they don't have emotions; therefore, it is to be expected somewhat if not then absolutely.