Caruana's brilliancy: The Engine Challenge

by Albert Silver
12/16/2016 – When a grandmaster analyzing a game, professes a move or type of move as exceptionally challenging for an engine, it is obviously going to be scrutinized left and right. That is precisely what happened in the analysis of Fabiano Caruana’s fantastic queen sacrifice against Hikaru Nakamura in game six of the London Classic. The comments on engines were not entirely wrong, but as we will see, there are notable exceptions! Learn how the entire sacrifice could have been solved in seconds.

ChessBase 14 Download ChessBase 14 Download

Everyone uses ChessBase, from the World Champion to the amateur next door. Start your personal success story with ChessBase 14 and enjoy your chess even more!


Along with the ChessBase 14 program you can access the Live Database of 8 million games, and receive three months of free ChesssBase Account Premium membership and all of our online apps! Have a look today!

More...

The game will go down in history as one of the great queen sacrifices, and fans were given an absolute treat. Let’s skip straight away to the key points, always enjoyable to see again and remember.

 

Above is the position after 18…e5 and both players had been playing fairly quickly, which led one to understand that both had seen this position and line in their preparation. White played here the beautiful queen sacrifice 19.Qxf6!! Here is where it makes sense to see what the engines saw since no one would enter this position nowadays at such a high level in the opening without having studied it thoroughly. All engines see the queen sacrifice almost instantly, but the main line they display involves recovering the queen with a roughly equal position. After the more or less forced 19… Bxf6 20.Nd5 Qd8 we reach the next key crossroads.

 

Presuming no one is privy to exceptional hardware such as 16 cores or more, a look at Stockfish 8 or Houdini 5 for at least three minutes on a good quad-core (an Intel i5 at 4 x 3.0GHz for the purposes of this article) will show a roughly equal evaluation with the main line 21.Nc6 (the black queen is trapped) 21…Bxg4 22.Nxd8 Bxd8.

Caruana's sparkling win over Nakamura was the highlight of the London Classic (photo by Lennart Ootes)

Instead, Caruana uncorked 21.Nf5!!, leaving the material imbalance on the board with White down a queen for two pieces. Thus when Polish grandmaster Krasenkow commented in his Round Six analysis that engines struggle with such positions, and that it could only be the result of human ingenuity and intuition, it was no doubt after seeing no engine coming up with it in a reasonable time.

"I must say that such "real" queen sacrifices are an Achilles' heel of analytic engines. They almost always evaluate positions with, say, two minor pieces for a queen in favour of the strongest piece, while in reality, in human play, there may be a more than sufficient compensation for the material. Therefore such positions should be analysed and evaluated "manually", and kudos to Caruana and his team for doing that!"

There seems little doubt this is what happened to Nakamura and his second(s), who used an engine, but did not insist after seeing nothing after a few minutes. How long would they take on a normal quad-core?

Stockfish 8, a top free engine, using 2GB hash tables, takes around eight full minutes. So the user would need to wait a full eight minutes before the engine announced it had made a breakthrough.

The new member of the family of elites, Houdini 5, takes about half that time, and finds it in 2 minute 47 seconds. By no means is this to suggest Houdini 5 will always outdo its rival by a factor of three, since solving a position varies enormously from one to the next. The point is that it too takes nearly several minutes to find Caruana's 21.Nf5

Still, readers may recall an article that was posted a few days ago describing the special Tactical Mode in Houdini 5. An option in the engine that turns it into a single-minded combination seeker, a bit like the late great Tal, hell bent on trying to find a tactical shot.

When Houdini 5’s Tactical Mode is enabled it finds Caruana’s 21.Nf5!! In exactly… zero seconds! Not only that, but it finds the full winning continuation, and displays a large plus score for White.

So what if you analyzed the position before the queen sacrifice? How long would it take to see 21…Nf5 in its main line? Meaning how long would it take to see the complete winning sequence from 19.Qxf6 until 21…Nf5? The answer is two seconds!

Once more, this emphasizes the usefulness of the Tactical Mode in Houdini 5 as a special tool to help analyze just such chaotic positions, helping avoid fatal oversights.

Live Book

It should be mentioned that Priyadarshan Banjan, editor of ChessBase India, correctly pointed out in his article on Round Six that as soon as one had opened an engine in ChessBase 13 or 14, one would also see the top three engine analyses from others in the Live Book. Your engine might have only analyzed a second and seen nothing of note, but others might have already seen this in great depth, and that analysis is immediately available.

As you can see above, Houdini 5 (normal mode) has only been running for a few of seconds, but on the right are analyses of Stockfish 8 at a depth of 60 plies (!!). The brown colored lettering means it was analyzed for the equivalent of 60 minutes on an i7 processor. No matter what you are analyzing, never forget to consult the Live Book as it is quite possible someone has already analyzed your position to great depths, saving you the time of doing it yourself.

You can purchase Houdini 5 in the ChessBase Shop



Born in the US, he grew up in Paris, France, where he completed his Baccalaureat, and after college moved to Rio de Janeiro, Brazil. He had a peak rating of 2240 FIDE, and was a key designer of Chess Assistant 6. In 2010 he joined the ChessBase family as an editor and writer at ChessBase News. He is also a passionate photographer with work appearing in numerous publications.
Discussion and Feedback Join the public discussion or submit your feedback to the editors


Discuss

Rules for reader comments

 
 

Not registered yet? Register

melomaniak melomaniak 12/20/2016 10:26
Stockfish 8 on my i4790K (4cores/8threads, calculating 9500k/s) finds the variation with Nf5 before the queen sacrifice in 02:21 with score of +1.55. This is already old hardware, maybe some GMs should invest into Xeon based machines, an 18 or 22 cores would find this in no time...
genem genem 12/17/2016 10:13
@tyhjyydesta - Posted about Kramnik-Leko. Here are the details:
.
V.Kramnik - P.Leko, 0-1
Match World Chess Championship (MWCChamp) game 8, 2004/Oct/07.
.

.
Next from the above FEN position, Leko moved 25.. Qg6-d3!, a winning move that Kramnik's home computer had misjudged.
.
Kramnik blamed his helper seconds for not adequately testing this Qd3 move, and the seconds agreed to the blame.
.
However, the Fritz (or whatever chess engine) they used needed an exceptionally large amount of time to detect the strength of Qd3. The seconds cannot give so much time to every possible opening move during pre-game at-home preparation.
.
Maybe in the future, most opening preparations will be tested by Houdini in both regular mode and its new tactical mode?
KWRegan KWRegan 12/17/2016 06:16
After 21. .. Bxf5 22. Bxf5 Rb8 23. Rd3 Rb5 24. c4 Rxd5 25. Rxd5 Qb8 26. c5 dxc5 27. bxc5 Qb5 28. c6 Qxc6+ 29. Rc5 Qa4 30. Rc8+ Bd8 31. Rd1 Qa1+ 32. Kc2 Qa4+ 33. b3 Qa2+ 34. Kc3 O-O 35. Rdxd8 Qa5+ 36. b4 Qa3+ 37. Kc2 Qa4+ 38. Kc1 Qa3+ 39. Kd1 Qa4+ 40. Ke2 Qb5+ 41. Kf3 Rxd8 42. Rxd8+ Kg7, where is the win? Well, this is partly facetious ("long analysis, wrong analysis") but illustrates that a +1.23 from an engine---Stockfish 8 in my case---hardly means game-over.
tyhjyydesta tyhjyydesta 12/17/2016 03:02
Interesting comparison, however one thing to be noted is that prior to the game was actually played, the analysis in chessbase live book was nowhere near depth 60, and it was the actual game itself that drew attention to that position for others to analyze. I remember checking this position shortly after the game with best eval being by SF8@depth=40 showing a winning score - which most likely was also calculated only after the game.

Oh and kudos to fabi and his team for finding such a move - it's incredible that stockfish8 starts to understand that Nf5 might be a good move only around 10 minutes at decent quad analysis (and it takes even more time until it realizes that it's actually winning). Very intruiging position. For example another famous "computer analysis bludner" in the match Kramnik vs. Leko where Leko refuted Kramnik's preparation OTB - at that time there were saying that decent computer would see the hole in their preparation in about 90 seconds (time they couldn't spare at that time - since they had many positions to analyze) - while today Stockfish 8 on decent quad solves it in matter of couple of seconds. Therefore those 10 minutes nedded for Fabi - Naka position seems like eternity from computer chess perspective, which makes this position so much more impressive and strangely enough - from the way fabi has described this position - despite its complexity the position might be actually easier to understand by top players than a top engines.
koko48 koko48 12/17/2016 01:39
Good analysis....I would be curious to see a similar analysis - with various computers and the Tactical Mode - for Tal's famous Queen sac in the Saemisch KID against Bobotsov, Varna 1958: (1. d4 Nf6 2. c4 g6 3. Nc3 Bg7 4. e4 d6 5. f3 0-0 6. Be3 Nbd7 7. Qd2 c5 8. Nge2 a6 9. 0-0-0 Qa5 10. Kb1 b5 11. Nd5 Nxd5! 12. Qxa5 Nxe3...)

This is also a Q sac for two pieces and long term positional compensation...Black gets the dark squared B and usually ends up winning at least an exchange afterward (after 13. Rc1 Nxc4 14. Rxc4 bxc4, as the stem game and many subsequent games continued)

The Kings Indian has often been an openings the computers (the less recent computers, at least) seem to misevaluate the most....And this Queen sacrifice is very difficult for strong humans to play against with the white side, which is why many of them decline it and simply recapture the Knight on move 11

Tal said "There are two types of sacrifices - correct ones, and mine"....But this Queen sacrifice of Tal's seems to be correct, at least in human praxis....And Caruana's Queen sacrifice is also correct, apparently

yesenadam yesenadam 12/17/2016 12:44
From the Houdini 5 manual:
"When Tactical Mode is active, Houdini modifies its search process and uses some clever tricks to focus on tactical solutions in the root position. In Tactical Mode Houdini becomes a very skilled tactical problem solver. ...
Note that the focus on tactical moves will reduce the playing strength of the engine, the Tactical Mode is significantly weaker than the normal playing mode.

One can compare the Tactical Mode to what a human player does when he/she tries to solve a test position in a chess magazine or website. He/she will scan for tactical, forcing moves, threats, sacrifices etc. That way a lot more tactical solutions can be found than what the player would actually see and decide to play over the board, during a normal game. The "this is a test position" message changes the search strategy.
Houdini's Tactical Mode works exactly the same, very human-like: it will spend a lot more time looking for tactical moves, threats etc. In most positions this doesn't provide any benefit - most of the time there is no tactical solution available and the increased focus on tactics is just wasted. But in test positions (selected because there IS a tactical solution) it works extremely well."
genem genem 12/17/2016 12:31
Interesting demonstration.
Is 'Tactical Mode' mostly telling the engine to Not Prune moves that are probably hopeless by routine standards? By skipping the logic which evaluates moves, those CPU cycles could be used for brute calculation instead?
.
I vaguely recall that older chess engines had "personality" options, including one for emphasizing tactics over positional efforts. Is Houdini's 'Tactical Mode' a better implementation of that basic concept?
1