Over the last 20 years, and even more so the last decade, we have seen technology advancing by leaps and bounds in ways that would shock someone from only 1990. Hardware has advanced so much that our smartphones of today (the first iPhone dates back only seven years) are far more computer than phone, but software has also advanced hand-in-hand with this process. The strength of chess engines has also taken off, but it is sometimes hard for the layman to differentiate how much of the progress is due to hardware and how much to software. The answer is both of course.
Still, it was a bit of a shock to listen to a conversation between two strong players, one of whom is a grandmaster, claim that engines had really not progressed at all in the past ten years, and that the Elo leaps the programmers were taking credit for, were entirely due to the faster hardware. Needless to say, for someone who knows several of these programmers, and the enormous time and effort expended, to see them classified as con artists did not sit well with me.
I realized the statements were not meant maliciously, and were sincere in their utter ignorance. After some thought I realized the vast majority of users are probably unclear on just how much progress has been made in pure programming terms. There are of course ratings lists of engines, but the numbers are so outrageously high over human ratings that it becomes hard to fit them into any normal perspective. Consider one of the top ratings lists over the past years: CCRL (Computer Chess Ratings List).
Komodo 8 tops the ratings lists for computer chess
At the top on a single core is Komodo 8 with a mere 3232 Elo. For most of us, the near 2900 rating of Magnus Carlsen is already approaching science fiction, so where does 3232 fit in the picture? That is today though. The best engine 10 years ago was in fact Shredder 8, but since the list does not go back that far, we will make do with Shredder 9, rated…. 2725.
Although a top engine in its day, the lists suggests that in pure software there is a 500 Elo gap
That suggests that software has advanced over 500 Elo in ten years, without factoring in the faster computers themselves. Can this be true?
I decided to run a small experiment. Since Komodo 8 exists on both the desktop as well as the Android smartphone, I decided to play a small match between it on a smartphone, facing Shredder on a modern, top of the line quad-core i7 processor. I ran a small test to compare the speeds of the platforms, by running Komodo on the start position and seeing how long it took to reach 20 plies. The result was that it ran about 50 times slower on a smartphone. Not 50%, no, 50 times.
To put that in perspective, if Komodo were racing at the speed of Usain Bolt at his fastest (roughly 45km/h) then Shredder would be racing in a Concorde at 2250 km/h. Therefore if Komodo’s edge over the best of yesteryear was in fact only 150-200 Elo, then the fantastic hardware advantage by Shredder should allow it to crush it. Although I actually own Shredder 8, and could dig it up, it is unable to make use of more than one core (2004 after all), so instead I used Deep Shredder 10, from 2006, which is not only much stronger but able to make full use of the quad-core i7.
A view of Shedder 10 using an i7, facing Komodo 8 running on a smartphone
Three positions were chosen to be played with reverse colors, each engine playing it both as white and black, at a time control of fifteen minutes with a ten second increment. Why only six games? Quite simply because I had to do this by hand, and moreover, was forced to manually tell Komodo when to play. The reason is that it was not designed to play against an opponent on a smartphone, just as an analysis engine, so I would enter Shredder’s move, let Komodo analyze, and then tell it to play its move.
I took the opportunity of recording the sixth and last game in such a way that readers might
follow the analysis of Shredder 10, but also Komodo 8 on the smartphone at the same time.
The final result after six games was a merciless crush by Komodo 8 with four wins and two draw, winning by 5-1. Had the match been closer, I might have considered extending it to see how it progressed, but 5-1 is pretty clear. As a reference, the performance over the six games was a 280 Elo lead, therefore if you accept that Deep Shredder 10 on an i7 is at least 2800 Elo (it was rated 2770 on a slower single-core system), then Komodo 8 is well over 3000 Elo on an Android smartphone. For the record, the smartphone in question was an LG Optimus G Pro from 2013.
The games of the match
[Event "Rapid 15m+10s"] [Site "Rio de Janeiro, Brazil"] [Date "2014.09.22"] [Round "1"] [White "Deep Shredder 10 UCI"] [Black "Komodo 8, smartphone"] [Result "1/2-1/2"] [ECO "D51"] [PlyCount "125"] 1. d4 Nf6 2. c4 e6 {This was the starting position. After this, the engines were on their own.} 3. Nc3 d5 4. Bg5 Nbd7 5. e3 h6 6. Bxf6 Nxf6 7. Nf3 c6 8. Be2 dxc4 9. Bxc4 Bd6 10. e4 Be7 11. O-O O-O 12. Qd3 a5 13. e5 Nd5 14. Bb3 b6 15. Nxd5 cxd5 16. Bc2 g6 17. Ba4 Bd7 18. Bb3 a4 19. Bc2 Rc8 20. Rac1 Kg7 21. Qe3 Bb5 22. Rfe1 Qd7 23. a3 Rc7 24. Bb1 Rfc8 25. Rxc7 Rxc7 26. h4 Bc4 27. Qd2 Ba6 28. g3 Qb5 29. Kg2 Rc6 30. Nh2 h5 31. Nf3 Rc7 32. Rc1 Rxc1 33. Qxc1 Qe2 34. Bc2 b5 35. Qd2 b4 36. Qxe2 Bxe2 37. axb4 Bb5 38. Nd2 Bxb4 39. Nb1 Ba5 40. Kf3 f6 41. exf6+ Kxf6 42. Ke3 e5 43. dxe5+ Kxe5 44. Bxg6 Bb6+ 45. Kd2 Bxf2 46. Nc3 Bd7 47. Ne2 d4 48. Bxh5 Be3+ 49. Kc2 Bf5+ 50. Kd1 Bf2 51. Kd2 d3 52. g4 Bh7 53. Nc1 Kd4 54. Nxd3 Bxd3 55. Be8 Bxh4 56. Bxa4 Bc4 57. Bc2 Bg5+ 58. Kd1 Bb5 59. Bf5 Ba4+ 60. Bc2 Be8 61. Bf5 Bc6 62. Be6 Ba4+ 63. Ke2 1/2-1/2 [Event "Rapid 15m+10s"] [Site "Rio de Janeiro, Brazil"] [Date "2014.09.22"] [Round "2"] [White "Komodo 8, smartphone"] [Black "Deep Shredder 10 UCI"] [Result "1-0"] [ECO "E46"] [PlyCount "141"] 1. d4 Nf6 2. c4 e6 {This was the starting position. After this, the engines were on their own.} 3. Nc3 Bb4 4. e3 O-O 5. Bd2 b6 6. Bd3 Ba6 7. a3 Bxc3 8. Bxc3 d5 9. b3 Nbd7 10. Nf3 Ne4 11. Bb2 f5 12. cxd5 Bxd3 13. Qxd3 exd5 14. O-O c6 15. Ne5 Rc8 16. Rfe1 Nxe5 17. dxe5 Qh4 18. Qc2 c5 19. f3 Ng5 20. Rad1 Rc6 21. Rf1 Rh6 22. g3 Qh5 23. Qg2 Rd8 24. Rd2 Rg6 25. Kh1 Ne6 26. f4 Nc7 27. Bc3 a6 28. b4 c4 29. Kg1 Rh6 30. a4 Re8 31. Re1 Kh8 32. Bd4 Rb8 33. a5 bxa5 34. bxa5 Rb5 35. Bb6 Ne8 36. Rdd1 Rb3 37. Rf1 Rb4 38. Rb1 Rxb1 39. Rxb1 Qf7 40. Rd1 Rc6 41. Rxd5 Rc8 42. Rd1 Kg8 43. e4 fxe4 44. Qxe4 c3 45. Qd3 c2 46. Rc1 Qc4 47. Qxc4+ Rxc4 48. Kf2 Nc7 49. Bxc7 Rxc7 50. Ke3 Kf7 51. Kd3 Rd7+ 52. Kxc2 Rd5 53. Kb3 Rxa5 54. Rc7+ Kf8 55. e6 Rf5 56. Kc4 a5 57. Kd4 Rb5 58. Rf7+ Kg8 59. Ra7 Kf8 60. Ke4 Rb2 61. h4 a4 62. Rxa4 Ke7 63. f5 Rb7 64. g4 g6 65. Rd4 gxf5+ 66. gxf5 Kf6 67. Rd8 Ra7 68. Rf8+ Kg7 69. Rc8 Kf6 70. h5 Ra4+ 71. Kd5 1-0 [Event "Rapid 15m+10s"] [Site "Rio de Janeiro, Brazil"] [Date "2014.09.22"] [Round "3"] [White "Deep Shredder 10 UCI"] [Black "Komodo 8, smartphone"] [Result "0-1"] [ECO "A28"] [PlyCount "256"] 1. c4 e5 {This was the starting position. After this, the engines were on their own.} 2. Nc3 Nf6 3. Nf3 Nc6 4. e4 Bb4 5. d3 Bc5 6. Nxe5 Nxe5 7. d4 Bb4 8. dxe5 Nxe4 9. Qd4 Nxc3 10. bxc3 Ba5 11. Ba3 b6 12. Rc1 c5 13. Qd5 Rb8 14. Qd6 Bb7 15. Be2 Rc8 16. O-O Qg5 17. g3 Qf5 18. Rcd1 Qh3 19. f3 Bxc3 20. Rd3 Ba5 21. g4 Bc6 22. Re3 h5 23. g5 Qe6 24. Bb2 Kd8 25. f4 g6 26. Qd1 Kc7 27. Qc2 Kb8 28. Rd1 Rhe8 29. Ra3 Qe7 30. Bf1 Rc7 31. Bh3 Bb4 32. Re3 Rcc8 33. Qb3 Rc7 34. Red3 Qd8 35. Rd6 Re7 36. R1d3 Qc8 37. a3 Ba5 38. Rd1 Qb7 39. Bc3 Bf3 40. Rf1 Bxc3 41. Qxc3 Bc6 42. Ra1 Re8 43. a4 Ka8 44. Bf1 Re6 45. Rd2 a5 46. Bh3 Re7 47. Rb1 Be4 48. Rb3 Qa6 49. Rd6 Bc6 50. Rb2 Qb7 51. Qb3 Ka7 52. Rb1 Qb8 53. Rd2 Qb7 54. Rdb2 Be4 55. Rd1 Bf3 56. Rd6 Bc6 57. Qa3 Re8 58. Rb1 Re7 59. Qb3 Qb8 60. Rbd1 Qb7 61. Rf1 Be4 62. Rf2 Rc6 63. Rdd2 Rc8 64. Rd1 Rc7 65. Rdd2 Rc8 66. Rd6 Rc6 67. Rd1 Rc7 68. Rfd2 Bf3 69. Rb1 Bc6 70. Rbb2 Be4 71. Qc3 Bc6 72. Qc2 Be4 73. Qb3 Bf3 74. Rd3 Be4 75. Re3 Bc6 76. Rd2 Kb8 77. Re1 Ka7 78. Rd6 Rc8 79. Rb1 Rc7 80. Rd2 Re8 81. Rd6 Re7 82. Rf1 Be4 83. Qa3 Rc6 84. Rd2 Rc7 85. Qb3 Kb8 86. Rfd1 Bf3 87. Ra1 Bc6 88. Rd6 Ka7 89. Qb2 Bf3 90. Qb3 Bc6 91. Rad1 Be4 92. Qb2 Bc6 93. Qc3 Bxa4 94. Ra1 Bc6 95. Rd2 Re8 96. Rd6 Rcc8 97. Rad1 Re7 98. Rb1 Rb8 99. Rbd1 Ra8 100. Rb1 a4 101. Qc2 Kb8 102. Qc3 a3 103. Rd2 Ra4 104. Ra2 Qa6 105. Bf1 Re6 106. Rb3 Qa5 107. Qc1 d6 108. Qd1 dxe5 109. Bh3 Kb7 110. Bxe6 fxe6 111. fxe5 Rxc4 112. Rbxa3 Rd4 113. Qa1 Qb4 114. Ra7+ Kb8 115. Rf7 Rg4+ 116. Kf1 Rf4+ 117. Rxf4 Qxf4+ 118. Rf2 Bb5+ 119. Kg1 Qxg5+ 120. Rg2 Qe3+ 121. Rf2 Bd3 122. Kg2 Bf5 123. Kg1 c4 124. Qd1 Bd3 125. Qd2 Qd4 126. Qf4 Qxf4 127. Rxf4 c3 128. Rf8+ Kb7 0-1 [Event "Rapid 15m+10s"] [Site "Rio de Janeiro, Brazil"] [Date "2014.09.23"] [Round "4"] [White "Komodo 8, smartphone"] [Black "Deep Shredder 10 UCI"] [Result "1/2-1/2"] [ECO "A28"] [PlyCount "162"] 1. c4 e5 {This was the starting position. After this, the engines were on their own.} 2. Nc3 Nf6 3. Nf3 Nc6 4. e4 Bc5 5. Nxe5 Nxe5 6. d4 Bb4 7. dxe5 Nxe4 8. Qd4 Nxc3 9. bxc3 c5 10. Qe3 Ba5 11. Be2 O-O 12. Ba3 b6 13. Bf3 Rb8 14. O-O Ba6 15. Bd5 d6 16. Rad1 dxe5 17. Qxe5 Qd7 18. Bc1 Rbe8 19. Qg3 Qf5 20. Rd3 Qg6 21. Bf4 Rd8 22. Re1 Qxg3 23. hxg3 Rfe8 24. Rde3 Rxe3 25. Rxe3 Kf8 26. Bc7 Rd7 27. Bc6 Rd1+ 28. Kh2 g5 29. Bd5 Rd2 30. Rf3 Bb7 31. Bxb7 Rd7 32. Be5 Rxb7 33. Bf6 h6 34. Rd3 Rb8 35. Kh3 b5 36. cxb5 Rxb5 37. Rd7 Bb6 38. Rb7 Ke8 39. Re7+ Kf8 40. a4 Ra5 41. Re4 Bc7 42. f4 gxf4 43. gxf4 Bd6 44. Kg4 Ra6 45. Kh5 Rb6 46. g3 Ra6 47. f5 Rc6 48. c4 Rb6 49. g4 a5 50. Bd8 Rb8 51. Bxa5 Rb3 52. g5 hxg5 53. Bd8 Ra3 54. a5 Bf4 55. f6 Ra2 56. Bb6 Kg8 57. Re7 Ra1 58. Re8+ Kh7 59. Rf8 Rh1+ 60. Kg4 Kg6 61. a6 Ra1 62. Rg8+ Kxf6 63. a7 Ra3 64. Bd8+ Ke6 65. Bxg5 Bxg5 66. a8=Q Rxa8 67. Rxa8 Bf6 68. Ra3 Ke5 69. Rf3 Bh8 70. Rh3 f5+ 71. Kf3 Bf6 72. Rh6 Bg5 73. Rg6 Bd2 74. Rg7 Kd4 75. Rd7+ Kc3 76. Rd5 Bc1 77. Rxc5 Ba3 78. Ra5 Bb4 79. Rxf5 Kxc4 80. Ke4 Bc5 81. Rxc5+ Kxc5 1/2-1/2 [Event "Rapid 15m+10s"] [Site "Rio de Janeiro, Brazil"] [Date "2014.09.23"] [Round "5"] [White "Komodo 8, smartphone"] [Black "Deep Shredder 10 UCI"] [Result "1-0"] [ECO "C51"] [PlyCount "139"] 1. e4 e5 2. Nf3 Nc6 3. Bc4 Bc5 4. b4 Bxb4 5. c3 {This was the starting position. After this, the engines were on their own.} Bd6 6. d4 Nf6 7. O-O O-O 8. Bd3 a6 9. Nbd2 b5 10. Nb3 Bb7 11. a4 h6 12. h3 Qb8 13. Nc5 Bxc5 14. dxc5 bxa4 15. Rb1 Qa7 16. Nh2 Rae8 17. Ng4 Nxg4 18. Qxg4 Re6 19. Bc4 Rf6 20. Be3 Bc8 21. Qe2 Na5 22. Ba2 Qa8 23. Rb4 a3 24. Ra4 Nc6 25. Rxa3 Ne7 26. f3 Ng6 27. g3 Rd8 28. Ra5 Ne7 29. Rb1 Rf8 30. Bc4 Bb7 31. h4 Nc6 32. Ra4 a5 33. Rba1 Qa7 34. Rd1 Qa8 35. Rxd7 Rd8 36. Rd5 Bc8 37. Rxd8+ Nxd8 38. Bd5 c6 39. Bb3 Be6 40. Bc2 Rg6 41. Kh2 h5 42. Ra1 Nb7 43. Rb1 a4 44. Rb4 a3 45. Ra4 Qe8 46. Rxa3 Qf8 47. Qf2 Bc4 48. Ra7 Qc8 49. f4 Qb8 50. Ra4 Bb5 51. Rb4 exf4 52. Bxf4 Qa8 53. e5 Re6 54. Bb3 Rg6 55. Be3 Nd8 56. Qf3 Qc8 57. Qxh5 Bf1 58. g4 Ne6 59. Bc2 Qc7 60. Kg1 Bb5 61. Bxg6 fxg6 62. Qxg6 Qxe5 63. Qe8+ Kh7 64. Qh5+ Qxh5 65. gxh5 Bd3 66. Kf2 Bf5 67. Rb7 Bc2 68. h6 Kg8 69. hxg7 Nxg7 70. Kf3 1-0 [Event "Rapid 15m+10s"] [Site "Rio de Janeiro, Brazil"] [Date "2014.09.23"] [Round "6"] [White "Deep Shredder 10 UCI"] [Black "Komodo 8, smartphone"] [Result "0-1"] [ECO "C51"] [PlyCount "108"] 1. e4 e5 2. Nf3 Nc6 3. Bc4 Bc5 4. b4 Bxb4 5. c3 {This was the starting position. After this, the engines were on their own.} Bd6 6. d4 Nf6 7. O-O O-O 8. Re1 h6 9. Nbd2 Re8 10. Bb2 Rb8 11. Qb3 Re7 12. Bb5 Na5 13. Qc2 b6 14. c4 Bb4 15. dxe5 Nh5 16. a3 Bxd2 17. Nxd2 Nf4 18. Qc3 Ne6 19. Qg3 Nc5 20. Bd4 Nab7 21. Nb3 a6 22. Bxc5 Nxc5 23. Nxc5 axb5 24. Nb3 bxc4 25. Nd4 Qf8 26. Rac1 Ba6 27. Red1 Rbe8 28. f4 d6 29. Nc6 Re6 30. f5 Rxe5 31. Nxe5 Rxe5 32. f6 b5 33. Re1 g6 34. Qe3 Kh7 35. Qd4 Qe8 36. Re3 Qc6 37. Rce1 Bb7 38. h4 Rh5 39. g3 Re5 40. Kf2 Qd7 41. a4 Qe6 42. axb5 Rxb5 43. Rc1 Rb4 44. Rd1 Rb3 45. Rxb3 cxb3 46. Rd3 Bxe4 47. Re3 Qf5+ 48. Ke1 c5 49. Qc3 Bd5 50. Kd2 c4 51. Re2 b2 52. Qxb2 Qd3+ 53. Kc1 c3 54. Qb4 Qxe2 0-1
If anyone had any doubt as to the genuine progress of chess engines, and the merit of buying new versions, they can lay these concerns to rest. Chess engines have not only progressed over the last ten years, but there is reason to believe they have outpaced the hardware even. If you want the latest and greatest, Komodo 8 is the king of the hill.
Komodo 8 can be purchased in the ChessBase Shop
