Stefan Pohl Computer Chess

Latest Website-News (2024/09/13): Testrun of Stockfish 17 finished: 0 Celo to Stockfish 240820 and +10 Celo to Stockfish 16.1. And +42 Gamepair-Celo to Stockfish 16.1.

Gamepairs of Stockfish 17 vs. Stockfish 16.1: 500 (+143 =268 -89) = 55.4% = +42 Celo

 

Dont forget to take a look at my EAS-Ratinglist (The world's first engine-ratinglist not measuring strength of engines, but engines's style of play).

 

 

Stay tuned

UHO-Top15 Engines Ratinglist (+ regular testing of Stockfish Dev-versions)

 

 

Playing conditions:

 

The 15 strongest engines and the latest StockfishDev version are playing 1000 games vs. each opponent: 15000 games per engine are played. A RoundRobin Tournament with 120000 games overall !

 

Hardware: AMD Ryzen 3900 12-core (24 threads) notebook with 32GB RAM. 

Speed: (singlethread, TurboBoost-mode switched off, chess starting position) Stockfish 17: 500 kn/s (when 20 games are running simultaneously)

Hash: 256MB per engine

GUI: Cutechess-cli (GUI ends game, when a 5-piece endgame is on the board, all other games are played until mate or draw by chess-rules (3fold, 50-moves, stalemate))

Tablebases: None for engines, 5 Syzygy for cutechess-cli

Openings: My UHO_2022_6mvs_+120_+129 openings are used (first 500 lines) (UHO 2022 openings are part of my Anti Draw Openings download-package). 

Ponder, Large Memory Pages & learning: Off

Thinking time: 3min+1sec per game/engine (average game-duration: 7 min 50sec), around 3500-4000 games in 24 hours are played. One testrun (15000 games) takes around 100 hours (=4 days and some hours)

The version-numbers of the Stockfish engines are the date of the latest patch, which was included in the Stockfish sourcecode, not the release-date of the engine-file, written backwards (year,month,day))(example: 200807 = August, 7, 2020). The used SF compile is the AVX2-compile, which is the fastest on my AMD Ryzen CPU. SF binaries are taken from https://github.com/official-stockfish/Stockfish/releases (except the official SF-release versions, which are taken form the official Stockfish website).

Read the explanation, why I chose my testing-conditions, like I did here

 

Latest update: 2024/09/13: Stockfish 17 (0 Celo to Stockfish 240820 and +10 Celo to Stockfish 16.1)

 

(Ordo-calculation fixed to Stockfish 17 = 3843 Celo. Mention, there are no human or "realistic" Elo numbers in enginechess, since the engines reached superhuman strength, so I decided to use "Celo" (=Computer Elo) instead)

 

See the tournament cross-table as a picture (done by Fritz18 GUI) here

See the individual statistics of engine-results here

See the Engines Aggressiveness Score Ratinglist here

See the Gamepair-statistics of the UHO-Top15 Ratinglist here

See the full UHO Ratinglist (with EAS-Ratinglist): here

Download the current gamebase, the full-list gamebase and the archive here

See the old SPCC-Ratinglist (full list) and EAS-List from 2020 until 2023/08/28: here

 

(best Stockfish Celo: Stockfish 240719: 3845 Celo, latest full release (Stockfish 17) had 3843 Celo)

(highest EAS-Score since Stockfish 16 release: Stockfish 240519: 203882 EAS-points)

(Read the explanation of the Lc0-entry in the Ratinglist here).

     Program                    Celo    +    - Games    Score   Av.Op. Draws

   1 Stockfish 17 240906      : 3843    4    4 15000    70.7%   3683   48.6%
   2 Stockfish 16.1 240224    : 3833    4    4 15000    69.4%   3684   48.8%
   3 Torch 3 popavx2          : 3806    4    4 15000    66.0%   3685   48.5%
 [   Lc0 0.32dev BT4-6077500  : 3781   15   15  1000 (NN vs SF15.1 testing)]
   4 Berserk 13 avx2          : 3734    4    4 15000    56.1%   3690   50.6%
   5 Obsidian 13.08 avx2      : 3727    4    4 15000    55.1%   3691   51.2%
   6 KomodoDragon 3.3 avx2    : 3727    4    4 15000    55.0%   3691   51.3%
   7 Caissa 1.20 avx2         : 3686    4    4 15000    49.0%   3693   50.9%
   8 PlentyChess 2.1 avx2     : 3684    4    4 15000    48.8%   3693   52.0%
   9 Ethereal 14.38 avx2      : 3683    4    4 15000    48.7%   3694   50.3%
  10 RubiChess 240817 avx2    : 3670    4    4 15000    46.8%   3694   49.7%
  11 Alexandria 7.0 avx2      : 3653    4    4 15000    44.4%   3696   51.6%
  12 Clover 8.0 avx2          : 3642    4    4 15000    42.8%   3696   51.0%
  13 Viridithas 14.0 avx2     : 3615    4    4 15000    38.9%   3698   49.3%
  14 Lizard 10.5 avx2         : 3597    4    4 15000    36.5%   3699   49.5%
  15 Motor 0.70 avx2          : 3596    4    4 15000    36.4%   3699   51.3%
  16 Titan 1.1 avx2           : 3589    4    4 15000    35.3%   3700   49.7%

Games        : 120000 (finished)

White Wins   : 57573 (48.0 %)
Black Wins   : 2112   (1.8 %)
Draws        : 60315 (50.3 %)

Below the UHO-Top15 Ratinglist, recalculated with Gamepairs (using my Gamepair Rescoring Tool V1.5), Ordo-calculation fixed to Stockfish 17 = 3843 Celo, realizing Vondele's (Stockfish Maintainer) idea: "Thinking uniquely in game pairs makes sense with the biased openings used these days. While pentanomial makes  sense it is a bit complicated so we could simplify and score game pairs only (not games) as W-L-D (a traditional score of 2-0, or 1.5-0.5 is just a W)."

See the head-to-head gamepair-statistics of the UHO-Top15 Ratinglist here

   # PLAYER                   :    Celo  Error   Pairs     W     D     L   (%)  CFS(%)
   1 Stockfish 17 240906      :    3843   ----    7500  6125  1218   157  89.8     100
   2 Stockfish 16.1 240224    :    3801     13    7500  5841  1425   234  87.4     100
   3 Torch 3 popavx2          :    3697     12    7500  5088  1839   573  80.1     100
   4 Berserk 13 avx2          :    3499     12    7500  3282  2629  1589  61.3     100
   5 KomodoDragon 3.3 avx2    :    3486     11    7500  3087  2803  1610  59.8      88
   6 Obsidian 13.08 avx2      :    3481     12    7500  3070  2751  1679  59.3     100
   7 Caissa 1.20 avx2         :    3384     12    7500  2143  2895  2462  47.9      81
   8 PlentyChess 2.1 avx2     :    3380     12    7500  2048  3019  2433  47.4      59
   9 Ethereal 14.38 avx2      :    3379     12    7500  2077  2944  2479  47.3     100
  10 RubiChess 240817 avx2    :    3355     12    7500  1870  2917  2713  44.4     100
  11 Alexandria 7.0 avx2      :    3311     12    7500  1488  2897  3115  39.2     100
  12 Clover 8.0 avx2          :    3282     12    7500  1252  2862  3386  35.8     100
  13 Viridithas 14.0 avx2     :    3230     12    7500   957  2563  3980  29.8     100
  14 Lizard 10.5 avx2         :    3177     13    7500   643  2347  4510  24.2      69
  15 Motor 0.70 avx2          :    3174     12    7500   602  2392  4506  24.0     100
  16 Titan 1.1 avx2           :    3158     13    7500   521  2311  4668  22.4     ---

------------------------------------------------------------------- 
--- Number of all Gamepairs          : 60000 
--- Number of drawn Gamepairs overall: 19906 (= 33.18%) 
--- Number of 1:1 drawn Gamepairs    : 9001  (= 15.00%) 
--- Number of 2-draws drawn Gamepairs: 10905 (= 18.17%) 
------------------------------------------------------------------- 

Aborted testruns, because the tested engine was too weak to enter the UHO-Top15 Ratinglist:

Minic 3.41, Booot 7.3, Black Marlin 9.0, Equisetum 1.0, Stormphrax 5

Below you find a diagram of the progress of Stockfish in my tests since February 2023. 

And below that diagram, the older diagrams.

 

You can save the diagrams on your PC with mouseclick (right button) and then choose "save image"...