Stefan Pohl Computer Chess

Latest Website-News (2024/04/16): Testrun of Obsidian 12.0 finished: +42 Elo to Obsidian 11.0. Obsidian climbed from rank 9 to rank 6 in my UHO-Top15 Ratinglist.

And a measureable progress in my EAS Ratinglist (the EAS-Score raised from 73921 (rank 10, Obsidian 11) to 111643 (rank 4, Obsidian 12)) !! Very remarkable, because normally, the EAS-Score lowers, when a strong engine makes measureable Elo-progress...

 

Dont forget to take a look at my EAS-Ratinglist (The world's first engine-ratinglist not measuring strength of engines, but engines's style of play).

 

Next testrun: Stockfish 240413

 

Stay tuned

UHO-Top15 Engines Ratinglist (+ regular testing of Stockfish Dev-versions)

 

Playing conditions:

 

The 15 strongest engines and the latest StockfishDev version are playing 1000 games vs. each opponent: 15000 games per engine are played. A RoundRobin Tournament with 120000 games overall !

 

Hardware: AMD Ryzen 3900 12-core (24 threads) notebook with 32GB RAM. 

Speed: (singlethread, TurboBoost-mode switched off, chess starting position) Stockfish 16.1: 500 kn/s (when 20 games are running simultaneously)

Hash: 256MB per engine

GUI: Cutechess-cli (GUI ends game, when a 5-piece endgame is on the board, all other games are played until mate or draw by chess-rules (3fold, 50-moves, stalemate, insufficent material))

Tablebases: None for engines, 5 Syzygy for cutechess-cli

Openings: My UHO_2022_6mvs_+120_+129 openings are used (first 500 lines) (part of my UHO 2022 download). 

Ponder, Large Memory Pages & learning: Off

Thinking time: 3min+1sec per game/engine (average game-duration: 7 min 50sec), around 3500-4000 games in 24 hours are played. One testrun (15000 games) takes around 100 hours (=4 days and some hours)

The version-numbers of the Stockfish engines are the date of the latest patch, which was included in the Stockfish sourcecode, not the release-date of the engine-file, written backwards (year,month,day))(example: 200807 = August, 7, 2020). The used SF compile is the AVX2-compile, which is the fastest on my AMD Ryzen CPU. SF binaries are taken from https://github.com/official-stockfish/Stockfish/releases (except the official SF-release versions, which are taken form the official Stockfish website).

Read the explanation, why I chose my testing-conditions, like I did here

 

Latest update: 2024/04/16: Obsidian 12.0 (+42 Elo to Obsidian 11.0)

 

(Ordo-calculation fixed to Stockfish 16.1 = 3833 Elo)

 

See the tournament cross-table as a picture (done by Fritz18 GUI) here

See the individual statistics of engine-results here

See the Engines Aggressiveness Score Ratinglist here

See the Gamepair-statistics of the UHO-Top15 Ratinglist here

See the full UHO Ratinglist (with EAS-Ratinglist): here

Download the current gamebase, the full-list gamebase and the archive here

See the old SPCC-Ratinglist (full list) and EAS-List from 2020 until 2023/08/28: here

 

(best Stockfish Elo so far: Stockfish 240322: 3839 Elo, latest full release (Stockfish 16.1) had 3833 Elo)

(Read the explanation of the Lc0-entry in the Ratinglist here).

     Program                    Elo    +    -  Games    Score   Av.Op. Draws

   1 Stockfish 240322 avx2    : 3839    4    4 15000    71.5%   3671   48.0%
   2 Stockfish 16.1 240224    : 3833    4    4 15000    70.8%   3672   47.8%
   3 Torch 2 popavx2          : 3803    4    4 15000    67.0%   3674   47.8%
  [  Lc0 0.31dev T3-2815      : 3779   15   15  1000 (NN vs SF15.1 testing)]
   4 Berserk 13 avx2          : 3752    4    4 15000    60.1%   3677   48.9%
   5 KomodoDragon 3.3 avx2    : 3740    4    4 15000    58.5%   3678   49.6%
   6 Obsidian 12.0 avx2       : 3698    4    4 15000    52.5%   3681   51.0%
   7 Caissa 1.18 avx2         : 3682    4    4 15000    50.2%   3682   50.1%
   8 RubiChess 240112 avx2    : 3659    4    4 15000    46.9%   3683   49.1%
   9 Ethereal 14.25 nnue      : 3658    4    4 15000    46.7%   3683   50.3%
  10 PlentyChess 1.0 avx2     : 3636    4    4 15000    43.5%   3685   50.3%
  11 Alexandria 6.1.0 avx2    : 3615    4    4 15000    40.6%   3686   49.8%
  12 Seer 2.8.0 avx2          : 3614    4    4 15000    40.4%   3686   50.0%
  13 CSTal 2.0 avx2           : 3602    4    4 15000    38.8%   3687   50.8%
  14 Rebel 16.3 avx2          : 3600    4    4 15000    38.5%   3687   49.7%
  15 Clover 6.1 avx2          : 3593    4    4 15000    37.5%   3688   50.5%
  16 Koivisto 9.2 avx2        : 3585    4    4 15000    36.5%   3688   49.2%

Games        : 120000 (finished)

White Wins   : 57855 (48.2 %)
Black Wins   : 2681 (2.2 %)
Draws        : 59464 (49.6 %)

Below the UHO-Top15 Ratinglist, recalculated with Gamepairs (using my Gamepair Rescoring Tool V1.5), realizing Vondele's (Stockfish Maintainer) idea: "Thinking uniquely in game pairs makes sense with the biased openings used these days. While pentanomial makes  sense it is a bit complicated so we could simplify and score game pairs only (not games) as W-L-D (a traditional score of 2-0, or 1.5-0.5 is just a W)."

See the head-to-head gamepair-statistics of the UHO-Top15 Ratinglist here

   # PLAYER                   :  RATING  ERROR  PLAYED     W     D     L   (%)  CFS(%)
   1 Stockfish 240322 avx2    :    3865     14    7500  6245  1133   122  90.8     100
   2 Stockfish 16.1 240224    :    3833   ----    7500  6085  1211   204  89.2     100
   3 Torch 2 popavx2          :    3710     13    7500  5299  1658   543  81.7     100
   4 Berserk 13 avx2          :    3548     13    7500  4063  2155  1282  68.5     100
   5 KomodoDragon 3.3 avx2    :    3523     13    7500  3819  2290  1391  66.2     100
   6 Obsidian 12.0 avx2       :    3408     13    7500  2705  2736  2059  54.3     100
   7 Caissa 1.18 avx2         :    3373     13    7500  2429  2699  2372  50.4     100
   8 RubiChess 240112 avx2    :    3325     13    7500  1999  2737  2764  44.9      98
   9 Ethereal 14.25 nnue      :    3316     13    7500  1939  2705  2856  43.9     100
  10 PlentyChess 1.0 avx2     :    3265     13    7500  1452  2799  3249  38.0     100
  11 Alexandria 6.1.0 avx2    :    3222     13    7500  1163  2632  3705  33.1      96
  12 Seer 2.8.0 avx2          :    3213     13    7500  1093  2632  3775  32.1     100
  13 CSTal 2.0 avx2           :    3181     13    7500   893  2500  4107  28.6      64
  14 Rebel 16.3 avx2          :    3179     13    7500   876  2506  4118  28.4     100
  15 Clover 6.1 avx2          :    3153     13    7500   766  2325  4409  25.7     100
  16 Koivisto 9.2 avx2        :    3138     13    7500   690  2250  4560  24.2     ---

 

------------------------------------------------------------------- 
--- Number of all Gamepairs          : 60000 
--- Number of drawn Gamepairs overall: 18484 (= 30.81%) 
--- Number of 1:1 drawn Gamepairs    : 8517  (= 14.19%) 
--- Number of 2-draws drawn Gamepairs: 9967  (= 16.61%) 
------------------------------------------------------------------- 

Aborted testruns, because the tested engine was too weak to enter the UHO-Top15 Ratinglist:

Minic 3.40, Stormphrax 4.1.0, Booot 7.3, Black Marlin 9.0, Equisetum 1.0

Below you find a diagram of the progress of Stockfish in my tests since February 2023. 

And below that diagram, the older diagrams.

 

You can save the diagrams on your PC with mouseclick (right button) and then choose "save image"...