Stefan Pohl Computer Chess

Home of famous UHO openings and EAS Ratinglist


Latest Website-News (2024/06/23): Testrun of Stockfish 240615 finished: -2 Celo to Stockfish 240608.

 

Dont forget to take a look at my EAS-Ratinglist (The world's first engine-ratinglist not measuring strength of engines, but engines's style of play).

 

Stay tuned


UHO-Top15 Engines Ratinglist (+ regular testing of Stockfish Dev-versions)

 

Playing conditions:

 

The 15 strongest engines and the latest StockfishDev version are playing 1000 games vs. each opponent: 15000 games per engine are played. A RoundRobin Tournament with 120000 games overall !

 

Hardware: AMD Ryzen 3900 12-core (24 threads) notebook with 32GB RAM. 

Speed: (singlethread, TurboBoost-mode switched off, chess starting position) Stockfish 16.1: 500 kn/s (when 20 games are running simultaneously)

Hash: 256MB per engine

GUI: Cutechess-cli (GUI ends game, when a 5-piece endgame is on the board, all other games are played until mate or draw by chess-rules (3fold, 50-moves, stalemate, insufficent material))

Tablebases: None for engines, 5 Syzygy for cutechess-cli

OpeningsMy UHO_2022_6mvs_+120_+129 openings are used (first 500 lines) (part of my UHO 2022 download). 

Ponder, Large Memory Pages & learning: Off

Thinking time: 3min+1sec per game/engine (average game-duration: 7 min 50sec), around 3500-4000 games in 24 hours are played. One testrun (15000 games) takes around 100 hours (=4 days and some hours)

The version-numbers of the Stockfish engines are the date of the latest patch, which was included in the Stockfish sourcecode, not the release-date of the engine-file, written backwards (year,month,day))(example: 200807 = August, 7, 2020). The used SF compile is the AVX2-compile, which is the fastest on my AMD Ryzen CPU. SF binaries are taken from https://github.com/official-stockfish/Stockfish/releases (except the official SF-release versions, which are taken form the official Stockfish website).

Read the explanation, why I chose my testing-conditions, like I did here

 

Latest update: 2024/06/23: Stockfish 240615 (-2 Celo to Stockfish 240608)

 

(Ordo-calculation fixed to Stockfish 16.1 = 3833 Celo. Mention, there are no human or "realistic" Elo numbers in enginechess, since the engines reached superhuman strength, so I decided to use "Celo" (=Computer Elo) instead)

 

See the tournament cross-table as a picture (done by Fritz18 GUI) here

See the individual statistics of engine-results here

See the Engines Aggressiveness Score Ratinglist here

See the Gamepair-statistics of the UHO-Top15 Ratinglist here

See the full UHO Ratinglist (with EAS-Ratinglist): here

Download the current gamebase, the full-list gamebase and the archive here

See the old SPCC-Ratinglist (full list) and EAS-List from 2020 until 2023/08/28: here

 

(best Stockfish Celo: Stockfish 240602: 3844 Celo, latest full release (Stockfish 16.1) had 3833 Celo)

(highest EAS-Score since Stockfish 16.1 release: Stockfish 240519: 203882 EAS points)

(Read the explanation of the Lc0-entry in the Ratinglist here).

     Program                    Celo    +    - Games    Score   Av.Op. Draws

   1 Stockfish 240615 avx2    : 3840    4    4 15000    70.9%   3678   47.9%
   2 Stockfish 16.1 240224    : 3833    4    4 15000    70.0%   3679   48.5%
   3 Torch 2 popavx2          : 3799    4    4 15000    65.7%   3681   48.6%
  [  Lc0 0.31dev T3-2815      : 3781   15   15  1000 (NN vs SF15.1 testing)]
   4 Berserk 13 avx2          : 3745    4    4 15000    58.2%   3685   49.8%
   5 KomodoDragon 3.3 avx2    : 3735    4    4 15000    56.8%   3685   50.8%
   6 Obsidian 12.29 avx2      : 3711    4    4 15000    53.4%   3687   51.8%
   7 Ethereal 14.38 avx2      : 3696    4    4 15000    51.2%   3688   49.6%
   8 Caissa 1.18 avx2         : 3672    4    4 15000    47.7%   3689   49.9%
   9 PlentyChess 2.0 avx2     : 3667    4    4 15000    47.0%   3690   50.6%
  10 Alexandria 7.0 avx2      : 3667    4    4 15000    47.0%   3690   51.4%
  11 RubiChess 240112 avx2    : 3647    4    4 15000    44.2%   3691   48.8%
  12 Clover 6.2 avx2          : 3604    4    4 15000    38.1%   3694   51.7%
  13 Titan 1.1 avx2           : 3604    4    4 15000    38.1%   3694   50.1%
  14 Seer 2.8.0 avx2          : 3602    4    4 15000    37.8%   3694   49.5%
  15 Uralochka 3.41a avx2     : 3597    4    4 15000    37.1%   3694   49.0%
  16 CSTal 2.0 avx2           : 3594    4    4 15000    36.7%   3695   51.0%


Games        : 120000 (finished)

White Wins   : 57933 (48.3 %)
Black Wins   : 2151   (1.8 %)
Draws        : 59916 (49.9 %)


Below the UHO-Top15 Ratinglist, recalculated with Gamepairs (using my Gamepair Rescoring Tool V1.5), Ordo-calculation fixed to Stockfish 16.1 = 3833 Celo, realizing Vondele's (Stockfish Maintainer) idea: "Thinking uniquely in game pairs makes sense with the biased openings used these days. While pentanomial makes  sense it is a bit complicated so we could simplify and score game pairs only (not games) as W-L-D (a traditional score of 2-0, or 1.5-0.5 is just a W)."

See the head-to-head gamepair-statistics of the UHO-Top15 Ratinglist here

   # PLAYER                   :    Celo  Error   Pairs     W     D     L   (%)  CFS(%)
   1 Stockfish 240615 avx2    :    3864     13    7500  6145  1224   131  90.1     100
   2 Stockfish 16.1 240224    :    3833   ----    7500  5971  1317   212  88.4     100
   3 Torch 2 popavx2          :    3705     12    7500  5052  1863   585  79.8     100
   4 Berserk 13 avx2          :    3546     12    7500  3701  2422  1377  65.5     100
   5 KomodoDragon 3.3 avx2    :    3525     12    7500  3454  2598  1448  63.4     100
   6 Obsidian 12.29 avx2      :    3458     12    7500  2799  2808  1893  56.0     100
   7 Ethereal 14.38 avx2      :    3425     12    7500  2486  2858  2156  52.2     100
   8 Caissa 1.18 avx2         :    3368     12    7500  1995  2848  2657  45.6     100
   9 Alexandria 7.0 avx2      :    3356     12    7500  1882  2857  2761  44.1      82
  10 PlentyChess 2.0 avx2     :    3351     12    7500  1815  2915  2770  43.6     100
  11 RubiChess 240112 avx2    :    3322     12    7500  1618  2787  3095  40.2     100
  12 Titan 1.1 avx2           :    3210     12    7500   804  2533  4163  27.6      76
  13 Seer 2.8.0 avx2          :    3207     13    7500   806  2475  4219  27.2      90
  14 Clover 6.2 avx2          :    3200     12    7500   773  2445  4282  26.6     100
  15 Uralochka 3.41a avx2     :    3185     12    7500   660  2434  4406  25.0      79
  16 CSTal 2.0 avx2           :    3181     13    7500   673  2348  4479  24.6     ---


------------------------------------------------------------------- 
--- Number of all Gamepairs          : 60000 
--- Number of drawn Gamepairs overall: 19366 (= 32.28%) 
--- Number of 1:1 drawn Gamepairs    :  8931 (= 14.88%) 
--- Number of 2-draws drawn Gamepairs: 10435 (= 17.39%) 
------------------------------------------------------------------- 


Aborted testruns, because the tested engine was too weak to enter the UHO-Top15 Ratinglist:

Minic 3.40, Stormphrax 4.1.0, Booot 7.3, Black Marlin 9.0, Equisetum 1.0


Below you find a diagram of the progress of Stockfish in my tests since February 2023

And below that diagram, the older diagrams.

 

You can save the diagrams on your PC with mouseclick (right button) and then choose "save image"...







Sie sind Besucher Nr.