Stefan Pohl Computer Chess

Home of famous UHO openings and EAS Ratinglist


Latest Website-News (2024/05/09): Testrun of Uralochka 3.41a finished: +49 Celo to Uralochka 3.40a. Uralochka re-entered the UHO-Top15 Ratinglist with this new version and kicked Koivisto 9.2 out.

The 6 engines on rank 11-16 are extremly close in strength: Only 21 Celo from rank 16 to 11.

Mention, there are no human or "realistic" Elo numbers in enginechess, since the engines reached superhuman strength, so I decided to use "Celo" (=Computer Elo) instead)

 

Dont forget to take a look at my EAS-Ratinglist (The world's first engine-ratinglist not measuring strength of engines, but engines's style of play).

 

Next testrun: Stockfish 240509 (Stockfish 240505 testrun aborted, because a lot of new patches were just released in Stockfish 240509 (4 functional patches and 5 simplification patches (!))

Next NN-testrun: Lc0 0.31dev 819344 (new net from T80 training-run)

 

BUG ALERT There was a bug found in pgn-extract, which affects my EAS-Tool and my other tools: Do not use any pgn-files, containing games, that are starting from a FEN-code. Then pgn-extract can detect false sacs and so will my tools, which are using pgn-extract! If the games in the pgn-file, given to the EAS-Tool, start from move 1 and from the normal chess starting-position, everything works fine - that is the reason, I never recognized this bug, because my games all start from move 1.

 

Stay tuned


UHO-Top15 Engines Ratinglist (+ regular testing of Stockfish Dev-versions)

 

Playing conditions:

 

The 15 strongest engines and the latest StockfishDev version are playing 1000 games vs. each opponent: 15000 games per engine are played. A RoundRobin Tournament with 120000 games overall !

 

Hardware: AMD Ryzen 3900 12-core (24 threads) notebook with 32GB RAM. 

Speed: (singlethread, TurboBoost-mode switched off, chess starting position) Stockfish 16.1: 500 kn/s (when 20 games are running simultaneously)

Hash: 256MB per engine

GUI: Cutechess-cli (GUI ends game, when a 5-piece endgame is on the board, all other games are played until mate or draw by chess-rules (3fold, 50-moves, stalemate, insufficent material))

Tablebases: None for engines, 5 Syzygy for cutechess-cli

OpeningsMy UHO_2022_6mvs_+120_+129 openings are used (first 500 lines) (part of my UHO 2022 download). 

Ponder, Large Memory Pages & learning: Off

Thinking time: 3min+1sec per game/engine (average game-duration: 7 min 50sec), around 3500-4000 games in 24 hours are played. One testrun (15000 games) takes around 100 hours (=4 days and some hours)

The version-numbers of the Stockfish engines are the date of the latest patch, which was included in the Stockfish sourcecode, not the release-date of the engine-file, written backwards (year,month,day))(example: 200807 = August, 7, 2020). The used SF compile is the AVX2-compile, which is the fastest on my AMD Ryzen CPU. SF binaries are taken from https://github.com/official-stockfish/Stockfish/releases (except the official SF-release versions, which are taken form the official Stockfish website).

Read the explanation, why I chose my testing-conditions, like I did here

 

Latest update: 2024/05/09: Uralochka 3.41a (+49 Celo to Uralochka 3.40a)

 

(Ordo-calculation fixed to Stockfish 16.1 = 3833 Celo. Mention, there are no human or "realistic" Elo numbers in enginechess, since the engines reached superhuman strength, so I decided to use "Celo" (=Computer Elo) instead)

 

See the tournament cross-table as a picture (done by Fritz18 GUI) here

See the individual statistics of engine-results here

See the Engines Aggressiveness Score Ratinglist here

See the Gamepair-statistics of the UHO-Top15 Ratinglist here

See the full UHO Ratinglist (with EAS-Ratinglist): here

Download the current gamebase, the full-list gamebase and the archive here

See the old SPCC-Ratinglist (full list) and EAS-List from 2020 until 2023/08/28: here

 

(best Stockfish Celo: Stockfish 240424: 3844 Celo, latest full release (Stockfish 16.1) had 3833 Celo)

(Read the explanation of the Lc0-entry in the Ratinglist here).

     Program                    Celo    +    - Games    Score   Av.Op. Draws

   1 Stockfish 240428 avx2    : 3841    4    4 15000    71.5%   3673   47.4%
   2 Stockfish 16.1 240224    : 3833    4    4 15000    70.5%   3674   47.9%
   3 Torch 2 popavx2          : 3801    4    4 15000    66.5%   3676   47.8%
  [  Lc0 0.31dev T3-2815      : 3781   15   15  1000 (NN vs SF15.1 testing)]
   4 Berserk 13 avx2          : 3748    4    4 15000    59.3%   3679   49.0%
   5 KomodoDragon 3.3 avx2    : 3738    4    4 15000    57.9%   3680   49.8%
   6 Ethereal 14.38 avx2      : 3701    4    4 15000    52.7%   3682   49.0%
   7 Obsidian 12.0 avx2       : 3696    4    4 15000    51.9%   3683   50.7%
   8 Caissa 1.18 avx2         : 3679    4    4 15000    49.5%   3684   49.1%
   9 RubiChess 240112 avx2    : 3656    4    4 15000    46.1%   3686   49.1%
  10 PlentyChess 1.0 avx2     : 3633    4    4 15000    42.9%   3687   50.0%
  11 Alexandria 6.1.0 avx2    : 3613    4    4 15000    40.0%   3688   49.4%
  12 Seer 2.8.0 avx2          : 3609    4    4 15000    39.5%   3689   49.0%
  13 CSTal 2.0 avx2           : 3600    4    4 15000    38.3%   3689   51.0%
  14 Uralochka 3.41a avx2     : 3600    4    4 15000    38.3%   3689   48.3%
  15 Rebel 16.3 avx2          : 3598    4    4 15000    38.0%   3689   49.7%
  16 Clover 6.1 avx2          : 3592    4    4 15000    37.1%   3690   50.3%


Games        : 120000 (finished)

White Wins   : 58365 (48.6 %)
Black Wins   : 2586 (2.2 %)
Draws        : 59049 (49.2 %)


Below the UHO-Top15 Ratinglist, recalculated with Gamepairs (using my Gamepair Rescoring Tool V1.5), realizing Vondele's (Stockfish Maintainer) idea: "Thinking uniquely in game pairs makes sense with the biased openings used these days. While pentanomial makes  sense it is a bit complicated so we could simplify and score game pairs only (not games) as W-L-D (a traditional score of 2-0, or 1.5-0.5 is just a W)."

See the head-to-head gamepair-statistics of the UHO-Top15 Ratinglist here

   # PLAYER                   :  RATING  ERROR  PLAYED     W     D     L   (%)  CFS(%)
   1 Stockfish 240428 avx2    :    3870     13    7500  6260  1108   132  90.9     100
   2 Stockfish 16.1 240224    :    3833   ----    7500  6049  1244   207  88.9     100
   3 Torch 2 popavx2          :    3707     13    7500  5212  1730   558  81.0     100
   4 Berserk 13 avx2          :    3542     12    7500  3903  2266  1331  67.1     100
   5 KomodoDragon 3.3 avx2    :    3521     12    7500  3685  2404  1411  65.2     100
   6 Ethereal 14.38 avx2      :    3423     12    7500  2766  2694  2040  54.8     100
   7 Obsidian 12.0 avx2       :    3408     12    7500  2606  2758  2136  53.1     100
   8 Caissa 1.18 avx2         :    3372     12    7500  2323  2708  2469  49.0     100
   9 RubiChess 240112 avx2    :    3323     12    7500  1877  2760  2863  43.4     100
  10 PlentyChess 1.0 avx2     :    3265     12    7500  1367  2787  3346  36.8     100
  11 Alexandria 6.1.0 avx2    :    3222     13    7500  1084  2627  3789  32.0     100
  12 Seer 2.8.0 avx2          :    3209     12    7500  1008  2556  3936  30.5     100
  13 CSTal 2.0 avx2           :    3181     13    7500   836  2464  4200  27.6      63
  14 Rebel 16.3 avx2          :    3180     13    7500   813  2486  4201  27.4      61
  15 Uralochka 3.41a avx2     :    3179     12    7500   795  2501  4204  27.3     100
  16 Clover 6.1 avx2          :    3156     13    7500   733  2273  4494  24.9     ---

 

------------------------------------------------------------------- 
--- Number of all Gamepairs          : 60000 
--- Number of drawn Gamepairs overall: 18683 (= 31.14%) 
--- Number of 1:1 drawn Gamepairs    : 8858  (= 14.76%) 
--- Number of 2-draws drawn Gamepairs: 9825  (= 16.37%) 
------------------------------------------------------------------- 


Aborted testruns, because the tested engine was too weak to enter the UHO-Top15 Ratinglist:

Minic 3.40, Stormphrax 4.1.0, Booot 7.3, Black Marlin 9.0, Equisetum 1.0


Below you find a diagram of the progress of Stockfish in my tests since February 2023

And below that diagram, the older diagrams.

 

You can save the diagrams on your PC with mouseclick (right button) and then choose "save image"...







Sie sind Besucher Nr.