Stefan Pohl Computer Chess

Home of famous UHO openings and EAS Ratinglist


Latest Website-News (2024/03/19): NN-testrun of Lc0 0.31dev BT4-6315000 finished: See the result and download the games on NN vs SF 15.1 testing

 

Dont forget to take a look at my EAS-Ratinglist (The world's first engine-ratinglist not measuring strength of engines, but engines's style of play).

 

Next testrun: Stockfish 240314

 

Stay tuned


UHO-Top15 Engines Ratinglist (+ regular testing of Stockfish Dev-versions)

 

Playing conditions:

 

The 15 strongest engines and the latest StockfishDev version are playing 1000 games vs. each opponent: 15000 games per engine are played. A RoundRobin Tournament with 120000 games overall !

 

Hardware: AMD Ryzen 3900 12-core (24 threads) notebook with 32GB RAM. 

Speed: (singlethread, TurboBoost-mode switched off, chess starting position) Stockfish 16.1: 500 kn/s (when 20 games are running simultaneously)

Hash: 256MB per engine

GUI: Cutechess-cli (GUI ends game, when a 5-piece endgame is on the board, all other games are played until mate or draw by chess-rules (3fold, 50-moves, stalemate, insufficent material))

Tablebases: None for engines, 5 Syzygy for cutechess-cli

OpeningsMy UHO_2022_6mvs_+120_+129 openings are used (first 500 lines) (part of my UHO 2022 download). 

Ponder, Large Memory Pages & learning: Off

Thinking time: 3min+1sec per game/engine (average game-duration: 7 min 50sec), around 3500-4000 games in 24 hours are played. One testrun (15000 games) takes around 100 hours (=4 days and some hours)

The version-numbers of the Stockfish engines are the date of the latest patch, which was included in the Stockfish sourcecode, not the release-date of the engine-file, written backwards (year,month,day))(example: 200807 = August, 7, 2020). The used SF compile is the AVX2-compile, which is the fastest on my AMD Ryzen CPU. SF binaries are taken from https://github.com/official-stockfish/Stockfish/releases (except the official SF-release versions, which are taken form the official Stockfish website).

Read the explanation, why I chose my testing-conditions, like I did here

 

Latest update: 2024/03/16: Rebel 16.3 (+29 Elo to Rebel EAS)

 

(Ordo-calculation fixed to Stockfish 16.1 = 3833 Elo)

 

See the tournament cross-table as a picture (done by Fritz18 GUI) here

See the individual statistics of engine-results here

See the Engines Aggressiveness Score Ratinglist here

See the Gamepair-statistics of the UHO-Top15 Ratinglist here

See the full UHO Ratinglist (with EAS-Ratinglist): here

Download the current gamebase, the full-list gamebase and the archive here

See the old SPCC-Ratinglist (full list) and EAS-List from 2020 until 2023/08/28: here

 

(best Stockfish Elo so far: Stockfish 240307: 3836 Elo, latest full release (Stockfish 16.1) had 3833 Elo)

(Read the explanation of the Lc0-entry in the Ratinglist here).

     Program                    Elo    +    -  Games    Score   Av.Op. Draws

   1 Stockfish 240307 avx2    : 3836    4    4 15000    72.2%   3661   47.1%
   2 Stockfish 16.1 240224    : 3833    4    4 15000    71.9%   3662   47.0%
  [  Lc0 0.31dev T3-2815      : 3785   15   15  1000 (NN vs SF15.1 testing)]
   3 Torch 1 popavx2          : 3782    4    4 15000    65.4%   3665   47.9%
   4 KomodoDragon 3.3 avx2    : 3747    4    4 15000    60.8%   3667   49.0%
   5 Berserk 12 avx2          : 3723    4    4 15000    57.4%   3669   49.1%
   6 Caissa 1.17 avx2         : 3673    4    4 15000    50.2%   3672   50.4%
   7 RubiChess 240112 avx2    : 3666    4    4 15000    49.3%   3673   48.9%
   8 Ethereal 14.25 nnue      : 3665    4    4 15000    49.1%   3673   50.6%
   9 Obsidian 11.0 avx2       : 3661    4    4 15000    48.5%   3673   50.0%
  10 Seer 2.8.0 avx2          : 3620    4    4 15000    42.7%   3676   49.9%
  11 CSTal 2.0 avx2           : 3607    4    4 15000    40.8%   3677   50.6%
  12 Rebel 16.3 avx2          : 3605    4    4 15000    40.6%   3677   49.3%
  13 Clover 6.1 avx2          : 3597    4    4 15000    39.5%   3677   50.6%
  14 Koivisto 9.2 avx2        : 3591    4    4 15000    38.6%   3678   49.5%
  15 Alexandria 6.0 avx2      : 3585    4    4 15000    37.8%   3678   48.6%
  16 RofChade 3.1 avx2        : 3566    4    4 15000    35.3%   3679   48.1%


Games        : 120000 (finished)

White Wins   : 58030 (48.4 %)
Black Wins   : 2981 (2.5 %)
Draws        : 58989 (49.2 %)


Below the UHO-Top15 Ratinglist, recalculated with Gamepairs (using my Gamepair Rescoring Tool V1.5), realizing Vondele's (Stockfish Maintainer) idea: "Thinking uniquely in game pairs makes sense with the biased openings used these days. While pentanomial makes  sense it is a bit complicated so we could simplify and score game pairs only (not games) as W-L-D (a traditional score of 2-0, or 1.5-0.5 is just a W)."

See the head-to-head gamepair-statistics of the UHO-Top15 Ratinglist here

   # PLAYER                   :  RATING  ERROR  PLAYED     W     D     L   (%)  CFS(%)
   1 Stockfish 240307 avx2    :    3848     14    7500  6379   990   131  91.7      98
   2 Stockfish 16.1 240224    :    3833   ----    7500  6309  1030   161  91.0     100
   3 Torch 1 popavx2          :    3630     13    7500  5062  1709   729  78.9     100
   4 KomodoDragon 3.3 avx2    :    3524     14    7500  4231  2073  1196  70.2     100
   5 Berserk 12 avx2          :    3452     14    7500  3606  2304  1590  63.4     100
   6 Caissa 1.17 avx2         :    3331     14    7500  2424  2709  2367  50.4      97
   7 RubiChess 240112 avx2    :    3323     13    7500  2330  2752  2418  49.4      98
   8 Ethereal 14.25 nnue      :    3313     13    7500  2291  2669  2540  48.3      99
   9 Obsidian 11.0 avx2       :    3303     14    7500  2184  2708  2608  47.2     100
  10 Seer 2.8.0 avx2          :    3208     13    7500  1341  2749  3410  36.2     100
  11 CSTal 2.0 avx2           :    3174     14    7500  1112  2618  3770  32.3      51
  12 Rebel 16.3 avx2          :    3173     13    7500  1124  2593  3783  32.3     100
  13 Clover 6.1 avx2          :    3147     14    7500   946  2508  4046  29.3      99
  14 Koivisto 9.2 avx2        :    3135     14    7500   882  2450  4168  28.1      53
  15 Alexandria 6.0 avx2      :    3135     14    7500   837  2534  4129  28.1     100
  16 RofChade 3.1 avx2        :    3088     14    7500   594  2300  4606  23.3     ---


------------------------------------------------------------------- 
--- Number of all Gamepairs          : 60000 
--- Number of drawn Gamepairs overall: 18348 (= 30.58%) 
--- Number of 1:1 drawn Gamepairs    : 8558  (= 14.26%) 
--- Number of 2-draws drawn Gamepairs: 9790  (= 16.32%) 
------------------------------------------------------------------- 


Aborted testruns, because the tested engine was too weak to enter the UHO-Top15 Ratinglist:

Minic 3.40, Stormphrax 4.1.0, Booot 7.3, Black Marlin 9.0, Equisetum 1.0


Below you find a diagram of the progress of Stockfish in my tests since February 2023

And below that diagram, the older diagrams.

 

You can save the diagrams on your PC with mouseclick (right button) and then choose "save image"...







Sie sind Besucher Nr.