Stefan Pohl Computer Chess

Latest Website-News (2018/05/15): Testrun of Stockfish 180506 finished. Nice progress. Now +19 Elo to Stockfish 9. Next testrun: Komodo 12. Result not before next Wednesday.

From now, the long thinking-time tournament is for testing of LC Zero. LC Zero 180519 (CUDA) Net 322 plays a gauntlet vs. 5 opponents: Demolito 180301 (Elo 2802), Amoeba 2.8 (Elo 2802), Bobcat 8 (Elo 2813),  Wasp 3 (Elo 2861), Ethereal 9 (Elo 2880). Average opponent CEGT Elo (40moves/20'): 2832

Testing of LC Zero is not easy. Because it uses the GPU for its thinking, it is not possible to run more than one game simultaneously on one PC. So, I decided to use the long thinking-time tournament (with higher speed of 10'+5'' (for more games)) for testing LC Zero...

My new SALC V5 openings and books are ready for download. Check out the "SALC openings"-section on this website for further information. Download SALC V5.02 here

Stay tuned.

Stockfish testing

Playing conditions:

Hardware: i7-6700HQ 2.6GHz Notebook (Skylake CPU), Windows 10 64bit, 8GB RAM

Fritzmark: singlecore: 5.3 / 2521 (all engines running on one core, only), average meganodes/s displayed by LittleBlitzerGUI: Houdini: 2.6 mn/s, Stockfish: 2.2 mn/s, Komodo: 2.0 mn/s

Hash: 512MB per engine

GUI: LittleBlitzerGUI (draw at 130 moves, resign at 400cp (for 4 moves))

Tablebases: None

Openings: HERT testset (by Thomas Zipproth) (download the file at the "Download & Links"-section or here)(I use a version of HERT, where the positions in the file are ordered in a different way - makes no difference for testing-results, dont be confused, when you download my gamebase-file and the game-sequence doesnt match with the sequence of your HERT-set...)

Ponder, Large Memory Pages & learning: Off

Thinking time: 180''+1000ms (= 3'+1'') per game/engine (average game-duration: around  7.5 minutes). One 5000 games-testrun takes about 7 days.The version-numbers of the Stockfish-development engines are the release-date, written backwards (year,month,day))(example: 170526 = May, 26, 2017). I use BrainFish-compiles (bmi2) by Thomas Zipproth (without using the Cerebellum-Library, BrainFish is identical to Stockfish and BrainFish-compiles are the fastest compiles of the Stockfish C++ code at the moment, around +10% faster than the abrok.eu-compiles and around 4% faster than the ultimaiq-compiles).

Download BrainFish (and the Cerebellum-Library): here

Each Stockfish-version plays 1000 games versus Komodo 11.3.1, Houdini 6, Fire 6.1, Shredder 13, Fizbo 2. All engines are running with default-settings, except: Move Overhead is set to 300ms, if an engine allows to do so.

To avoid distortions in the Ordo Elo-calculation, from now, only 2x Stockfish (latest official release + the latest version) and 1x asmFish and 1x Brainfish are stored in the gamebase (all older engine-versions games will be deleted, every time, when a new version was tested). Stockfish, asmFish and BrainFish older Elo-results can still be seen in the Elo-diagrams below. BrainFish plays always with the latest Cerebellum-Library of course, because otherwise BrainFish = Stockfish.

Latest update: 2018/05/15: Stockfish 180506

(Ordo-calculation fixed to Stockfish 9 = 3450 Elo)

See the individual statistics of engine-results here

Download the current gamebase here

Download the archive (all played games with HERT (180000 games)) here

See a ORDO-rating of the complete HERT-archive-base here

     Program                    Elo    +    -   Games   Score   Av.Op.  Draws

   1 asmBrainFish 9           : 3519    8    8  5000    77.7 %   3284   37.9 %
   2 BrainFish 180423 bmi2    : 3504    8    8  5000    76.2 %   3284   42.2 %
   3 asmFish 9 bmi2           : 3470    7    7  5000    72.8 %   3284   43.3 %
   4 Stockfish 180506 bmi2    : 3469    7    7  5000    72.7 %   3284   44.9 % (new)
   5 Stockfish 9 180201       : 3450    7    7  5000    70.6 %   3284   45.6 %
   6 Houdini 6 pext           : 3426    5    5  9000    55.6 %   3379   54.5 %
   7 Komodo 11.3.1 bmi2       : 3392    5    5  9000    50.7 %   3382   53.6 %
   8 Fire 6.1 popc            : 3208    5    5  9000    26.5 %   3403   38.6 %
   9 Fizbo 2 bmi2             : 3202    6    6  9000    25.8 %   3403   34.0 %
  10 Shredder 13 x64          : 3193    6    6  9000    24.7 %   3404   37.5 %

The 4 different Fishes in this Elo-list:

- Stockfish

- asmFish = Stockfish manually rewritten in assembler (look here)

- BrainFish = Stockfish playing with Cerebellum-Library by Thomas Zipproth (look here)

- asmBrainFish = asmFish playing with Cerebellum-Library

Below you find a diagram of the progress of Stockfish in my tests since the end of 2016. 

And below that diagram, the older diagrams.

You can save the diagrams (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"...

The Elo-ratings of older Stockfish dev-versions in the Ordo-calculation can be a little different to the Elo-"dots" in the diagram, because the results/games of new Stockfish dev-versions - when getting part of the Ordo-calculation - can change the Elo-ratings of the opponent engines and that can change the Elo-ratings of older Stockfish dev-versions (in the Ordo-calculation / ratinglist, but not in the diagram, where all Elo-"dots" are the rating of one Stockfish dev-version at the moment, when the testrun of that Stockfish dev-version was finished).