Stefan Pohl Computer Chess

private website for chessengine-tests


Latest Website-News (2019/04/22): Testrun of Lc0 Net 41978 finished. -6 Elo to Net 41800. Check out the result in the "Lc0 / NN testing"- section. Next testrun: Lc0 with 41800 Boost Network by D.Kappe (Net was boosted with CCRL engine-games). Will be interesting to comapre the result with the testrun of the regular 41800 Net, which I did before...

Testrun of the new BrainFish-2 190310, using 2 Cerebellums (one calculated by Leela, the other calculated by Stockfish) finished. +8 Elo to BrainFish 190310 (Stockfish-Cerebellum, only) and +39 Elo to Stockfish 190310.

Find more information and the download of BrainFish-2 on Thomas Zipproth's website - just click here

Next testrun: Stockfish 190420. Result not before next Sunday.

 

My Drawkiller Openings Project is finished. Never before any openings-set gave such low draw-rates without crunching the scores of the engines towards 50%, but instead pushing the scores away from 50%. The Drawkiller Normal- and Tournament sets nearly halve the draw-rate, compared to FEOBOS or the Stockfish Framework 8-move openings. I would never have expected, that this was possible – the Drawkiller project is really a breakthrough into another dimension of Computerchess. Learn more about Drawkiller openings in the "Drawkiller openings"- section on this website and download them here

 

Stay tuned.

 


Stockfish testing

 

Playing conditions:

 

Hardware: i7-6700HQ 2.6GHz Notebook (Skylake CPU), Windows 10 64bit, 8GB RAM

Fritzmark: singlecore: 5.3 / 2521 (all engines running on one core, only), average meganodes/s displayed by LittleBlitzerGUI: Houdini: 2.6 mn/s, Stockfish: 2.2 mn/s, Komodo: 2.0 mn/s

Hash: 512MB per engine

GUI: LittleBlitzerGUI (draw at 130 moves, resign at 400cp (for 4 moves))

Tablebases: None

Openings: HERT testset (by Thomas Zipproth) (download the file at the "Download & Links"-section or here)(I use a version of HERT, where the positions in the file are ordered in a different way - makes no difference for testing-results, dont be confused, when you download my gamebase-file and the game-sequence doesnt match with the sequence of your HERT-set...)

Ponder, Large Memory Pages & learning: Off

Thinking time: 180''+1000ms (= 3'+1'') per game/engine (average game-duration: around  7.5 minutes). One 5000 games-testrun takes about 7 days.The version-numbers of the Stockfish engines are the date of the latest patch, which was included in the Stockfish sourcecode, not the release-date of the engine-file, written backwards (year,month,day))(example: 170526 = May, 26, 2017). Since July, 2018 I use the abrok-compiles of Stockfish again (http://abrok.eu/stockfish), because they are now much faster than before - now only 1.3% slower than BrainFish-compiles. So, there is no reason anymore to not use these "official" development-compiles.

Download BrainFish (and the Cerebellum-Library): here

 

Each Stockfish-version plays 1000 games versus Komodo 12.3, Houdini 6, Fire 7.1, Ethereal 11.25, Komodo 12.3 MCTS. All engines are running with default-settings, except: Move Overhead is set to 300ms, if an engine allows to do so.

To avoid distortions in the Ordo Elo-calculation, from now, only 2x Stockfish (latest official release + the latest version) and 1x asmFish and 1x Brainfish are stored in the gamebase (all older engine-versions games will be deleted, every time, when a new version was tested). Stockfish, asmFish and BrainFish older Elo-results can still be seen in the Elo-diagrams below. BrainFish plays always with the latest Cerebellum-Library of course, because otherwise BrainFish = Stockfish.

 

Latest update: 2019/04/21: BrainFish-2 190310 (2 Cerebellums (Leela & Stockfish))

 

(Ordo-calculation fixed to Stockfish 10 = 3508 Elo)

 

See the individual statistics of engine-results here

See the ORDO-rating of the archive-gamebase since 2019 here

Download the current gamebase here

Download the archive-gamebase since 2019 here

 

     Program                      Elo    +    -   Games   Score   Av.Op.  Draws

   1 BrainFish-2 190310 bmi2    : 3576    9    9  5000    80.1 %   3323   36.3 % (new)
   2 Stockfish 190331 bmi2      : 3529    8    8  5000    75.6 %   3323   40.9 %
   3 Stockfish 10 181129        : 3508    6    6 10000    77.4 %   3280   38.4 %
   4 Stockfish 9 180201         : 3455    7    7  6000    71.9 %   3278   44.5 %
   5 Houdini 6 pext             : 3429    4    4 15000    63.4 %   3321   47.9 %
   6 Komodo 12.3 bmi2           : 3395    5    5 10000    56.7 %   3343   48.9 %
   7 Komodo 12 bmi2             : 3394    6    6  8000    60.5 %   3312   51.2 %
   8 Fire 7.1 popc              : 3281    4    4 15000    44.1 %   3331   50.1 %
   9 Komodo 12.3 MCTS           : 3257    5    5 11000    37.5 %   3360   43.5 %
  10 Ethereal 11.25 pext        : 3255    6    6  9000    34.8 %   3380   46.2 %
  11 Xiphos 0.5 bmi2            : 3244    7    7  6000    35.8 %   3354   47.2 %
  12 Laser 1.7 bmi2             : 3202    7    7  6000    30.8 %   3354   45.6 %
  13 Fizbo 2 bmi2               : 3195    7    7  6000    34.0 %   3322   38.5 %
  14 Shredder 13 x64            : 3192    7    7  7000    30.8 %   3349   42.3 %
  15 Booot 6.3.1 popc           : 3181    7    7  6000    32.1 %   3324   42.9 %
  16 Andscacs 0.95 popc         : 3150    8    8  5000    23.1 %   3374   35.3 %

The version-numbers (180622 for example) of the engines are the date of the latest patch, which was included in the Stockfish sourcecode, not the release-date of the engine-file. Especially the asmFish-engines are often released much later!!

Below you find a diagram of the progress of Stockfish in my tests since the end of 2018

And below that diagram, the older diagrams.

 

You can save the diagrams (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"...

The Elo-ratings of older Stockfish dev-versions in the Ordo-calculation can be a little different to the Elo-"dots" in the diagram, because the results/games of new Stockfish dev-versions - when getting part of the Ordo-calculation - can change the Elo-ratings of the opponent engines and that can change the Elo-ratings of older Stockfish dev-versions (in the Ordo-calculation / ratinglist, but not in the diagram, where all Elo-"dots" are the rating of one Stockfish dev-version at the moment, when the testrun of that Stockfish dev-version was finished).

 

 

 


Sie sind Besucher Nr.