Stefan Pohl Computer Chess

private website for chessengine-tests


Long thinking-time tournament (with LC Zero CUDA)

 

Playing conditions:

 

Hardware: i7-6700HQ (2.6 GHz) Notebook (Quadcore), Windows 10 64bit, 12GB RAM

Fritzmark: singlecore: 5.3 / 2521 (all AB-engines running on one core, only)

GPU (used by LC Zero): Nvidia Cuda Gforce GTX 950M (4GB memory, grafics: 914 MHz, memory: 1.25 GHz). LC Zero CUDA calculates around 1020 rollouts/s in the starting position (measured with "go infinte"-command until depth 28) with Netsize 20x256

Leela-Ratio: 0.67 for my tournament (opponent engines running singlethread)(what is it? look here) (The Ratio-value of AlphaZero in the match vs. Stockfish 8 was 1.0, and the Ratio-value in TCEC is around 0.35) so a value of 0.67 is very close (and between) to both tournaments.  Better GPUs (like GTX 1080) have much higer Ratio-Values (6 or higher), which means a huge advantage for Leela, when playing vs. other engines and that leads to distorted results (Leela seems to be stronger, than it is).)

Hash: 2 GB per engine

GUI: Fritz 16 GUI (no draw, no resign)

Tablebases: 3-6 Syzygy for GUI (GUI ends all games, when only 6 pieces remain on the chessboard)

Openings: Drawkiller tournament Book. Download it here

Large Memory Pages: Off

Ponder: ON (because the AB-engines are running on one core, only and Leela on the GPU, pondering is no waste of resources here in this tournament)

Thinking time: 15'+5'' per game/engine (average game-duration: 40', so around 35 games per day are played).

 

LC Zero Github (information, download Networks and LC Zero Engine): here

Read more about, how LC Zero works, in the LC0-Blog: here

 

 

Current participants: Stockfish 181120 (very close to Stockfish 10), Houdini 6, Komodo 12.2.2, Ethereal 11.12, Fire 7.1 and LC0 0.20.1 Net:32669 (LC0 playing a Gauntlet - more games for new LC0 in short time)

 

Latest update: 2019/01/16 - download all 1595 played games here

 

Take a look at the unbelievable low draw-rates around 30%... With a classical opening-book, you will get draw-rates over 60%-65% with 15'+5'' timecontrol in such a top-engine tournament!!! Learn more about my Drawkiller-openings in the "Drawkiller openings"-section of this website and download them for free!

 

     Program                       Elo    +    -   Games   Score   Av.Op.  Draws

   1 Stockfish 201118 64 BMI2    : 3499   28   28   343    76.4 %   3261   30.3 %
   2 Lc0 v0.20.1 N:32463         : 3410   30   30   235    63.4 %   3289   30.6 %
   3 Houdini 6 x64-pext          : 3400   25   25   343    63.1 %   3282   31.8 %
   4 Komodo 12.2.2 64-bit        : 3361   24   24   343    57.6 %   3290   32.9 %
   5 Ethereal 11.12 (PEXT)       : 3133   29   29   343    26.4 %   3340   25.4 %
   6 Fire 7.1 x64 popcnt         : 3054   30   30   343    17.3 %   3357   21.9 %

 


All played games:

 

     Program                       Elo    +    -   Games   Score   Av.Op.  Draws

   1 Stockfish 201118 64 BMI2    : 3486   23   23   467    72.2 %   3299   32.5 %
   2 Lc0 v0.20.1 N:32463         : 3412   31   31   235    63.4 %   3297   30.6 %
   3 Houdini 6 x64-pext          : 3400   22   22   467    60.3 %   3313   31.5 %
   4 Lc0 v0.19.0 N:11250         : 3380   26   26   370    59.7 %   3297   35.7 %
   5 Lc0 v0.20.0-rc2 N:32295     : 3368   30   30   250    58.2 %   3297   32.4 %
   6 Komodo 12.2.2 64-bit        : 3354   21   21   467    53.6 %   3320   34.5 %
   7 Ethereal 11.12 (PEXT)       : 3155   23   23   467    26.2 %   3352   27.6 %
   8 Fire 7.1 x64 popcnt         : 3090   26   26   467    18.8 %   3362   24.0 %

 

 

Games        : 1595 (finished)

White Wins   : 700 (43.9 %)
Black Wins   : 402 (25.2 %)
Draws        : 493 (30.9 %)
Unfinished   : 0

White Score  : 59.3 %
Black Score  : 40.7 %

 

Individual statistics:

 

1 Stockfish 201118 64 BMI2 : 3486 467 (+261,=152,- 54), 72.2 %

Lc0 v0.20.1 N:32463        : 47 (+ 18,= 19,- 10), 58.5 %
Lc0 v0.20.0-rc2 N:32295    : 50 (+ 23,= 19,-  8), 65.0 %
Ethereal 11.12 (PEXT)      : 74 (+ 58,= 15,-  1), 88.5 %
Fire 7.1 x64 popcnt        : 74 (+ 66,=  8,-  0), 94.6 %
Lc0 v0.19.0 N:11250        : 74 (+ 28,= 29,- 17), 57.4 %
Komodo 12.2.2 64-bit       : 74 (+ 36,= 28,- 10), 67.6 %
Houdini 6 x64-pext         : 74 (+ 32,= 34,-  8), 66.2 %

 

2 Lc0 v0.20.1 N:32463      : 3412 235 (+113,= 72,- 50), 63.4 %

Ethereal 11.12 (PEXT)      : 47 (+ 32,= 14,-  1), 83.0 %
Fire 7.1 x64 popcnt        : 47 (+ 35,=  8,-  4), 83.0 %
Komodo 12.2.2 64-bit       : 47 (+ 16,= 19,- 12), 54.3 %
Stockfish 201118 64 BMI2   : 47 (+ 10,= 19,- 18), 41.5 %
Houdini 6 x64-pext         : 47 (+ 20,= 12,- 15), 55.3 %

 

3 Houdini 6 x64-pext       : 3400 467 (+208,=147,-112), 60.3 %

Lc0 v0.20.1 N:32463        : 47 (+ 15,= 12,- 20), 44.7 %
Lc0 v0.20.0-rc2 N:32295    : 50 (+ 21,= 14,- 15), 56.0 %
Ethereal 11.12 (PEXT)      : 74 (+ 55,= 14,-  5), 83.8 %
Fire 7.1 x64 popcnt        : 74 (+ 58,= 16,-  0), 89.2 %
Lc0 v0.19.0 N:11250        : 74 (+ 25,= 24,- 25), 50.0 %
Komodo 12.2.2 64-bit       : 74 (+ 26,= 33,- 15), 57.4 %
Stockfish 201118 64 BMI2   : 74 (+  8,= 34,- 32), 33.8 %

 

4 Lc0 v0.19.0 N:11250      : 3380 370 (+155,=132,- 83), 59.7 %

Ethereal 11.12 (PEXT)      : 74 (+ 42,= 25,-  7), 73.6 %
Fire 7.1 x64 popcnt        : 74 (+ 46,= 22,-  6), 77.0 %
Komodo 12.2.2 64-bit       : 74 (+ 25,= 32,- 17), 55.4 %
Stockfish 201118 64 BMI2   : 74 (+ 17,= 29,- 28), 42.6 %
Houdini 6 x64-pext         : 74 (+ 25,= 24,- 25), 50.0 %

 

5 Lc0 v0.20.0-rc2 N:32295  : 3368 250 (+105,= 81,- 64), 58.2 %

Ethereal 11.12 (PEXT)      : 50 (+ 29,= 17,-  4), 75.0 %
Fire 7.1 x64 popcnt        : 50 (+ 31,= 15,-  4), 77.0 %
Komodo 12.2.2 64-bit       : 50 (+ 22,= 16,- 12), 60.0 %
Stockfish 201118 64 BMI2   : 50 (+  8,= 19,- 23), 35.0 %
Houdini 6 x64-pext         : 50 (+ 15,= 14,- 21), 44.0 %

 

6 Komodo 12.2.2 64-bit     : 3354 467 (+170,=161,-136), 53.6 %

Lc0 v0.20.1 N:32463        : 47 (+ 12,= 19,- 16), 45.7 %
Lc0 v0.20.0-rc2 N:32295    : 50 (+ 12,= 16,- 22), 40.0 %
Ethereal 11.12 (PEXT)      : 74 (+ 47,= 17,- 10), 75.0 %
Fire 7.1 x64 popcnt        : 74 (+ 57,= 16,-  1), 87.8 %
Lc0 v0.19.0 N:11250        : 74 (+ 17,= 32,- 25), 44.6 %
Stockfish 201118 64 BMI2   : 74 (+ 10,= 28,- 36), 32.4 %
Houdini 6 x64-pext         : 74 (+ 15,= 33,- 26), 42.6 %

 

7 Ethereal 11.12 (PEXT)    : 3155 467 (+ 58,=129,-280), 26.2 %

Lc0 v0.20.1 N:32463        : 47 (+  1,= 14,- 32), 17.0 %
Lc0 v0.20.0-rc2 N:32295    : 50 (+  4,= 17,- 29), 25.0 %
Fire 7.1 x64 popcnt        : 74 (+ 30,= 27,- 17), 58.8 %
Lc0 v0.19.0 N:11250        : 74 (+  7,= 25,- 42), 26.4 %
Komodo 12.2.2 64-bit       : 74 (+ 10,= 17,- 47), 25.0 %
Stockfish 201118 64 BMI2   : 74 (+  1,= 15,- 58), 11.5 %
Houdini 6 x64-pext         : 74 (+  5,= 14,- 55), 16.2 %

 

8 Fire 7.1 x64 popcnt      : 3090 467 (+ 32,=112,-323), 18.8 %

Lc0 v0.20.1 N:32463        : 47 (+  4,=  8,- 35), 17.0 %
Lc0 v0.20.0-rc2 N:32295    : 50 (+  4,= 15,- 31), 23.0 %
Ethereal 11.12 (PEXT)      : 74 (+ 17,= 27,- 30), 41.2 %
Lc0 v0.19.0 N:11250        : 74 (+  6,= 22,- 46), 23.0 %
Komodo 12.2.2 64-bit       : 74 (+  1,= 16,- 57), 12.2 %
Stockfish 201118 64 BMI2   : 74 (+  0,=  8,- 66),  5.4 %
Houdini 6 x64-pext         : 74 (+  0,= 16,- 58), 10.8 %