Stefan Pohl Computer Chessprivate website for chessengine-testsLC0 / Neural Nets versus Stockfish testing
Playing conditions:
Hardware: i7-8750H 2.6GHz (Hexacore) Notebook, RTX 2060 GPU, Windows 10 64bit, 16GB RAM Speed: Stockfish (running on 11 hyperthreading-threads, Intel Turbo-Mode off): 9000 kn/s, Lc0 (with old 32930 20x256 net): 16000 n/s in starting position. Since Lc0 0.26.3, Lc0 uses Cuda 11.1, which makes it around +37% faster. To keep the Leela-Ratio on 1.0, I slowed down the GPU with the Afterburner-Tool. Hash / NN Cache: 4096 GB Hash for Stockfish / 5000000 NN-Cachesize for Lc0 GUI: Cutechess-cli (GUI ends game, when a 5-piece endgame is on the board) Tablebases: None for engines, 5 Syzygy for cutechess-cli Openings: Unbalanced Human Openings V3 6moves with eval [+0.90;+0.99]. Learn more in the "Anti Draw Openings"- section. Ponder, Large Memory Pages & learning: Off Thinking time: Lc0 2'+1'' and Stockfish 3'+1.5'' (means a perfect Leela-Ratio of 1.0). Average game-duration: 8 minutes, one 750 games-testrun takes around 4 days.
Each Lc0 / Neural Net plays 750 games vs. Stockfish 13 with my new Unbalanced Human Openings V3
Learn more about Lc0 (getting started in a GUI, links to net-downloads, FAQs, development-informations and the Leela-Blog) here
Latest update: 2021/06/23: Lc0 0.27.0 744204
Download all played games (games of the old test-setup, too): here The results of the old test-setup can be seen here Program Elo + - Games Score Av.Op. Draws 1 Stockfish 13 bmi2 : 3723 5 5 8250 67.2 % 3595 50.3 %
White Wins : 3864 (46.8 %)
Mention, that this is not a ratinglist, but only a performance test of Lc0 with different NNs versus Stockfish. Because Lc0 vs. Stockfish is definitly the most interesting head-to-head competition of NN vs. AB-engines. For a real ratinglist including Lc0 running on a RTX-GPU (with a valid Leela-Ratio of 1.0), please visit Andreas Strangmueller's excellent website. Just click here
Stockfish vs Lc0 longtime testing ("SuFi for the poor")
Each testrun 300 games with 150 Noomen lowdraw-openings (selected openings from TCEC superfinals) and 5'+3'' thinking-time (Lc0) / 7.5'+4.5'' (Stockfish). This thinking-time gives a perfect Leela-Ratio of 1.0 on the used PC hardware: i7-8750H 2.6GHz (Hexacore, TurboBoost mode off) Notebook, RTX 2060 GPU. Average game-duration: 20 minutes. Stockfish (running on 11 hyperthreading-threads, Intel Turbo-Mode off) 9000 kn/s, Lc0 (with old 32930 20x256 net) on RTX 2060 mobile: 16000 n/s in starting position. Hash / NN Cache: 4096 GB Hash for Stockfish / 10000000 NN-Cachesize for Lc0 GUI: Cutechess-cli (GUI ends game, when a 5-piece endgame is on the board) Tablebases: None for engines, 5 Syzygy for cutechess-cli Openings: 150 Noomen lowdraws openings (J. Noomen selected non-drawish openings out of his TCEC superfinal openings of previous TCEC seasons). Download here Ponder, Large Memory Pages & learning: Off Thinking time: Lc0 5'+3'' and Stockfish 7.5'+4.5'' (means a perfect Leela-Ratio of 1.0). Average game-duration: 20 minutes.
Download all played games here
Latest update: 2021/04/28 Stockfish 210415 vs Lc0 0.27.0 68695 See some short and spectacular wins of this match directly here on the website in the "View SF vs Lc0 games"- section! Stockfish 210415 bmi2 vs Lc0 0.27.0 68695 : 300 (+ 62,=218,- 20), 57.0 % (+49 Elo)
|