Beruflich Dokumente
Kultur Dokumente
10^1 [10 S]
Resources 1 1 1 **LcZero ID 5 Long Time Control Tests Complete (15+2) : 3 EL
2 2 2 https://docs.google.com/spreadsheets/d/1ZAIuHR6n-5JTxKQc0
Leela Chess Zero Website: L.e.e.l.a Shortened Google URL 3 3 3
http://lczero.org/ goo.gl/hGJ4Jf 4 4 4 **LcZero ID 5 Short Time Control Tests Complete (1+1) : 3 ELO
5 5 5 https://docs.google.com/spreadsheets/d/1ZAIuHR6n-5JTxKQc0
Deepmind's AlphaZero Paper: Perfect 2017 + Balsa Opening Books 6 6 6 Latest Update:
https://arxiv.org/pdf/1712.01815.pdf https://sites.google.com/site/computerschess/balsa-opening-test-suite 7 7 7 Leela ID 452 LTC
8 8 8
Spcc Stockfish Testing: 9 9 9 Next Test:
https://www.sp-cc.de/ 10 10 10 Leela ID 4?? STC
11 11 11
Stockfish Website: 12 12 12
https://stockfishchess.org/ 13 13 13
14 14 14
Ipman Chess Stockfish Testing: 15 15 15
http://www.ipmanchess.yolasite.com/ 16 16 16
17 17 17
CCRL 18 18 18
http://www.computerchess.org.uk/ccrl/4040/ 19 19 19
20 20 * If you have any suggestions or test requests please
20
Fishtest: 21 21 leave a comment 21
http://tests.stockfishchess.org/tests?success_only=1 22 22 Hardware and Settings: 22
23 23 CPU i7 7700k Important notes: 23
Other Leela Rating List Links: Useful Links 24 24 GPU (For Leela) GTX 1080 ti I am unable to test Stockfish Scaling due to my
24
LCZ rating list (CCRL Estimate) Hash Formula (T x S / 100) MB 25 25 Hash Data 1 GB Hardware limitations. Sorry! 25
Leela Chess Zero BrainFish Link 26 26 Book Perfect 2017 I need a minimum of 16 GB Ram on my PC 26
Leela Chess Zero vs Stockfish 9 27 27 Time Control 1+1 in order to test it properly at 10+ Billion Nodes27
LCZero Benchmarks 28 28 28
LC0 Elo Estimates Summary 29 29 Key: 29
500 Elo Barrier (Versions of Stockfish and Elo) 30 30 Leela Latest Update Latest Update: 30
31 31 Leela Next Test Leela ID 468 31
32 32 Leela 32
33 33 Leela Test Networks Next Test: 33
34 34 Stockfish/Variants Leela ID 10036 20x256 Net 34
35 35 Stockfish Theoretical 35
36 36 AlphaZero 44 Million Games 36
37 37 37
38 38 Notes: 38
39 39 -Going by the expression "Doubling hardware adds +50 ELO to an engine" Stockfish 8 64 threads ELO39
40 40 should be +150 ELO to an 8 thread CPU Stockfish. 40
41 41 -NOTE this rating list does not factor in the handicaps for Stockfish in the AlphaZero games. 41
42 42 -Lc0 CUDA is now used. 42
43 43 -Lc0 is tested against the version of SF closest to its strength with exceptions due to regression.
43
44 44 44
45 45 Interesting Notes: 45
46 46 6x64 Network Speeds: 86,000 Nodes Per Second 46
47 47 10x128 Network Speeds: 38,000 Nodes Per Second 47
48 48 15x192 Network Speeds: 16,000 Nodes Per Second 48
49 49 20x256 Network Speeds: 7,000 Nodes Per Second 49
50 50 50
51 51 51
52 52 52
53 53 53
54 54 54
55 55 55
56 56 56
57 57 57
58 58 58
https://goo.gl/71pnYs 13 AlphaZero TITAN V [7] 3593 3593 20k NPS 20x256?20k NPS 20x256? 59 59 59
60 60 60
61 61 61
62 62 62
63 63 63
64 64 64
65 65 65
66 66 66
67 67 67
68 68 68
69 69 69
70 70 70
71 71 71
72 72 72
73 73 73
74 74 74
75 75 75
76 76 76
77 77 77
78 78 78
79 79 79
80 80 80
81 81 81
82 82 82
83 83 83
84 84
85 85
86 86
87 87
88 88
89 89
90 90
91 91
92 92
93 93
94 94
95 95
96 96
97 97
98 98
99 99
100 100
101 101
102 102
103 103
104 104
105 105
106 106
107 107
108 108
109 109
110 110
111 111
112 112
113 113
114 114
115 115
116 116
117 117
118 118
119 119
120 120
121 121
122 122
123 123
124 124
125 125
126 126
127 127
128 128
129 129
130 130
131 131
132 132
133 133
134 134
135 135
136 136
137 137
138 138
139 139
140 140
141 141
142 142
143 143
144 144
145 145
146 146
147 147
148 148
149 149
150 150
151 151
152 152
153 153
154 154
155 155
156 156
157 157
158 158
159 159
160 160
161 161
162 162
163 163
164 164
165 165
166 166
167 167
168 168
169 169
170 170
171 171
No easteregg here https://www.strawpoll.me/16093545
Stockfish 9 Scaling By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) In Progress... This might take even longer than Lc0 Scaling
Currently in progress...
This might take even Stockfish 9 Nodes vs. Delta ELO
longer than Lc0 Scaling Nodes Log10(Nodes)=X
Elo Delta ELO Diff. Info. Notes
50,000 4.699 0 0 100 Games 50,000 vs. 50,000
Key: 100,000 5.000 263 263 100 Games 100,000 vs. 50,000
Stockfish Latest Update 200,000 5.301 454 191 100 Games 200,000 vs. 100,000
Stockfish 400,000 5.602 622 168 100 Games 400,000 vs. 200,000
800,000 5.903 818 196 100 Games 800k vs. 400k
1,600,000 6.204 100 Games
3,200,000 6.505 100 Games
6,400,000 6.806 100 Games
12,800,0007.107 100 Games
25,600,0007.408 100 Games (3 Seconds per Move)
51,200,0007.709 100 Games
102,400,000
8.010 100 Games
204,800,000
8.311 100 Games
409,600,000
8.612 100 Games
819,200,000
8.913 100 Games
1,638,400,000
9.214
3,276,800,000
9.515
6,553,600,000
9.816
13,107,200,000
10.118
26,214,400,000
10.419
52,428,800,000
10.720
104,857,600,000
11.021
Notes:
-3 GB of Hash Data per opponent
is all I can manage with my hardware.
These eastereggs are out of control Note to self- Add a link later
Leela vs. Stockfish Scaling By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) In Progress... This might take even longer than Lc0 Scaling MORE INFO. BELOW
Lc0 Nodes vs Delta ELO Stockfish Dev. August 18 Nodes vs. Delta ELO
Nodes Log [22]
10^x Seconds
Elo Delta
ELO Diff.
Elo 50k [23]
ELO Diff.Nodes Log [24] 10^x Seconds
Elo Delta ELO Diff. Elo 25M [25] ELO Diff.
1 0.000 0 0 1 0.000 0.00 0
2 0.301 139 139 2 0.301 1.92 1.92
4 0.602 156 17 4 0.602 6.52 4.60
8 0.903 191 35 8 0.903 14.56 8.04
16 1.204 322 131 16 1.204 35.52 20.96
25 1.398 469 147 25 1.398 64.55 29.03
50 1.699 662 193 50 1.699 109.71 45.16
100 2.000 824 162 100 2.000 152.22 42.51
200 2.301 967 143 200 2.301 192.13 39.91
400 2.602 1120 153 400 2.602 256.08 63.95
800 2.903 1218 98 800 2.903 385.03 128.95
1,600 3.204 1361 143 1,600 3.204 576.34 191.31
3,125 3.495 1488 127 3,125 3.495 807.79 231.45
6,250 3.796 1548 60 6,250 3.796 1,093.76 285.97
12,500 4.097 1637 89 12,500 4.097 1,380.21 286.45
25,000 4.398 1715 78 0 0 25,000 4.398 1,648.08 267.87
50,000 4.699 1764 49 49 49 50,000 4.699 1,903.09 255.01
100,000 5.000 1792 28 77 28 100,000 5.000 2,124.23 221.14
200,000 5.301 1823 31 108 31 200,000 5.301 2,309.11 184.88
400,000 5.602 1823 0 108 0 400,000 5.602 2,498.80 189.69
800,000 5.903 800,000 5.903 2,652.24 153.44
1,600,000 6.204 1,600,000 6.204 2,803.59 151.35
3,200,000 6.505 3,200,000 6.505
6,400,000 6.806 6,400,000 6.806
12,800,000 7.107 12,800,0007.107
25,600,000 7.408 25,600,0007.408 0 0
51,200,000 7.709 51,200,0007.709
102,400,0008.010
204,800,0008.311
409,600,0008.612
819,200,0008.913
1,638,400,000
9.214
3,276,800,000
9.515
6,553,600,000
9.816
13,107,200,000
10.118
26,214,400,000
10.419
52,428,800,000
10.720
104,857,600,000
11.021
These eastereggs are out of control Note to self- Add a link later
Leela Chess Zero Scaling 20x256 vs 15x192 By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) 15x192 Network ID 472 20x256 Network ID 10480 Nodes (SF) ELO Performance
Nodes Log10(Nodes)=X Elo Delta ELO Diff.Elo DeltaELO Diff. Nodes Log10(Nodes)=X Info. Notes 10M vs 100M -164 ELO so far.
1 0.000 0 0 0 0 1 0.000 200 Games 1 vs 1 20M vs 100M -156
2 0.301 53 53 139 139 2 0.301 200 Games 2 vs 1 40M vs 100M
4 0.602 67 14 156 17 4 0.602 200 Games 4 vs 2 80M vs 100M
8 0.903 100 33 191 35 8 0.903 200 Games 8 vs 4 100M vs 100M 0
16 1.204 172 72 322 131 16 1.204 200 Games 16 vs 8 160M vs 100M
25 1.398 347 175 469 147 25 1.398 200 Games 25 vs 16 320M vs 100M
50 1.699 533 186 662 193 50 1.699 200 Games 50 vs 25 640M vs 100M
100 2.000 736 203 824 162 100 2.000 200 Games 100 vs 50 1.28B vs 100M
200 2.301 920 184 967 143 200 2.301 200 Games 200 vs 100
400 2.602 1039 119 1120 153 400 2.602 200 Games 400 vs 200
800 2.903 1176 137 1218 98 800 2.903 200 Games 800 vs 400
1,600 3.204 1293 117 1361 143 1,600 3.204 200 Games 1,600 vs 800
3,125 3.495 1438 145 1488 127 3,125 3.495 200-100G 3,125 vs 1,600
6,250 3.796 1542 104 1548 60 6,250 3.796 100 Games 6,250 vs 3,125 Lc0 Nodes vs Delta
Lc0ELO
Nodes vs Delta ELO
12,500 4.097 1627 85 1637 89 12,500 4.097 100 Games 12,500 vs 6,250 15x192 Network20x256
ID 472 Network ID 10480Elo Delta ELO Diff.
25,000 4.398 1738 111 1715 78 25,000 4.398 100 Games 25,000 vs 12,500 0 0 0 0
50,000 4.699 1842 104 1764 49 50,000 4.699 100 Games 50k vs 25k 53 139 139 139
100,000 5.000 1912 70 1792 28 100,000 5.000 100 Games 100k vs 50k 67 156 156 17
200,000 5.301 1950 38 1823 31 200,000 5.301 100 Games 200k vs 50k-200k vs 100k 100 191 191 35
400,000 5.602 2015 65 1823 0 400,000 5.602 100 Games 400k vs 50k-400k vs 200k 172 322 322 131
800,000 5.903 2088 73 800,000 5.903 100-50G 800k vs 50k-800k vs 400k 347 469 469 147
1,600,000 6.204 2115 27 1,600,000 6.204 50 Games 1.6M vs 800k (1.6M vs 50k Results=Similar) 533 662 662 193
3,200,000 6.505 2151 36 3,200,000 6.505 50 Games 3.2M vs 800k 736 824 824 162
6,400,000 6.806 6,400,000 6.806 920 967 967 143
12,800,000 7.107 12,800,000 7.107 1039 1120 1120 153
25,600,000 7.408 25,600,000 7.408 1176 1218 1218 98
51,200,000 7.709 51,200,000 7.709 1293 1361
102,400,000 8.010 102,400,000 8.010 1438 1488
1542 1548
MORE INFO. BELOW Key: 1627 1637
Leela Latest Update 1738 1715
IMPORTANT NOTES: (Read me) Leela 1842 1764
-Lc0 CUDA ID 472 is used. 1912 1792
-Leela Nodes vs. Delta ELO is less accurate. Use the Information: 1950 1823
first chart to estimate ELO given x Nodes per Move. -Log10(x)=y is the same as 10^y=x 2015 1823
-All settings on Lc0 CUDA remain default. -I will likely include more games later 2088
-Interesting test: I found that the ELO difference b/w 2115
1.6M vs. 50k compared to 800k is the same as 1.6M vs. 2151
800k. (Currently around 35 ELO) This means that my
prior 50k test should be accurate!
-The Selfplay ELO coorelation to real ELO is not 1:1.
The relationship between Selfplay ELO and real ELO is
around 100:75. (MTGOstark's estimations)
Leela Scaling Scaling [20x256] By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) Lc0 Nodes vs Delta ELO Nodes (SF) ELO Performance
Nodes Log10(Nodes)=X Elo Delta ELO Diff.
Elo 50k [27]
ELO Diff. Info. Notes 10M vs 100M -164 ELO so far.
1 0.000 0 0 200 Games 1 vs 1 20M vs 100M -156
2 0.301 139 139 200 Games 2 vs 1 40M vs 100M
4 0.602 156 17 200 Games 4 vs 2 80M vs 100M
8 0.903 191 35 200 Games 8 vs 4 100M vs 100M 0
16 1.204 322 131 200 Games 16 vs 8 160M vs 100M
25 1.398 469 147 200 Games 25 vs 16 320M vs 100M
50 1.699 662 193 200 Games 50 vs 25 640M vs 100M
100 2.000 824 162 200 Games 100 vs 50 1.28B vs 100M
200 2.301 967 143 200 Games 200 vs 100
400 2.602 1120 153 200 Games 400 vs 200
800 2.903 1218 98 200 Games 800 vs 400
1,600 3.204 1361 143 200 Games 1,600 vs 800
3,125 3.495 1488 127 100 Games 3,125 vs 1,600
6,250 3.796 1548 60 100 Games 6,250 vs 3,125 Nodes Elo
12,500 4.097 1637 89 100 Games 12,500 vs 6,250 25,000 0
25,000 4.398 1715 78 0 0 100 Games 25,000 vs 12,500 (3 Seconds per Move) 50,000 49
50,000 4.699 1764 49 49 49 100 Games 50k vs 25k 100,000 77
100,000 5.000 1792 28 77 28 100 Games 100k vs 50k 200,000 108
200,000 5.301 1823 31 108 31 100 Games 200k vs 100k 400,000 108
400,000 5.602 1823 0 108 0 100 Games 400k vs 200k 800,000
800,000 5.903 50 Games 800k vs 400k
1,600,000 6.204 50 Games 1.6M vs 800k (1.6M vs 50k Results=Similar)
3,200,000 6.505 50 Games 3.2M vs 800k
6,400,000 6.806
12,800,000 7.107
25,600,000 7.408
51,200,000 7.709
[28]
MORE INFO. BELOW Key:
Leela Latest Update
IMPORTANT NOTES: (Read me) Leela
-Lc0 CUDA ID 10480 is used.
-Leela Nodes vs. Delta ELO is less accurate. Use the Information:
first chart to estimate ELO given x Nodes per Move. -Log10(x)=y is the same as 10^y=x
-All settings on Lc0 CUDA remain default. -I will likely include more games later
-Interesting test: I found that the ELO difference b/w
1.6M vs. 50k compared to 800k is the same as 1.6M vs.
800k. (Currently around 35 ELO) This means that my
prior 50k test should be accurate!
Leela Chess Zero Scaling [15x192] By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) Lc0 Nodes vs Delta ELO Nodes (SF) ELO Performance
Nodes Log10(Nodes)=X Elo Delta ELO Diff.
Elo 50k [30]
ELO Diff. Info. Notes 10M vs 100M -164 ELO so far.
1 0.000 0 0 200 Games 1 vs 1 20M vs 100M -156
2 0.301 53 53 200 Games 2 vs 1 40M vs 100M
4 0.602 67 14 200 Games 4 vs 2 80M vs 100M
8 0.903 100 33 200 Games 8 vs 4 100M vs 100M 0
16 1.204 172 72 200 Games 16 vs 8 160M vs 100M
25 1.398 347 175 200 Games 25 vs 16 320M vs 100M
50 1.699 533 186 200 Games 50 vs 25 640M vs 100M
100 2.000 736 203 200 Games 100 vs 50 1.28B vs 100M
200 2.301 920 184 200 Games 200 vs 100
400 2.602 1039 119 200 Games 400 vs 200
800 2.903 1176 137 200 Games 800 vs 400
1,600 3.204 1293 117 200 Games 1,600 vs 800
3,125 3.495 1438 145 200 Games 3,125 vs 1,600
6,250 3.796 1542 104 100 Games 6,250 vs 3,125
12,500 4.097 1627 85 100 Games 12,500 vs 6,250
25,000 4.398 1738 111 100 Games 25,000 vs 12,500
50,000 4.699 1842 104 0 0 100 Games 50k vs 25k (3 Seconds per Move)
100,000 5.000 1912 70 70 70 100 Games 100k vs 50k
200,000 5.301 1950 38 108 38 100 Games 200k vs 50k
400,000 5.602 2015 65 173 65 100 Games 400k vs 50k
800,000 5.903 2088 73 246 73 100 Games 800k vs 50k
1,600,000 6.204 2115 27 273 27 50 Games 1.6M vs 800k (1.6M vs 50k Results=Similar)
3,200,000 6.505 2151 36 309 36 50 Games 3.2M vs 800k
6,400,000 6.806
12,800,000 7.107
25,600,000 7.408
51,200,000 7.709
102,400,000 8.010 574 Elo est [31]
Est. based off: -766 + 72.7 ln(x)
Easter egg? You found one! Note to self: Add a link here later.
Leela Chess Zero Rating List [Charts] By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) MORE INFO. BELOW
3,676
3,676
Rating List (Matchups) By: Cscuile LcZero ELO Estimate List Approximation (L.e.e.l.a.) Leela Stream Link: (Offline)
Work in progress https://www.twitch.tv/cscuile
cp = (int(cp) / 4)
cp = (int(cp) / 162)
cp = (math.atan(cp))
cp = (cp / 3.14)
cp = (cp + 0.5)
cp = cp * 100
elif cp < 0:
cp = (int(cp) / 162)
cp = (math.atan(cp))
cp = (cp / 3.14)
cp = (cp + 0.5)
cp = cp * 100
if cp > 50:
win = (cp - 50) * 2
draw = 100 - win
loss = 0
elif cp == 50:
draw = 50
else:
win = 0
loss = (50 - cp) * 2
draw = 100 - loss
print('Leela - Win: %.2f%% - Draw: %.2f%% - Loss: %.2f%%' % (win, draw, loss))
loss = (50 - cp) * 2
draw = 100 - loss
print('Leela - Win: %.2f%% - Draw: %.2f%% - Loss: %.2f%%' % (win, draw, loss))
Stockfish (AlphaZero)
3371.29 - 3199.81
= 171 Elo Difference
This Estimate scales a 20k nps Titan V to Deepmind's 80k nps on 4 TPUs. 1+1 Time Control is used, with
an average game length being 40 moves.
[8] Log10(Nodes)=X
[10] Five-Hundred Forty-Thousand to one. Lucky you, ta ta. Some may get this reference.
Note: I needed this many games in order to minimize the ELO error bar.
[12] Log10(Nodes)=X
[13] This column shows ELO relative to the time spent calculating nodes.
The following hardware is considered with their respected Nodes Per Second at the starting position of a
game.
[16] This column shows ELO relative to the time spent calculating nodes.
The following hardware is considered with their respected Nodes Per Second at the starting position of a
game.
[18] Log10(Nodes)=X
[20] Five-Hundred Forty-Thousand to one. Lucky you, ta ta. Some may get this reference.
Note: I needed this many games in order to minimize the ELO error bar.
[22] Log10(Nodes)=X
[24] Log10(Nodes)=X
[26] ELO Difference Estimation based off of the best-fit Natural Logarithmic function.
[28] ELO Difference Estimation based off of the best-fit Natural Logarithmic function.
[29] ELO Difference Estimation based off of the best-fit Natural Logarithmic function.
[31] ELO Difference Estimation based off of the best-fit Natural Logarithmic function.
[32] ELO Difference Estimation based off of the best-fit Natural Logarithmic function.
[33] 4 CPU
[35] If you have any test requests such as "What's Leela's ELO ran on x10 Nvidia Tesla v100's" just post a
comment. You can find the comment button on the top right corner of the screen.
[40] AlphaZero 1080TI is scaled against Leela ID 10480 20x256 Network Architecture. You can find 20
Block Scaling information on the "Lc0 Scaling [20x256]" Doc to the right.
Equation Used: (8/11/18)
-3.36 + 169ln(x)
[41] This is quite the milestone! Leela ID 10751 ran on a 1080TI is stronger than Stockfish 8 ran on a 4 core
i7 7700k
[42] 45.8%/100%
[43] Stockfish 8 4CPU 8 Threads under normal hardware and setting conditions.
[44] AlphaZero 1080TI is scaled against Leela ID 10480 20x256 Network Architecture. You can find 20
Block Scaling information on the "Lc0 Scaling [20x256]" Doc to the right.
Equation Used: (8/11/18)
-3.36 + 169ln(x)
Avg, 2.5 seconds per move
[45] Each engine must mate in order to win. There is no longer a win margin. IE: No more -3.00 =
Adjudicated to Win