Code

Rescore tb rebase#1

Code

Open

almaudoh wants to merge 84 commits intomasteralmaudoh/lc0:masterfrom rescore_tb_rebasealmaudoh/lc0:rescore_tb_rebaseCopy head branch name to clipboard

+18,928-15

Commits

Commits on Sep 9, 2018

• Add a mode to turn lc0 into a chunk data rescorer powered by Tablebase.

  Tilps

  committed
  ff29bb1

  Copy full SHA for ff29bb1

Commits on Sep 13, 2018

• Add some stats.

  Tilps

  committed
  ad68cae

  Copy full SHA for ad68cae

Commits on Sep 14, 2018

• Add secondary rescoring using wdl to reduce back propigation of blunders a bit.

  Tilps

  committed
  00e9b8a

  Copy full SHA for 00e9b8a

Commits on Sep 23, 2018

• Add policy distribution adjust support to rescorer.

  Tilps

  committed
  c0dd9f4

  Copy full SHA for c0dd9f4

Commits on Sep 24, 2018

• Track the game outcomes, and the change to the start of the game

  Tilps

  committed
  846d490

  Copy full SHA for 846d490

Commits on Sep 25, 2018

• Add DTZ based assistance for secondary rescoring.

  Tilps

  committed
  e0352dd

  Copy full SHA for e0352dd

Commits on Oct 1, 2018

• Change move count to a moves remaining to potentially use for modulating target value.

  Tilps

  committed
  a4e30de

  Copy full SHA for a4e30de

Commits on Oct 11, 2018

• Use DTZ for pawnless 3 piece positions as a substitue for DTM to adjust move_count to be more correct

  Tilps

  committed
  d30d0ea

  Copy full SHA for d30d0ea

Commits on Feb 10, 2019

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  3adba16

  Copy full SHA for 3adba16

• another fix.

  Tilps

  committed
  247ec79

  Copy full SHA for 247ec79

• More fixing.

  Tilps

  committed
  5c59a70

  Copy full SHA for 5c59a70

• Getting things compiling again.

  Tilps

  committed
  492fc3b

  Copy full SHA for 492fc3b

• Make rescorer more obvious.

  Tilps

  committed
  d38c241

  Copy full SHA for d38c241

• reorder to match struct order.

  Tilps

  committed
  a58cca1

  Copy full SHA for a58cca1

• Actually update the version when converting to v4 format.

  Tilps

  committed
  879fabe

  Copy full SHA for 879fabe

Commits on Mar 4, 2019

• Implement the threading support.

  Tilps

  committed
  13d3258

  Copy full SHA for 13d3258

• Fix compilation issues on some compilers.

  Tilps

  committed
  7811655

  Copy full SHA for 7811655

• More compilation fixing.

  Tilps

  committed
  fd0580b

  Copy full SHA for fd0580b

• Fix off by one.

  Tilps

  committed
  2400643

  Copy full SHA for 2400643

Commits on Mar 30, 2019

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  e7833eb

  Copy full SHA for e7833eb

• Add support for root probe policy boosting for minimum dtz in winning positions.

  Tilps

  committed
  79ef254

  Copy full SHA for 79ef254

• Fix test compile.

  Tilps

  committed
  86b134a

  Copy full SHA for 86b134a

• Fix missing option.

  Tilps

  committed
  53329cc

  Copy full SHA for 53329cc

• Add a counter.

  Tilps

  committed
  c41e55d

  Copy full SHA for c41e55d

• Log if policy boost is for a move labelled illegal.

  Tilps

  committed
  0a6e933

  Copy full SHA for 0a6e933

Commits on Mar 31, 2019

• Add a histogram for total amount of boosted policy per boosted position.

  Tilps

  committed
  6b73d05

  Copy full SHA for 6b73d05

• Distribute boost rather than apply to all - also log before and after dists.

  Tilps

  committed
  402ef5e

  Copy full SHA for 402ef5e

Commits on Apr 8, 2019

• Add gaviotatb code for later use in dtm_boost

  Tilps

  committed
  d2b23a3

  Copy full SHA for d2b23a3

• Fix compile issue on linux.

  Tilps

  committed
  93ce7fa

  Copy full SHA for 93ce7fa

• Prepare logic for dtm policy boost.

  Tilps

  committed
  86823a8

  Copy full SHA for 86823a8

• Load gaviota tb if specified.

  Tilps

  committed
  0f3d65f

  Copy full SHA for 0f3d65f

• Probe gaviota to decide which 'safe' moves are most deserving of boost based on dtm.

  Tilps

  committed
  a1697ad

  Copy full SHA for a1697ad

Commits on Oct 12, 2019

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  effbbd3

  Copy full SHA for effbbd3

• First attempt at supporting arbitrary starting point training data for rescorer.

  Tilps

  committed
  14bf321

  Copy full SHA for 14bf321

• Fix missing brackets.

  Tilps

  committed
  f2eadb3

  Copy full SHA for f2eadb3

• Some fixes.

  Tilps

  committed
  d6ba89d

  Copy full SHA for d6ba89d

• Avoid crashes from walking history before start of provided game information.

  Tilps

  committed
  74a5d42

  Copy full SHA for 74a5d42

Commits on Feb 9, 2020

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  889c7e1

  Copy full SHA for 889c7e1

• Some more merge fixes.

  Tilps

  committed
  c5cd41d

  Copy full SHA for c5cd41d

• Fix some formatting.

  Tilps

  committed
  a6b13f7

  Copy full SHA for a6b13f7

• Only process .gz files, don't crash out on invalid files, don't create output until input has been read.

  Tilps

  committed
  0fdd7bf

  Copy full SHA for 0fdd7bf

• Don't keep partially valid files.

  Tilps

  committed
  df78b01

  Copy full SHA for df78b01

• Add basic range validation for input data.

  Tilps

  committed
  577fb35

  Copy full SHA for 577fb35

• Don't create writer any earlier than needed.

  Tilps

  committed
  d708c56

  Copy full SHA for d708c56

• Fix decoding castling moves for the new Move format.

  Tilps

  committed
  0e7935f

  Copy full SHA for 0e7935f

• Validate game moves for legality.

  Tilps

  committed
  a34b722

  Copy full SHA for a34b722

• Also log illegal move if it passes probability check but fails the real check.

  Tilps

  committed
  b0d06f9

  Copy full SHA for b0d06f9

• Fix another merge error.

  Tilps

  committed
  286b0bf

  Copy full SHA for 286b0bf

• Compile fix for linux.

  Tilps

  committed
  4aeb3d9

  Copy full SHA for 4aeb3d9

Commits on Mar 8, 2020

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  a63135c

  Copy full SHA for a63135c

• Plies left in rescorer (#1)

  Show description for 2f2e1d0
  Ttl

  authored
  2f2e1d0

  Copy full SHA for 2f2e1d0

Commits on Mar 21, 2020

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  79a19f3

  Copy full SHA for 79a19f3

• Post merge fixup for the kings/knights change in board.

  Tilps

  committed
  b5be4f8

  Copy full SHA for b5be4f8

Commits on Mar 22, 2020

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  36399ac

  Copy full SHA for 36399ac

• Rescore tb v5 (#2)

  Show description for 3fe4716
  Tilps

  authored
  3fe4716

  Copy full SHA for 3fe4716

• Support FRC input_format in rescoring.

  Tilps

  committed
  39e8332

  Copy full SHA for 39e8332

Commits on Mar 26, 2020

• Add some very important missing break statements...

  Tilps

  committed
  0d52ed7

  Copy full SHA for 0d52ed7

Commits on Apr 9, 2020

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  eb3ff87

  Copy full SHA for eb3ff87

• Fix merge.

  Tilps

  committed
  945410d

  Copy full SHA for 945410d

• Change movement decode to not rely on there being any history planes filled in.

  Show description for 39515fb
  Tilps

  committed
  39515fb

  Copy full SHA for 39515fb

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  49cc5dc

  Copy full SHA for 49cc5dc

• Minimum changes to make it compile again post merge.

  Tilps

  committed
  1d29068

  Copy full SHA for 1d29068

• Input format 3 support.

  Tilps

  committed
  18bfc8e

  Copy full SHA for 18bfc8e

• Fix data range checks were incorrect for format 3 and 2.

  Tilps

  committed
  5a61558

  Copy full SHA for 5a61558

• Fix up bugs with chess 960 castle moves that leave a rook or king in place.

  Tilps

  committed
  20dc79f

  Copy full SHA for 20dc79f

Commits on Apr 22, 2020

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  c442060

  Copy full SHA for c442060

• Post merge compile fixups for renames.

  Tilps

  committed
  f921607

  Copy full SHA for f921607

Commits on Jun 17, 2020

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  e03c36f

  Copy full SHA for e03c36f

• Add support for hectoplies and hectoplies armageddon to validate, and fixup the merge of latest code.

  Tilps

  committed
  777b262

  Copy full SHA for 777b262

Commits on Jul 2, 2020

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  dc0861a

  Copy full SHA for dc0861a

• More fixes for type 4 and 132.

  Tilps

  committed
  eb1a86b

  Copy full SHA for eb1a86b

Commits on Sep 13, 2020

• Add input format conversion support to rescorer.

  Tilps

  committed
  cd1215b

  Copy full SHA for cd1215b

• Better match for training.

  Tilps

  committed
  2f7d08c

  Copy full SHA for 2f7d08c

Commits on Sep 19, 2020

• Merge branch 'master' into rescore_tb

  Tilps

  committed
  842de0c

  Copy full SHA for 842de0c

• Add canonical v2 format to rescorer.

  Tilps

  committed
  03793ab

  Copy full SHA for 03793ab

Commits on Oct 11, 2020

• Add a utility for substituting policy from higher quality data into main data.

  Tilps

  committed
  21b4e48

  Copy full SHA for 21b4e48

• Fix missing option and add some commented out diagnostic code.

  Tilps

  committed
  c37778f

  Copy full SHA for c37778f

• More cleanup in comments.

  Tilps

  committed
  1ee96e2

  Copy full SHA for 1ee96e2

Commits on Oct 13, 2020

• Handle empty policy-substitutions dir and input dir better.

  Tilps

  committed
  53a6f81

  Copy full SHA for 53a6f81

Commits on Oct 25, 2020

• Don't keep chunks that are marked as not for training.

  Tilps

  committed
  2d28367

  Copy full SHA for 2d28367

• More fixes for handling files with placeholder chunks.

  Tilps

  committed
  74628be

  Copy full SHA for 74628be

Commits on Oct 31, 2020

• Add 'deblunderer'

  Show description for 25032e8
  Tilps

  committed
  25032e8

  Copy full SHA for 25032e8

• Fix some bugs in deblunder.

  Tilps

  committed
  ef590d2

  Copy full SHA for ef590d2

Commits on Dec 28, 2020

• Merge branch 'master' into rescore_tb_rebase

  almaudoh

  committed
  76a30d0

  Copy full SHA for 76a30d0