Code

Merk hash scheme migration#338

Code

Open

MavenRain wants to merge 120 commits intoliftedinit:mainliftedinit/many-rs:mainfrom MavenRain:merk-migrationMavenRain/many-rs:merk-migrationCopy head branch name to clipboard

+4,753-2,446

Commits

Commits on Mar 21, 2023

• Very rough draft of merk key migration

  MavenRain

  committed
  9c39f12

  Copy full SHA for 9c39f12

• Branch broken due to Bazel problem

  MavenRain

  committed
  6569168

  Copy full SHA for 6569168

• New migration type

  MavenRain

  committed
  7534813

  Copy full SHA for 7534813

• Lock file changes

  MavenRain

  committed
  015478f

  Copy full SHA for 015478f

Commits on Mar 22, 2023

• Lock file changes

  MavenRain

  committed
  9fc967a

  Copy full SHA for 9fc967a

• fix: alias many-ledger test

  fmorency

  committed
  186091b

  Copy full SHA for 186091b

• Factor complex type

  MavenRain

  committed
  df8814b

  Copy full SHA for df8814b

Commits on Mar 23, 2023

• Add hash migration to json config

  MavenRain

  committed
  7091a87

  Copy full SHA for 7091a87

Commits on Mar 27, 2023

• Fixed storage error by sorting batch in ledger tokens section

  MavenRain

  committed
  cd7c4b7

  Copy full SHA for cd7c4b7

• Remove unused imports

  MavenRain

  committed
  f18d6dd

  Copy full SHA for f18d6dd

• cargo fmt

  MavenRain

  committed
  b074ef0

  Copy full SHA for b074ef0

• Lock file changes

  MavenRain

  committed
  1332d87

  Copy full SHA for 1332d87

• Lock file changes

  MavenRain

  committed
  de63140

  Copy full SHA for de63140

• Lock file changes

  MavenRain

  committed
  18f16ea

  Copy full SHA for 18f16ea

• Flop over to v2 for idstore export

  MavenRain

  committed
  b9f0110

  Copy full SHA for b9f0110

• To merk v2 for ledger db CLI

  MavenRain

  committed
  c5a75b8

  Copy full SHA for c5a75b8

Commits on Mar 29, 2023

• Choose v1 or v2 storage opening in ledger based on migration

  MavenRain

  committed
  9cc2dcb

  Copy full SHA for 9cc2dcb

• Storage opening in ledger dependent on hash migration

  MavenRain

  committed
  cac41ce

  Copy full SHA for cac41ce

• KvStore only uses v2 storage

  MavenRain

  committed
  2a3767b

  Copy full SHA for 2a3767b

Commits on Mar 30, 2023

• On write, all operations take merk version into account

  MavenRain

  committed
  d33d246

  Copy full SHA for d33d246

• Use v2 merk error for KvStoreIterator

  MavenRain

  committed
  71adc6b

  Copy full SHA for 71adc6b

• Corrected some storage operations in the main ledger storage file

  MavenRain

  committed
  9cb3ebe

  Copy full SHA for 9cb3ebe

• Stub for hash migration resiliency test

  MavenRain

  committed
  907d5d7

  Copy full SHA for 907d5d7

• Rectify clippy errors

  MavenRain

  committed
  e2bb5e6

  Copy full SHA for e2bb5e6

• Add setup/teardown for migration resiliency test

  MavenRain

  committed
  050e039

  Copy full SHA for 050e039

• Fix bug causing staging e2e failure

  MavenRain

  committed
  0478be6

  Copy full SHA for 0478be6

• Some ledger main.rs cleanup

  MavenRain

  committed
  46b9aac

  Copy full SHA for 46b9aac

• More ledger main.rs cleanup

  MavenRain

  committed
  7e6c718

  Copy full SHA for 7e6c718

• Add initial consistency check to hash migraton resiliency test

  MavenRain

  committed
  1b4b088

  Copy full SHA for 1b4b088

• Edit toml files to remove redundant license fields

  MavenRain

  committed
  ca5814b

  Copy full SHA for ca5814b

• Cargo Bazel lock changes

  MavenRain

  committed
  8a22532

  Copy full SHA for 8a22532

• Fix imports in ledger main

  MavenRain

  committed
  da1bf32

  Copy full SHA for da1bf32

• Overcome clippy errors

  MavenRain

  committed
  dffa8b4

  Copy full SHA for dffa8b4

• Completed hash migration resiliency test

  MavenRain

  committed
  d3ca797

  Copy full SHA for d3ca797

Commits on Apr 3, 2023

• Try hardcoded temp file for v2 storage

  MavenRain

  committed
  81a556c

  Copy full SHA for 81a556c

• Merge https://github.com/liftedinit/many-rs into merk-migration

  MavenRain

  committed
  42e5bc6

  Copy full SHA for 42e5bc6

• look for migrations config file in the right place

  MavenRain

  committed
  252fef6

  Copy full SHA for 252fef6

• cargo fmt

  MavenRain

  committed
  6997d20

  Copy full SHA for 6997d20

Commits on Apr 4, 2023

• Debugging commit for deserialization error in hash migration

  MavenRain

  committed
  58ce7b0

  Copy full SHA for 58ce7b0

• Rectified merge with main

  MavenRain

  committed
  014067d

  Copy full SHA for 014067d

• Now debugging unexpected transport error

  MavenRain

  committed
  17a4709

  Copy full SHA for 17a4709

• Attempt to print send envelope message before response is returned

  MavenRain

  committed
  2554e03

  Copy full SHA for 2554e03

• Print respone before failed attempt to deserialize

  MavenRain

  committed
  5fbcb2d

  Copy full SHA for 5fbcb2d

• Log requests before cose packaging

  MavenRain

  committed
  3bed6b3

  Copy full SHA for 3bed6b3

• Instrument ledger.info call

  MavenRain

  committed
  e745b8f

  Copy full SHA for e745b8f

• Capture response from client call to ledger.info

  MavenRain

  committed
  912620d

  Copy full SHA for 912620d

• Fix clippy error

  MavenRain

  committed
  0a18e90

  Copy full SHA for 0a18e90

• Remove some debugging logs to restore webauthn bats tests

  MavenRain

  committed
  eb17ffd

  Copy full SHA for eb17ffd

• Merge https://github.com/liftedinit/many-rs into merk-migration

  MavenRain

  committed
  da72e3f

  Copy full SHA for da72e3f

• Remove send_message logging

  MavenRain

  committed
  c02b7fc

  Copy full SHA for c02b7fc

• Debugging symbols function

  MavenRain

  committed
  d0f0510

  Copy full SHA for d0f0510

• RUST_BACKTRACE=1 to get backtrace

  MavenRain

  committed
  dae0b50

  Copy full SHA for dae0b50

• Try to get backtrace to work

  MavenRain

  committed
  bcbc627

  Copy full SHA for bcbc627

• Get error for status from the response in the client call

  MavenRain

  committed
  ff4fbed

  Copy full SHA for ff4fbed

Commits on Apr 5, 2023

• Attempt to log incoming request on server side

  MavenRain

  committed
  b7a4c0c

  Copy full SHA for b7a4c0c

• Examine reqwest call in send_envelope

  MavenRain

  committed
  90eebbc

  Copy full SHA for 90eebbc

• cargo fmt

  MavenRain

  committed
  fc8b0e9

  Copy full SHA for fc8b0e9

• Log response again

  MavenRain

  committed
  da64fba

  Copy full SHA for da64fba

• Change transport error to unknown error

  MavenRain

  committed
  f575b00

  Copy full SHA for f575b00

• Further scrutinize response

  MavenRain

  committed
  2c0c000

  Copy full SHA for 2c0c000

• Print response result

  MavenRain

  committed
  cea55b6

  Copy full SHA for cea55b6

• Use modified reqwest repo for further debugging

  MavenRain

  committed
  a5572bf

  Copy full SHA for a5572bf

• Error for status

  MavenRain

  committed
  1033b96

  Copy full SHA for 1033b96

• Error surfaced earlier

  MavenRain

  committed
  b01dd7c

  Copy full SHA for b01dd7c

• Restore error conversion after error-for-status

  MavenRain

  committed
  d6291a5

  Copy full SHA for d6291a5

• Some error-handling in many main

  MavenRain

  committed
  86712ac

  Copy full SHA for 86712ac

• Debug SYMBOLS_ROOT through migration

  MavenRain

  committed
  b1f5f84

  Copy full SHA for b1f5f84

• Now try to decode symbols into map during migration

  MavenRain

  committed
  a1de093

  Copy full SHA for a1de093

• Format change of symbol root log

  MavenRain

  committed
  1acb6ae

  Copy full SHA for 1acb6ae

• Possible moment-of-truth: replacing to_vec with minicbor::to_vec

  MavenRain

  committed
  30346d2

  Copy full SHA for 30346d2

• Debug update_at_height

  MavenRain

  committed
  042e192

  Copy full SHA for 042e192

• Simply into replacing cbor (double?) encoding

  MavenRain

  committed
  162676e

  Copy full SHA for 162676e

• Try just migrating objects with known iterators

  MavenRain

  committed
  6183734

  Copy full SHA for 6183734

• Fix needless borrow

  MavenRain

  committed
  78cf28c

  Copy full SHA for 78cf28c

• multisig bug in migration fix

  MavenRain

  committed
  28f30c9

  Copy full SHA for 28f30c9

• Specifically add symbols table

  MavenRain

  committed
  03dd4d1

  Copy full SHA for 03dd4d1

• Possible solution to iterate-all problem

  MavenRain

  committed
  def4139

  Copy full SHA for def4139

Commits on Apr 6, 2023

• Cleanup of unwraps post debugging

  MavenRain

  committed
  6500bf4

  Copy full SHA for 6500bf4

• reqwest response handling cleanup

  MavenRain

  committed
  174c927

  Copy full SHA for 174c927

• Refactor update_at_height call post hardcoding path for new storage

  MavenRain

  committed
  60385a4

  Copy full SHA for 60385a4

• Refactor replacement from function pointer to more general closure

  MavenRain

  committed
  bd74390

  Copy full SHA for bd74390

• Fix clippy errors and remove unwraps post debugging

  MavenRain

  committed
  6eefbd1

  Copy full SHA for 6eefbd1

• Refactoring of LedgerStorage::commit

  MavenRain

  committed
  e2c4f17

  Copy full SHA for e2c4f17

• Overcome clippy error

  MavenRain

  committed
  bc7493b

  Copy full SHA for bc7493b

• Remove println statements post-debugging

  MavenRain

  committed
  63b2ce4

  Copy full SHA for 63b2ce4

• More migration related cleanup

  MavenRain

  committed
  cf3d3c2

  Copy full SHA for cf3d3c2

• Introduce forests

  MavenRain

  committed
  490f6f7

  Copy full SHA for 490f6f7

• Return error message in payload with 500 from server

  MavenRain

  committed
  183715b

  Copy full SHA for 183715b

• Fix clippy error

  MavenRain

  committed
  caca26c

  Copy full SHA for caca26c

• Merge https://github.com/liftedinit/many-rs into merk-migration

  MavenRain

  committed
  5632885

  Copy full SHA for 5632885

• Deleting more debugging code and import formats

  MavenRain

  committed
  76ff5af

  Copy full SHA for 76ff5af

Commits on Apr 10, 2023

• Remove dead code allowance

  MavenRain

  committed
  702cf18

  Copy full SHA for 702cf18

• Restore dead code allowance temporarily

  MavenRain

  committed
  f513be6

  Copy full SHA for f513be6

• Now try to write to same v2 path as v1 path

  MavenRain

  committed
  74fb305

  Copy full SHA for 74fb305

• Merge branch 'detached-state' into merk-migration

  MavenRain

  committed
  baa1f16

  Copy full SHA for baa1f16

• Fix migration e2e tests

  MavenRain

  committed
  bc17301

  Copy full SHA for bc17301

• Trying to destroy old v1 merk copy properly

  MavenRain

  committed
  eba86ea

  Copy full SHA for eba86ea

Commits on Apr 11, 2023

• Debugging new migration flow

  MavenRain

  committed
  0b58318

  Copy full SHA for 0b58318

• Add another unwrapping

  MavenRain

  committed
  894bee5

  Copy full SHA for 894bee5

• Straight unwrappings trip a clippy error

  MavenRain

  committed
  ce75813

  Copy full SHA for ce75813

• Debugging update_at_height

  MavenRain

  committed
  c24902a

  Copy full SHA for c24902a

• Debugging initialize function

  MavenRain

  committed
  a0eb7ba

  Copy full SHA for a0eb7ba

• Propagate Debug requirements for error types

  MavenRain

  committed
  35aec13

  Copy full SHA for 35aec13

• Further initialize debugging

  MavenRain

  committed
  3da8121

  Copy full SHA for 3da8121

• Inline initialize method for further debugging

  MavenRain

  committed
  2639e9f

  Copy full SHA for 2639e9f

• Move initialize inlining

  MavenRain

  committed
  3fc1954

  Copy full SHA for 3fc1954

• Debug into hash migration initialization

  MavenRain

  committed
  d66869b

  Copy full SHA for d66869b

• Change to random file name inside created merk temporary operation

  MavenRain

  committed
  b70771e

  Copy full SHA for b70771e

• Temp directory fixed and debugging removed

  MavenRain

  committed
  95bce1e

  Copy full SHA for 95bce1e

• Small migration error-handling edit and removing dead code annotation from path field of ledger storage

  MavenRain

  committed
  cfdb514

  Copy full SHA for cfdb514

Commits on Apr 12, 2023

• Midstep to removing replacement argument of migration initializer

  MavenRain

  committed
  f4fa962

  Copy full SHA for f4fa962

• Remove replacement field from hash migration function type

  MavenRain

  committed
  986290c

  Copy full SHA for 986290c

• Abstract from PathBuf to Path in function signatures

  MavenRain

  committed
  24f91db

  Copy full SHA for 24f91db

• Fix unnecessary to_owned

  MavenRain

  committed
  a83ff7d

  Copy full SHA for a83ff7d

Commits on Apr 17, 2023

• Batch processing refactor

  MavenRain

  committed
  0ca8182

  Copy full SHA for 0ca8182

• Fix clippy errors

  MavenRain

  committed
  e9d67c7

  Copy full SHA for e9d67c7

Commits on Apr 19, 2023

• Test consuming db file path from extra config

  MavenRain

  committed
  e62de6c

  Copy full SHA for e62de6c

• Add db file to migrations config

  MavenRain

  committed
  b3c8986

  Copy full SHA for b3c8986

• Convert entry to PathBuf

  MavenRain

  committed
  fa7ad3a

  Copy full SHA for fa7ad3a

Commits on Apr 21, 2023

• Print and pass error in AbciCommitInfo

  MavenRain

  committed
  db0f739

  Copy full SHA for db0f739