Code

Feature/compressed tree w protobuf#126

Code

Draft

mathleur wants to merge 46 commits intodevelopecmwf/polytope:developfrom feature/compressed_tree_w_protobufecmwf/polytope:feature/compressed_tree_w_protobufCopy head branch name to clipboard

+1,846-623

Commits

Commits on Feb 15, 2024

• create tensor index tree object and incorporate into hullslicer

  mathleur

  committed
  45b9a11

  Copy full SHA for 45b9a11

Commits on Feb 16, 2024

• fix some tests

  mathleur

  committed
  fe35193

  Copy full SHA for fe35193

• fix get for xarray backend

  mathleur

  committed
  4c868b2

  Copy full SHA for 4c868b2

• fix xarray testts

  mathleur

  committed
  6bd0b1c

  Copy full SHA for 6bd0b1c

• fix mroe tests

  mathleur

  committed
  2efbacf

  Copy full SHA for 2efbacf

• fix type change transformation

  mathleur

  committed
  07d48f3

  Copy full SHA for 07d48f3

• fix all tests with xarray backend

  mathleur

  committed
  3cbed71

  Copy full SHA for 3cbed71

Commits on Feb 19, 2024

• make first version fo tensor index tree work with fdb

  mathleur

  committed
  7eb8755

  Copy full SHA for 7eb8755

• more tests

  mathleur

  committed
  ba382fa

  Copy full SHA for ba382fa

• start adding compression for grids

  mathleur

  committed
  e415a2d

  Copy full SHA for e415a2d

• clean up

  mathleur

  committed
  ba65c47

  Copy full SHA for ba65c47

• make right grid axes be compressed in tree

  mathleur

  committed
  d60bb0a

  Copy full SHA for d60bb0a

Commits on Feb 29, 2024

• clean up

  mathleur

  committed
  4110f93

  Copy full SHA for 4110f93

Commits on Mar 4, 2024

• remove duplicate print for index trees

  mathleur

  committed
  ed43774

  Copy full SHA for ed43774

• start moving compressed tree logic of adding children to tensor tree structure

  mathleur

  committed
  cb94a1e

  Copy full SHA for cb94a1e

Commits on Mar 5, 2024

• merge develop and move compression logic into tensor index tree

  mathleur

  committed
  ef80bb5

  Copy full SHA for ef80bb5

Commits on Mar 6, 2024

• fix xarray get

  mathleur

  committed
  bce6fb4

  Copy full SHA for bce6fb4

Commits on Mar 7, 2024

• start to fix more tests

  mathleur

  committed
  9b5e71d

  Copy full SHA for 9b5e71d

• fix almost all problems except data size attached to leaves

  mathleur

  committed
  582f299

  Copy full SHA for 582f299

• fix almost all tests, but data extracted from fdb is only the first index in compressed tuples

  mathleur

  committed
  fab2252

  Copy full SHA for fab2252

Commits on Mar 11, 2024

• fix small bug on slicing for flat polytopes

  mathleur

  committed
  1ec5145

  Copy full SHA for 1ec5145

• fix everything except returned values from pygribjump

  mathleur

  committed
  3b16685

  Copy full SHA for 3b16685

• flake8

  mathleur

  committed
  8c9f273

  Copy full SHA for 8c9f273

• flake8

  mathleur

  committed
  c4ff333

  Copy full SHA for c4ff333

• flake8

  mathleur

  committed
  171efae

  Copy full SHA for 171efae

Commits on Mar 14, 2024

• make associating data to right tree nodes work with compressed trees

  mathleur

  committed
  9acfcf4

  Copy full SHA for 9acfcf4

• clean up

  mathleur

  committed
  670fb08

  Copy full SHA for 670fb08

Commits on Mar 15, 2024

• add a index tree protobuf

  mathleur

  committed
  4394117

  Copy full SHA for 4394117

• fix test

  mathleur

  committed
  62f4363

  Copy full SHA for 62f4363

• add protobuf index tree encoder

  mathleur

  committed
  83a6aec

  Copy full SHA for 83a6aec

• add protobuf index tree decoder

  mathleur

  committed
  8bdc5ba

  Copy full SHA for 8bdc5ba

Commits on Mar 18, 2024

• add encoder/decoder support for timestamps/timedeltas and test

  mathleur

  committed
  b1b81a6

  Copy full SHA for b1b81a6

• add performance test for protobuf encoder/decoder

  mathleur

  committed
  74f0f75

  Copy full SHA for 74f0f75

• Merge branch 'feature/index_tree_protobuf' of github.com:ecmwf/polytope into feature/compressed_tree_w_protobuf

  mathleur

  committed
  48da664

  Copy full SHA for 48da664

Commits on Mar 19, 2024

• modify protobuf tree encoding to support compressed tree tuple values

  mathleur

  committed
  93b02b4

  Copy full SHA for 93b02b4

Commits on Apr 18, 2024

• add result_size to protobuf compressed tree

  mathleur

  committed
  61f3438

  Copy full SHA for 61f3438

• remove large file

  mathleur

  committed
  9363e69

  Copy full SHA for 9363e69

• update gitignore

  mathleur

  committed
  dca546e

  Copy full SHA for dca546e

• move to proto3

  mathleur

  committed
  d5444fe

  Copy full SHA for d5444fe

Commits on Apr 23, 2024

• start to add cap proto index tree

  mathleur

  committed
  fa8e7fa

  Copy full SHA for fa8e7fa

• finish capnp protobuffer of compressed tree

  mathleur

  committed
  5ce2c2a

  Copy full SHA for 5ce2c2a

Commits on Apr 29, 2024

• add and fix capnp encoder

  mathleur

  committed
  91a42a3

  Copy full SHA for 91a42a3

• make encoder and decoder work for capnp

  mathleur

  committed
  2ed7e10

  Copy full SHA for 2ed7e10

• make protobuf encoding right

  mathleur

  committed
  5038c63

  Copy full SHA for 5038c63

Commits on Apr 30, 2024

• fix tests

  mathleur

  committed
  b90e92a

  Copy full SHA for b90e92a

• do encoding and decoding to a byte array instead of a file

  mathleur

  committed
  a07970e

  Copy full SHA for a07970e