Code

Mkv#20

Code

Merged

KeplerC merged 81 commits intomainBerkeleyAutomation/fog_x:mainfrom mkvBerkeleyAutomation/fog_x:mkvCopy head branch name to clipboardSep 18, 2024

+5,120-2,993

Commits

Commits on Aug 19, 2024

• basic structure

  KeplerC

  committed
  bbb1644

  Copy full SHA for bbb1644

Commits on Aug 20, 2024

• Refactor Trajectory class to improve frame encoding and add support for different encodings

  KeplerC

  committed
  9309045

  Copy full SHA for 9309045

• fix loading

  KeplerC

  committed
  d394d67

  Copy full SHA for d394d67

• doesnt work, consider migrate robot data loader over

  KeplerC

  committed
  daaaa57

  Copy full SHA for daaaa57

• static works

  KeplerC

  committed
  70dc889

  Copy full SHA for 70dc889

Commits on Aug 21, 2024

• feat: Improve frame encoding and add support for different encodings in Trajectory class

  KeplerC

  committed
  5b0b462

  Copy full SHA for 5b0b462

• decode

  KeplerC

  committed
  9bf9eea

  Copy full SHA for 9bf9eea

• h5 cache

  KeplerC

  committed
  9d66f32

  Copy full SHA for 9d66f32

• figure out the issue of remuxing due to the context

  KeplerC

  committed
  c389804

  Copy full SHA for c389804

• it works without h264

  KeplerC

  committed
  d875a0a

  Copy full SHA for d875a0a

• fix the decoding bug and silient logs

  KeplerC

  committed
  e9f051e

  Copy full SHA for e9f051e

• Refactor Trajectory class to improve frame encoding and add support for different encodings

  KeplerC

  committed
  32d3dac

  Copy full SHA for 32d3dac

• feat: Add support for pre-initialized H.264 video streams in Trajectory class

  KeplerC

  committed
  945ddb0

  Copy full SHA for 945ddb0

• Refactor Trajectory class to remove commented code and improve code readability

  KeplerC

  committed
  a3e2c34

  Copy full SHA for a3e2c34

• Refactor Trajectory class to remove commented code and improve code readability

  KeplerC

  committed
  c7c9284

  Copy full SHA for c7c9284

• Refactor Trajectory class to improve code readability and remove commented code

  KeplerC

  committed
  b627e75

  Copy full SHA for b627e75

Commits on Aug 22, 2024

• init robot data loader structure

  KeplerC

  committed
  00d3d5e

  Copy full SHA for 00d3d5e

• convert from openx

  KeplerC

  committed
  5cfa061

  Copy full SHA for 5cfa061

• Refactor Trajectory class to improve frame encoding and add support for different encodings

  KeplerC

  committed
  0e5226f

  Copy full SHA for 0e5226f

• feat: Add HDF5Loader to support loading HDF5 files in fog_x/loader/__init__.py

  KeplerC

  committed
  e41675a

  Copy full SHA for e41675a

• add h5 accessing

  KeplerC

  committed
  c34a7c0

  Copy full SHA for c34a7c0

• code formatting

  KeplerC

  committed
  239c230

  Copy full SHA for 239c230

Commits on Aug 25, 2024

• Refactor Trajectory class to remove commented code and improve code readability

  KeplerC

  committed
  2f10e68

  Copy full SHA for 2f10e68

• benchmark code, missing container loader info

  KeplerC

  committed
  8f40ff8

  Copy full SHA for 8f40ff8

• Refactor Trajectory class to remove commented code and improve code readability

  KeplerC

  committed
  301f385

  Copy full SHA for 301f385

• Refactor Trajectory class to improve code readability and remove commented code

  KeplerC

  committed
  4545447

  Copy full SHA for 4545447

• Refactor Trajectory class to add optional cache path for storing cache files

  KeplerC

  committed
  d594e39

  Copy full SHA for d594e39

• Refactor Trajectory class to clear cache directory and improve code readability

  KeplerC

  committed
  430c73b

  Copy full SHA for 430c73b

• Refactor Trajectory class for improved code readability and removal of commented code

  KeplerC

  committed
  0220880

  Copy full SHA for 0220880

• Refactor Trajectory class to fix cache directory path

  KeplerC

  committed
  e280615

  Copy full SHA for e280615

• Refactor Trajectory class to add HDF5Handler for converting data to HDF5 format

  KeplerC

  committed
  87fecf1

  Copy full SHA for 87fecf1

• save stream to a different file doesnt work yet

  KeplerC

  committed
  b4254e8

  Copy full SHA for b4254e8

• Refactor VLALoader class to update file path for loading VLA data

  KeplerC

  committed
  058fd5b

  Copy full SHA for 058fd5b

Commits on Aug 26, 2024

• Refactor DatasetHandler to clear OS cache after loading data

  KeplerC

  committed
  1a3bee4

  Copy full SHA for 1a3bee4

• Refactor Trajectory class to improve code readability and add lazy loading for data

  KeplerC

  committed
  a8a05ef

  Copy full SHA for a8a05ef

• Refactor prepare function for improved code readability and consistency

  KeplerC

  committed
  c866200

  Copy full SHA for c866200

• Refactor VLAHandler.measure_loading_time() to recursively load h5 data and add option to add to trajectories

  KeplerC

  committed
  6e9c5bf

  Copy full SHA for 6e9c5bf

• Refactor Trajectory class to improve code readability and add lazy loading for data

  KeplerC

  committed
  1cfcc27

  Copy full SHA for 1cfcc27

• Refactor Trajectory class to improve code readability and add lazy loading for data

  KeplerC

  committed
  975c4e5

  Copy full SHA for 975c4e5

• Refactor RLDSLoader class to improve code readability and add lazy loading for data

  KeplerC

  committed
  e83e6da

  Copy full SHA for e83e6da

• fix tf record's benchmark to read the data

  KeplerC

  committed
  4ba6453

  Copy full SHA for 4ba6453

• support no cache baseline

  KeplerC

  committed
  2c4d797

  Copy full SHA for 2c4d797

• add visualization results

  KeplerC

  committed
  1cb9ee5

  Copy full SHA for 1cb9ee5

Commits on Aug 27, 2024

• add DL dataset

  KeplerC

  committed
  d14c4ab

  Copy full SHA for d14c4ab

• add basic support for octo integration

  KeplerC

  committed
  d430709

  Copy full SHA for d430709

• fix a bug in loading

  KeplerC

  committed
  3467b3f

  Copy full SHA for 3467b3f

• octo dataloader working

  KeplerC

  committed
  b79068a

  Copy full SHA for b79068a

• Refactor RLDSLoader and Trajectory classes to improve code readability and add lazy loading for data

  KeplerC

  committed
  5600985

  Copy full SHA for 5600985

• Refactor RLDSLoader and Trajectory classes to improve code readability and add lazy loading for data

  KeplerC

  committed
  1f445df

  Copy full SHA for 1f445df

Commits on Aug 30, 2024

• open x dataset converter streamline

  KeplerC

  committed
  0333a09

  Copy full SHA for 0333a09

• support both lossy and lossless compression

  KeplerC

  committed
  d5c7332

  Copy full SHA for d5c7332

• chore: Update DEFAULT_DATASET_NAMES in openx.py and add lossy_compression parameter in Trajectory class

  KeplerC

  committed
  1567b44

  Copy full SHA for 1567b44

• chore: Update vla_to_h5.py to process VLA data and convert it to HDF5 format

  KeplerC

  committed
  3953f7f

  Copy full SHA for 3953f7f

• Refactor RLDSLoader and Trajectory classes to improve code readability and add lazy loading for data

  KeplerC

  committed
  3fcfc43

  Copy full SHA for 3fcfc43

• Refactor RLDSLoader and Trajectory classes for improved code readability and lazy loading of data

  KeplerC

  committed
  c0a840f

  Copy full SHA for c0a840f

• fix the logging; before randomly access

  KeplerC

  committed
  8e0b188

  Copy full SHA for 8e0b188

• add random loading

  KeplerC

  committed
  a0e813a

  Copy full SHA for a0e813a

Commits on Aug 31, 2024

• async write to cache

  KeplerC

  committed
  143a4fe

  Copy full SHA for 143a4fe

• support dataloader, still has bugs

  KeplerC

  committed
  b13ae79

  Copy full SHA for b13ae79

• support lerobot

  KeplerC

  committed
  305d8b6

  Copy full SHA for 305d8b6

• Refactor RLDSLoader and Trajectory classes to improve code readability and lazy loading of data

  KeplerC

  committed
  604486c

  Copy full SHA for 604486c

• write as pytorch dataloader

  KeplerC

  committed
  466c5cb

  Copy full SHA for 466c5cb

• multi proces to sped up

  KeplerC

  committed
  eccf7b2

  Copy full SHA for eccf7b2

• chore: Refactor Trajectory class for improved code readability and efficient multi-processing

  KeplerC

  committed
  e4913b1

  Copy full SHA for e4913b1

• Refactor Trajectory and VLAIterableDataset classes for improved code readability and performance

  KeplerC

  committed
  01841ee

  Copy full SHA for 01841ee

Commits on Sep 1, 2024

• fix rlds and add debug

  KeplerC

  committed
  5f5d328

  Copy full SHA for 5f5d328

• Refactor DatasetHandler class for improved code readability and performance

  KeplerC

  committed
  c4d7150

  Copy full SHA for c4d7150

Commits on Sep 2, 2024

• Refactor evaluation script for improved code organization and performance

  KeplerC

  committed
  fcd8f2d

  Copy full SHA for fcd8f2d

• Refactor evaluation script for improved code organization and performance

  KeplerC

  committed
  3516491

  Copy full SHA for 3516491

• Refactor VLA loader to use PyTorch dataloader for improved code readability and performance

  KeplerC

  committed
  d264839

  Copy full SHA for d264839

• Refactor loader modules to improve code organization and performance

  KeplerC

  committed
  79117e6

  Copy full SHA for 79117e6

• Refactor LeRobotLoader to load one episode at a time for improved performance and memory efficiency

  KeplerC

  committed
  0670995

  Copy full SHA for 0670995

• Refactor LeRobotLoader to load one episode at a time for improved performance and memory efficiency

  KeplerC

  committed
  e618571

  Copy full SHA for e618571

• Refactor RLDSLoader and HDF5Loader to use smaller shuffle buffer sizes for improved performance and memory efficiency

  KeplerC

  committed
  066abe9

  Copy full SHA for 066abe9

• fix bugs that prevents rlds and lr to move forward after iterating through the dataset

  KeplerC

  committed
  74d6c38

  Copy full SHA for 74d6c38

Commits on Sep 3, 2024

• fix size issue

  KeplerC

  committed
  47bce7e

  Copy full SHA for 47bce7e

• backward support octo and rlds conversion

  KeplerC

  committed
  f14a943

  Copy full SHA for f14a943

Commits on Sep 7, 2024

• fix bug of resizing width

  KeplerC

  committed
  04f3b4a

  Copy full SHA for 04f3b4a

Commits on Sep 10, 2024

• data, etc.

  KeplerC

  committed
  0a0542d

  Copy full SHA for 0a0542d

Commits on Sep 18, 2024

• submitted version

  KeplerC

  committed
  a35a695

  Copy full SHA for a35a695

• Merge branch 'mkv' of https://github.com/BerkeleyAutomation/fog_x into mkv

  KeplerC

  committed
  3868a85

  Copy full SHA for 3868a85