Code

IO Package refactor#172

Code

Open

javihern98 wants to merge 63 commits intodevelopbis-med-it/pysdmx:developfrom io_refactorbis-med-it/pysdmx:io_refactorCopy head branch name to clipboard

+19,121-2,204

Commits

Commits on Dec 18, 2024

• Draft code for read_sdmx.

  Show description for 3664415
  javihern98

  committed
  3664415

  Copy full SHA for 3664415

• Merge branch 'develop' into 156-add-read_sdmx-convenience-method

  javihern98

  authored
  bdf8145

  Copy full SHA for bdf8145

Commits on Dec 19, 2024

• Refactored code on Message class to move submission and ActionType to their classes. Added read_sdmx method to reader

  Show description for 2d87af7
  javihern98

  committed
  2d87af7

  Copy full SHA for 2d87af7

• Linting and mypy changes

  Show description for 617aa4c
  javihern98

  committed
  617aa4c

  Copy full SHA for 617aa4c

• Refactored code to ensure we use the Short URN as keys of the message content. Use ItemReference as ConceptIdentity if necessary. Fixed tests accordingly.

  Show description for 2c2cab3
  javihern98

  committed
  2c2cab3

  Copy full SHA for 2c2cab3

• Added tests for read_sdmx with csv files.

  Show description for ffb2a8e
  javihern98

  committed
  ffb2a8e

  Copy full SHA for ffb2a8e

• Linting and mypy changes.

  Show description for 01f5489
  javihern98

  committed
  01f5489

  Copy full SHA for 01f5489

• Adapted structures tests to reach max code coverage

  Show description for ab63f01
  javihern98

  committed
  ab63f01

  Copy full SHA for ab63f01

• Removed unique_id method and adapted code to use Reference.

  Show description for 8b960d2
  javihern98

  committed
  8b960d2

  Copy full SHA for 8b960d2

• Added utils methods and classes to all.

  Show description for 41e7a8d
  javihern98

  committed
  41e7a8d

  Copy full SHA for 41e7a8d

• Adapted tests for input processor to max code coverage.

  Show description for b140de0
  javihern98

  committed
  b140de0

  Copy full SHA for b140de0

• Adapted tests for read_sdmx to max code coverage.

  Show description for 0c03933
  javihern98

  committed
  0c03933

  Copy full SHA for 0c03933

• Added tag to concept and itemReference to avoid serialization issues.

  Show description for f567c50
  javihern98

  committed
  f567c50

  Copy full SHA for f567c50

• Merge remote-tracking branch 'refs/remotes/origin/develop' into 156-add-read_sdmx-convenience-method

  Show description for 85076af
  javihern98

  committed
  85076af

  Copy full SHA for 85076af

• Fixed message imports to prevent circular imports. Ruff automatic fixes. Added get_datasets methods. Maxed code coverage in all code.

  Show description for fe1fbb4
  javihern98

  committed
  fe1fbb4

  Copy full SHA for fe1fbb4

Commits on Jan 9, 2025

• Read and write XML methods added (as requested, the write method has been split into write data and metadata). Read and write XML tests updated to work with the new methods.

  mla2001

  committed
  8afd68b

  Copy full SHA for 8afd68b

• Fixed ruff errors.

  mla2001

  committed
  5417e73

  Copy full SHA for 5417e73

• Fixed mypy errors.

  mla2001

  committed
  6e9ec54

  Copy full SHA for 6e9ec54

• Fixed read Path input error.

  mla2001

  committed
  386af2f

  Copy full SHA for 386af2f

• Adapted ReadSDMX to infer the format automatically.

  Show description for 6b6886f
  javihern98

  committed
  6b6886f

  Copy full SHA for 6b6886f

• Linting changes.

  Show description for b6e6200
  javihern98

  committed
  b6e6200

  Copy full SHA for b6e6200

• Renamed ReadFormat to SDMXFormat. Added Submission and Error formats detection on SDMX-ML. Fixed tests.

  Show description for 03dd8ad
  javihern98

  committed
  03dd8ad

  Copy full SHA for 03dd8ad

Commits on Jan 10, 2025

• Ignored mypy error.

  Show description for bd27711
  javihern98

  committed
  bd27711

  Copy full SHA for bd27711

• Added to_schema method to DataStructureDefinition. Draft code for get_datasets method.

  Show description for 5818c40
  javihern98

  committed
  5818c40

  Copy full SHA for 5818c40

• Replaced whole URN to Short URN in Dataset. Added tests to match coverage.

  Show description for 6a4bac7
  javihern98

  committed
  6a4bac7

  Copy full SHA for 6a4bac7

• Added get_datasets to io

  Show description for d38ed7f
  javihern98

  committed
  d38ed7f

  Copy full SHA for d38ed7f

• Added URL parsing support on read_sdmx. Made httpx a mandatory dependency.

  Show description for e2b2946
  javihern98

  committed
  e2b2946

  Copy full SHA for e2b2946

• Merge branch 'develop' into 156-add-read_sdmx-convenience-method

  javihern98

  authored
  4eca815

  Copy full SHA for 4eca815

• Updated poetry lock.

  Show description for 183fe4d
  javihern98

  committed
  183fe4d

  Copy full SHA for 183fe4d

• Merge remote-tracking branch 'origin/156-add-read_sdmx-convenience-method' into 156-add-read_sdmx-convenience-method

  javihern98

  committed
  d8fa929

  Copy full SHA for d8fa929

• Updated XML reader and writers with the new signature. Refactored tests to work with the new reader and writers.

  mla2001

  committed
  4ab5896

  Copy full SHA for 4ab5896

• Fixed XML read return typing.

  mla2001

  committed
  d197d44

  Copy full SHA for d197d44

• Fixed most ruff errors.

  mla2001

  committed
  4be7535

  Copy full SHA for 4be7535

• Fixed all ruff errors.

  mla2001

  committed
  a78dca6

  Copy full SHA for a78dca6

• Fixed all mypy errors.

  mla2001

  committed
  0a79372

  Copy full SHA for 0a79372

• Updated poetry lock and used correct version of httpx. Updated tests with mocks.

  Show description for 3b48f9e
  javihern98

  committed
  3b48f9e

  Copy full SHA for 3b48f9e

• 100% code coverage.

  mla2001

  committed
  3ea8431

  Copy full SHA for 3ea8431

• Fixed all ruff errors.

  mla2001

  committed
  1544afb

  Copy full SHA for 1544afb

• Added validate flag to get_datasets.

  Show description for ed6303a
  javihern98

  committed
  ed6303a

  Copy full SHA for ed6303a

• Fixed mypy errors. Fixed all errors.

  mla2001

  committed
  eb7038a

  Copy full SHA for eb7038a

• Merge branch 'develop' into 164-checking-for-inconsistencies-in-parsers-and-writers-methods

  mla2001

  authored
  e26e1ee

  Copy full SHA for e26e1ee

• Update test_reader.py

  mla2001

  authored
  2a4ceb3

  Copy full SHA for 2a4ceb3

• Fixed all errors.

  mla2001

  committed
  c7f3d14

  Copy full SHA for c7f3d14

• Restored fixes for reading at best effort basis.

  Show description for 8341e65
  javihern98

  committed
  8341e65

  Copy full SHA for 8341e65

Commits on Jan 13, 2025

• Refactor on method names to make it private, signature of structures writing and removing redundancies

  Show description for 85bc5ea
  javihern98

  committed
  85bc5ea

  Copy full SHA for 85bc5ea

• Merge remote-tracking branch 'refs/remotes/origin/164-checking-for-inconsistencies-in-parsers-and-writers-methods' into io_refactor

  Show description for f6df667
  javihern98

  committed
  f6df667

  Copy full SHA for f6df667

• Refactor on message to use Sequence[...] objects.

  Show description for 53ac3e6
  javihern98

  committed
  53ac3e6

  Copy full SHA for 53ac3e6

• Draft code on SDMX-ML 2.1 readers refactor to be consistent with writers file structure.

  Show description for f78463c
  javihern98

  committed
  f78463c

  Copy full SHA for f78463c

• Draft code on input processing. Added dataflow support to get_datasets.

  Show description for a527de0
  javihern98

  committed
  a527de0

  Copy full SHA for a527de0

• Removed inconsistencies on read signature. Fixed input data on each XML reader. Added some error handling if a wrong SDMX message is used as input.

  Show description for 09fbb8c
  javihern98

  committed
  09fbb8c

  Copy full SHA for 09fbb8c

• Fixed mypy errors before testing.

  Show description for af4ecc7
  javihern98

  committed
  af4ecc7

  Copy full SHA for af4ecc7

• Changed short_urn to property in MaintainableArtefact.

  Show description for f84d234
  javihern98

  committed
  f84d234

  Copy full SHA for f84d234

• Added property short_urn to DataStructureDefinition (sdmxtype must be DataStructure). Changed Submission to RegistryInterface. Added better documentation for structures formats. Fixed tests for io …

  Show description for a9af618
  javihern98

  committed
  a9af618

  Copy full SHA for a9af618

• Fixed tests on xml.

  Show description for 4cfcab7
  javihern98

  committed
  4cfcab7

  Copy full SHA for 4cfcab7

• Fixed message tests.

  Show description for 2363a61
  javihern98

  committed
  2363a61

  Copy full SHA for 2363a61

• Removed inconsistencies on SDMX-CSV writers by adding the datasets as a list.

  Show description for 885f1af
  javihern98

  committed
  885f1af

  Copy full SHA for 885f1af

• Cleaned up code. Added tests for Coverage.

  Show description for 3a18798
  javihern98

  committed
  3a18798

  Copy full SHA for 3a18798

• Replaced MessageType to SDMXFormat. Fixed tests.

  Show description for 3cbde9f
  javihern98

  committed
  3cbde9f

  Copy full SHA for 3cbde9f

• Mypy fix.

  Show description for 8105528
  javihern98

  committed
  8105528

  Copy full SHA for 8105528

• Docs updated

  Show description for b16b2c6
  javihern98

  committed
  b16b2c6

  Copy full SHA for b16b2c6

• Updated signature on input processor

  Show description for fd1c3f3
  javihern98

  committed
  fd1c3f3

  Copy full SHA for fd1c3f3

Commits on Jan 16, 2025

• Fixed typo on write function in csv.

  Show description for d14d5db
  javihern98

  committed
  d14d5db

  Copy full SHA for d14d5db

• Separated enumeration of SDMX JSON into Data and Structures

  Show description for f8e2815
  javihern98

  committed
  f8e2815

  Copy full SHA for f8e2815