Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate Python Data Structures for TX EBCDIC Files defined by Cobol data grammar #36

Open
wants to merge 23 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 18 commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
3d28113
Work to write an ANTLR parser to suck out the data structure so that it
markfyoung0711 May 17, 2024
7e45a23
parse and add usage to Symbol
markfyoung0711 May 19, 2024
91cc4f5
Derive the Listener specializations for my applications (which only i…
markfyoung0711 May 21, 2024
c15e9b5
add link to the cobol parser work from README.md, add struct format f…
markfyoung0711 May 21, 2024
11bdd31
try updating
markfyoung0711 May 21, 2024
9b0684d
try updating
markfyoung0711 May 21, 2024
c94297d
try updating
markfyoung0711 May 21, 2024
227cff5
try updating
markfyoung0711 May 21, 2024
05ae4f7
try updating
markfyoung0711 May 21, 2024
73096ed
try updating
markfyoung0711 May 21, 2024
fc73571
try updating
markfyoung0711 May 21, 2024
dadc16b
no need for dataclass for Symbol/SymbolTable
markfyoung0711 May 21, 2024
e01c155
occurs number of times should be an int
markfyoung0711 May 22, 2024
bc778c0
occurs flush was not cleaning up properly. now it is
markfyoung0711 May 22, 2024
d6429a3
clean up occurs vars after flush
markfyoung0711 May 22, 2024
999da62
start the work to remove underlying redefineds
markfyoung0711 May 22, 2024
11beacf
repr same as str for Symbol
markfyoung0711 May 22, 2024
98ef966
initial scraper for TX RRC Datasets: rrc_scrape.py
markfyoung0711 May 23, 2024
1df25cf
Dockerfile added for app inclusion on GCP.
markfyoung0711 May 26, 2024
124b1b1
more requirements now with new code
markfyoung0711 May 28, 2024
e387c69
add columns to symbol table
markfyoung0711 May 29, 2024
48f5080
record types yaml needs record type number as key
markfyoung0711 May 30, 2024
81f113f
gather all the records into a dataframe, and concat into one
markfyoung0711 May 30, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -86,3 +86,11 @@ https://github.com/mlbelobraydi/TXRRC_data_harvest/wiki/TXRRC-Data-Source-Refere
If this code isn't what you are looking for, here is a list of other TXRRC projects on github.

https://github.com/mlbelobraydi/TXRRC_data_harvest/wiki/Similar-projects

## Generation of Python struct from Cobol Copybook Parser

The RRC datasets have PDF files that define the COBOL Copybook statements.
It would be nice to be able to pass these copybook fragments into a python tool
that would then generate the struct format for parsing the raw binary stream.

The work under [Cobol Parser](src/cobol_parser.md) addresses this desire.
Loading