Skip to content
This repository has been archived by the owner on Aug 13, 2024. It is now read-only.

Add support for splittable extracting #1

Open
alexanderdean opened this issue Jun 28, 2017 · 4 comments
Open

Add support for splittable extracting #1

alexanderdean opened this issue Jun 28, 2017 · 4 comments

Comments

@alexanderdean
Copy link

Please close if this has already been done!

This is referring to the way you can write an extractor to deal with a partial file.

@devesh-shetty
Copy link
Contributor

@alexanderdean , do you mean dealing with distributed files?

@alexanderdean
Copy link
Author

No, @stuartleeks can explain...

@devesh-shetty
Copy link
Contributor

Hey @alexanderdean, Do you want to extract individual rows instead of the entire tsv (consisting of multiple rows) at once?

@alexanderdean
Copy link
Author

It's about extracting 4Gb chunks of a file at a time, but I can't find the reference online. Stuart can explain, leave this ticket until he does!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants