Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize create table from external iceberg/ delta/ parquet files #61

Open
zhousun opened this issue Dec 31, 2024 · 1 comment
Open
Labels
feature good first issue Good for newcomers
Milestone

Comments

@zhousun
Copy link
Contributor

zhousun commented Dec 31, 2024

What feature are you requesting?

Create a columnstore table by shallow copying the files without duplicating or rewriting them.

Why are you requesting this feature?

Allow using extenal engine to ingest large volume of data to a columnstore table without going through postgres..

What is your proposed implementation for this feature?

No response

@zhousun zhousun added good first issue Good for newcomers feature labels Dec 31, 2024
@dpxcc dpxcc added this to the tbd milestone Jan 5, 2025
@ritwizsinha
Copy link

@zhousun please assign. I am not exactly sure where the processing is happening for copying data from a large external store. Is it not the createTable function?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

3 participants