You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now, when generating TPC-H data, one huge row group / record batch is created with all of the data. Arrow should be able to handle that "ok" but it doesn't right now and that is perhaps not as realistic a scenario. Perhaps group the data into row groups of size 1M. The writers should have options to control row group / record batch size even if the input to the writer is one huge table.
The text was updated successfully, but these errors were encountered:
Right now, when generating TPC-H data, one huge row group / record batch is created with all of the data. Arrow should be able to handle that "ok" but it doesn't right now and that is perhaps not as realistic a scenario. Perhaps group the data into row groups of size 1M. The writers should have options to control row group / record batch size even if the input to the writer is one huge table.
The text was updated successfully, but these errors were encountered: