You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Which reads all attributes stored in path and then it is filtered by BlogLogReader just for requested.
This solution can be suboptimal for some FileFormats (eq parquet), where we can use for example push down filters and read just block which contains requested attributes.
We should probably pass list of requested attributes directly into FileFormat which allows to read file more effectively.
The text was updated successfully, but these errors were encountered:
Currently we have this signature in
FileFormat
interfaceWhich reads all attributes stored in
path
and then it is filtered by BlogLogReader just for requested.This solution can be suboptimal for some FileFormats (eq parquet), where we can use for example push down filters and read just block which contains requested attributes.
We should probably pass list of requested attributes directly into
FileFormat
which allows to read file more effectively.The text was updated successfully, but these errors were encountered: