-
When I do something like
Does it automatically do something like |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Yes. The graph for that dataset is computed all at once so intermediaries are shared, and data is only read once. This is not caching though. For that you need to turn on the cache: https://docs.dask.org/en/latest/caching.html#automatic-opportunistic-caching and then you may see speedups when repeatedly accessing the same data. |
Beta Was this translation helpful? Give feedback.
Yes. The graph for that dataset is computed all at once so intermediaries are shared, and data is only read once.
This is not caching though. For that you need to turn on the cache: https://docs.dask.org/en/latest/caching.html#automatic-opportunistic-caching and then you may see speedups when repeatedly accessing the same data.