Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add configurable counterfeit plugin to evaluate optimizer scalability #1

Open
sekruse opened this issue Oct 23, 2017 · 0 comments
Open
Assignees

Comments

@sekruse
Copy link
Member

sekruse commented Oct 23, 2017

In order to evaluate the optimizer scalability w.r.t. the number Platforms/Plugins registered with Rheem, this issue proposes to introduce a configurable counterfeit Plugin.

There are two components of the optimizer that are particularly susceptible to the number of Platforms:

  1. The plan enumeration component likely declines in performance as there are more alternative plans to consider. This is particularly governed by the number of alternatives for each Rheem operator.
  2. The data movement planning is likely affected by the size and density of the ChannelConversionGraph.

Now the main idea of the counterfeit plugin is to add one or more Platforms to the RheemContext, thereby providing new OperatorMappings and new ChannelConversions. This should be done in a configurable manner.

@sekruse sekruse self-assigned this Oct 23, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant