Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RL Experiments #216

Draft
wants to merge 51 commits into
base: main
Choose a base branch
from
Draft

RL Experiments #216

wants to merge 51 commits into from

Conversation

flowerthrower
Copy link
Collaborator

This is an experimental PR. It is used to document my progress on various RL-related experiments.
One idea is to incorporate graph neural networks into the RL framework.
Another way to improve the RL agent is by adjusting the input features or the reward strategy.

src/mqt/predictor/ml/GNN.py Fixed Show fixed Hide fixed
src/mqt/predictor/ml/GNNclassifier.py Fixed Show fixed Hide fixed
src/mqt/predictor/evaluation.py Fixed Show fixed Hide fixed
src/mqt/predictor/evaluation.py Fixed Show fixed Hide fixed
tests/test_evaluation.py Fixed Show fixed Hide fixed
src/mqt/predictor/ml/predictor.py Fixed Show fixed Hide fixed
src/mqt/predictor/ml/predictor.py Fixed Show fixed Hide fixed
tests/compilation/test_predictor_rl.py Fixed Show fixed Hide fixed
tests/compilation/test_predictor_rl.py Fixed Show fixed Hide fixed
}

# Update defaults with provided kwargs
self.set_params(**kwargs)

Check warning

Code scanning / CodeQL

`__init__` method calls overridden method Warning

Call to self.
set_params
in __init__ method, which is overridden by
method MultiGNNClassifier.set_params
.
]
last_hidden_dim = self.output_dim

self.out_nn = nn.Sequential(nn.Linear(last_hidden_dim, self.output_dim), self.activation_func)

Check failure

Code scanning / CodeQL

Potentially uninitialized local variable Error

Local variable 'last_hidden_dim' may be used before it is initialized.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant