Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to evaluate the robustness of a model #4

Open
mpascariu opened this issue Dec 1, 2018 · 0 comments
Open

How to evaluate the robustness of a model #4

mpascariu opened this issue Dec 1, 2018 · 0 comments
Labels
help wanted Extra attention is needed

Comments

@mpascariu
Copy link
Owner

mpascariu commented Dec 1, 2018

Everybody is talking about robustness but nobody is checking/measuring/writing/publishing about it. What it is this animal called "robustness"?

The package contains an attempted to measure it in the same way the accuracy is assessed. We understand that a model is robust if the estimates and generated results are fairly stable following gradual changes in input data or model specification.

What if the results are changing to little following a reasonable change in the input data? Is this model more robust than a model that changes in a "proportional" manner? What if the changes are to large? When is "to large" to large?

We are interested to learn about the best practices and implement them here. Help.

@mpascariu mpascariu added the help wanted Extra attention is needed label Dec 1, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant