Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

review predicted probability section #18

Open
norcalbiostat opened this issue Dec 1, 2022 · 2 comments
Open

review predicted probability section #18

norcalbiostat opened this issue Dec 1, 2022 · 2 comments

Comments

@norcalbiostat
Copy link
Owner

choosing a cutoff value with "max" accuracy is picking a value that is actually the max predicted probability. Not the value of the max accuracy

@norcalbiostat
Copy link
Owner Author

no, its working fine. the example sucks.

@norcalbiostat
Copy link
Owner Author

Because you have so much overlap between the distributions of predicted probabilities the accuracy value (True Pos + True Neg) / N is really at it's max if everything is classified as "eating 1-2 F/V".
Since there are fewer data points overall in the 3+ group, it doesn't matter if you mis-classify ALL of them as eating 1-2FV, you'll still have a higher % accuracy than if you used any lower cut point.

Explain this example better and then find another example where moving the cutpoint actually helps.

@norcalbiostat norcalbiostat reopened this Dec 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant