Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Assignment 5 & 6: ask students to report point estimates #7

Open
ninpnin opened this issue Oct 16, 2023 · 2 comments
Open

Assignment 5 & 6: ask students to report point estimates #7

ninpnin opened this issue Oct 16, 2023 · 2 comments

Comments

@ninpnin
Copy link
Collaborator

ninpnin commented Oct 16, 2023

In Assignments 5 and 6, we ask the students to sample from the same Bioassay posterior with Metropolis-Hastings and Stan, respectively.

In neither of these assignments is reporting eg. the posterior mean required. I think it would make solving the assignment more straightforward, and grading more fair.

Assignment 6

For example, in Assignment 6 we grade according to this:

Does the implemented Stan-model seem to be working?
No implementation
Model implemented but results not visualized/reported (1p)
Model implemented, but the results seem weird (1p)
Model seems to work correctly

It's sometimes difficult to give a fair grade, especially if the results are not numerically summarized (which we don't require).

I think a better and fairer grading would be

Does the implemented Stan-model yield correct results?
No implementation (0p)
Model implemented but results not visualized/reported (1p)
Results are incorrect due to a minor mistake (2p)
Yes, and the posterior means are roughly [...] for alpha and [...] for beta (3p)

Moreover, we would add Report the results of the sampling, including posterior means for alpha and beta to task 1.

Assignment 5

In assignment 5, we could simply add a question

Are the posterior means roughly [...] for alpha and [...] for beta?
No (0p)
Yes (1p)

Moreover, we would add Also report the posterior means for alpha and beta to task 2 or 4.

@MansMeg
Copy link
Owner

MansMeg commented Oct 16, 2023

I think this are two excellent ideas. Then we can just compute the true value in the teacher repo to compare with. I think this might be good if you would do a PR to this repo and to the teacher repo.

@MansMeg
Copy link
Owner

MansMeg commented Oct 28, 2024

Has this been fixed @ninpnin ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants