Assignment 8

S1 · 7.5 points

Basic requirements

Q1 · Yes / No · 1 point

Can you open the pdf and it’s not blank?

Q2 · Yes / No · 1 point

Is the report anonymous?

S2 · 85 points

Model assessment: LOO-CV for factory data with Stan

Q3 · Yes / No · 1 point

Is the source code included?

Q4 · Scale · 1 point

Are the PSIS-LOO values correctly calculated? The correct values are approximately: pooled: -XXX, separate: -XXX, hierarchical: -XXX.

  • None correct
  • One correct
  • Two correct
  • All correct

Q5 · Scale · 1 point

Are the k-values reported (visualized or tabulated) for each of the three models?

  • None
  • For one model
  • For two models
  • For all the models

Q6 · Scale · 1 point

Are the p_eff values correctly calculated? The correct values are approximately: pooled: X.X, separate: X.X, hierarchical: X.X.

  • None correct
  • One correct
  • Two correct
  • All correct

Q7 · Scale · 1 point

Is the interpretation of the k-values correct? Correct interpretation (roughly): 1) all k < XX 2) some k > XX 3) several k > XX

Q8 · Scale · 1 point

Are the obtained values interpreted right, that is, is the model with highest PSIS-LOO value selected?

  • No interpretation/discussion
  • Some results missing/wrong, and wrong interpretation
  • Results correct but interpretation wrong
  • Some results missing/wrong, but the interpretation is correct (based on the results obtained)
  • Results correct and interpretation correct

S3 · 7.5 points

Overall quality of the report

Q9 · Scale · 1 poDoes the report follow the formatting instructions?

  • Not at all
  • Little
  • Mostly
  • Yes

Q10 -

In case the report doesn’t fully follow the formatting instructions, specify the formatting instruction that is not followed. If applicable, specify the page of the report, where this difference in formatting is visible.

Q11 -

Please provide also feedback on the presentation (e.g. text, layout, flow of the responses, figures, figure captions). Part of the course is practicing making data analysis reports. By providing feedback on the report presentation and other students can learn what they can improve or what they already did well. You should be able to provide constructive or positive feedback for all non-empty reports, even if there is nothing to say about the technical correctness of the answers. You can also provide feedback on code.