ManyClasses

ManyClasses 2 is now released as a preprint! 🥳 osf.io/preprints/psyarxiv/3x…

The generalizability crisis commentaries are out (including ours; doi.org/10.1017/S0140525X210…). Eager to see what generalizes!

Throwback to two years ago, February 2020, hours each day manually coding moderators. Fun times!

ManyClasses stickers! We've got about 30 extras, and we'd love to share them with our Twitter followers. No initiation or payment required. Send us your mailing address by DM.

You took the words right out of our mouths. 🙂

Good question! You could calculate it if you wanted! Outcome data available at osf.io/g7q4w/ ... We were sensitive to the shortcomings of heterogeneity metrics, and instead just directly estimated and visualized class-/condition-level variance.

Looking deeper, we found hints of possible benefits for delayed feedback in classes with open-ended test questions and/or with lots of quizzes, but these classes were rare, and these patterns did not meet our threshold for drawing clear inferences. 10/19

We also ran analyses of 40 different candidate moderators, and found no strong evidence of differences in the effects of feedback timing between students or class designs -- but with 38 classes, class-level moderator analyses are kinda underpowered. 9/19

So what did we find? Our analysis found no generalizable effect of feedback timing across these 38 classes. It wasn't that there was uncertainty in our global estimate -- we found a global effect of feedback timing that was tight around zero. 8/19

Knew it'd be a good day with "Lunch with @BrianNosek" on the calendar! @BenMotz, @Boreel3, not tagged: Janelle Sherman