Replication Markets retweeted
Anyone have favorite references re: doing meta-analysis well?
This quoted post is unavailable.
Replication Markets retweeted
This is crucial. So precisely how do we change these incentives? Pressure grant-makers and journal editors to create open-science requirements?
Replying to @LauraK_Nelson
The biggest roadblock? As a junior scholar, I take on all the risk in doing this - loads of time and effort and potential critique - with virtually no reward. The incentive structure must change. Open science / open scholarship benefits everyone. Let's reward that work 🙏
Replication Markets retweeted
Like prediction markets? Like free money?
@ReplicationMkts is running a prediction market on whether COVID preprints will be published, cited, etc., and per the study design, the ones that have *already* been published are in play too. Sign up and trade! reddit.com/r/ReplicationMark…
Replication Markets retweeted
Check out the new @theAAG Annals Forum articles on #Reproducibility and #Replicability in geospatial research including an article co-authored by #Esri product engineer Kevin Butler & Chief Scientist @deepseadawn sgsup.asu.edu/forum-articles…
Replication Markets retweeted
Will COVID-19 research replicate? Replication Markets forecasts ~63% will be confirmed by replication.
Our sample is social and behavioral science research selected as part of DARPA SCORE, we make no claims about its generalizability. replicationmarkets.com/index… THREAD🧵
Replication Markets retweeted
Curious about #COVID19 related social science? Perhaps you have concerns about its rigor? @ReplicationMkts is predicting which of 100 pre-prints will successfully replicate. Sign up here: replicationmarkets.com/ because we could use your judgment. Yes *your* judgment! ...
Replication Markets retweeted
I'm proud to have contributed to this paper on community forecasts of replication rates. Most credit goes to @michaelbg01 and @DViganola and also to ALL my @ReplicationMkts colleagues. A few thoughts below: 1/8
Replying to @michaelbg01
We basically found that the community expects that replicability rates to increase over time (2009-2018) and that some fields clearly have more reproducible research than others
Replication Markets retweeted
Book recommendation: Science Fictions: How Fraud, Bias, Negligence and Hype Undermine the Search for Truth by @StuartJRitchie All these factors ^^ make science less replicable, which is where replicationmarkets.com/ comes in... sign up: to help predict replicability (& win $)
Replication Markets retweeted
Why is it so rarely noted that forecasting is actually crucial to informing all kinds of policy? Traditional social science and policy research is great for understanding what happened in the past, but decision-making requires predicting what is going to happen (if we do X)? 1/n
Replication Markets retweeted
#ButWillitReplicate? is a question worth asking in every field, including machine learning. wired.com/story/artificial-i… @ReplicationMkts @yangl1u though the implications will vary based on context.
Replication Markets retweeted
Our 2020 Advanced Methods for Reproducible Science workshop is now open for applications: bristol.ac.uk/psychology/res… @deevybee @chrisdc77 @MarcusMunafo Please RT!
Replication Markets retweeted
e.g. this study has p < 0.05 but p_market is 0.65 indicating only a 35% chance of the result replicating.
The question is will the incentive correctly propagate to those who spread information (i.e. the press). I worry that it might not - people like fantasy more than truth!









