On the Robustness of Statistical Results to Data Exclusion in T Tests
online.ucpress.edu/collabra/article/12/1/169367/219241/On…
Jelte Wicherts
Jelte Michiel Wicherts (born September 13, 1976) is a Dutch psychologist and a professor in the Tilburg School of Social and Behavioral Sciences at Tilburg University. His research interests include biases in decision-making, as well as scientific misconduct and reproducibility. He has also studied group differences in IQ scores and the Flynn effect. More on Wikipedia
-
Jelte Wicherts
@JelteWicherts
-
Jelte Wicherts
@JelteWicherts
In @elife: Responsible Research Assessment of Faculty: maximizing quality, transparency, and trustworthiness of scientific research in Research-Performing Organizations doi.org/10.7554/eLife.112683.1
-
Jelte Wicherts
@JelteWicherts
The ultimate guide to reanalysis dx.doi.org/10.1111/spc3.70152
-
Jelte Wicherts
@JelteWicherts
Come on, Scopus/Elsevier….this ain’t the right title.
Put a leash on your AI puppy!
doi.org/10.1037/edu0000965 -
Jelte Wicherts
@JelteWicherts
Classic educational psychology on scaffolding fails to replicate. doi.org/10.1037/edu0000965
-
Jelte Wicherts
@JelteWicherts
What it takes to tutor—A preregistered direct replication of the scaffolding experimental study by D. Wood et al. (1978). doi.org/10.1037/edu0000965
-
Jelte Wicherts
@JelteWicherts
Meta-analyzing the multiverse: A peek under the hood of selective reporting. doi.org/10.1037/met0000559
-
Jelte Wicherts
@JelteWicherts
The quality of qualitative research
royalsocietypublishing.org/doi/10.1098/rsos.242001 -
Jelte Wicherts reposted
Rolf Degen
@DegenRolf
The stereotype threat effect, once one of social psychology's pet theories, gets hammered in another large-scale replication failure.
Stereotype threat refers to the fear of being judged based on negative stereotypes about the performance of a certain group one identifies with. Numerous published studies have found that stereotype threat might lower mathematics test performance among women. However, many studies used suboptimal designs and analyses; the literature might be subject to publication bias; and the cross-cultural generalizability of the effect remains unknown.
This registered replication report describes the result of eight direct replications (total N = 1502) of a representative stereotype-threat study by Johns et al., who found that threatened women (but not men) underperform when they are confronted with a mathematics test that is presented to measure gender differences. Data were obtained by eight labs; three from the US and five from Europe (Germany, Austria, Slovakia, and The Netherlands).
We were unable to replicate a stereotype-threat effect, neither as the interaction between the stereotype-threat conditions and gender, nor as a simple main effect among women. The average effect size we found among women was virtually null, and, thus, substantially smaller than the originally reported effect size . Our null results are in line with the findings in preregistered (replication) studies.
The current results fail to replicate the stereotype-threat effect by Johns et al, hence casting doubt on the generalizability of the effect of stereotype threat on women’s mathematics performance. These results seem to be in line with previous notion that effects of stereotype threat as described in the published literature might have been inflated due to publication bias. -
Jelte Wicherts
@JelteWicherts
Implementing Statcheck During Peer Review Is Related to a Steep Decline in Statistical-Reporting Inconsistencies - Michèle B. Nuijten, Jelte M. Wicherts, 2024 journals.sagepub.com/doi/full/10.1177/25152459241258945
-
Jelte Wicherts reposted
Jelte Wicherts
@JelteWicherts
Vacancy: We are looking for two fully paid PhD students in methodology and statistics as part of my NWO-funded VICI project Examining Variation in Causal Effects in Psychology!
www.academictransfer.com/nl/338321/phd-position-in-method… -
Jelte Wicherts
@JelteWicherts
Vacancy: We are looking for two fully paid PhD students in methodology and statistics as part of my NWO-funded VICI project Examining Variation in Causal Effects in Psychology!
www.academictransfer.com/nl/338321/phd-position-in-method… -
Jelte Wicherts
@JelteWicherts
Nearly three-quarters of tested psychological scales failed the test of measurement invariance needed for meaningful group comparisons
psycnet.apa.org/record/2024-39319-001 -
Jelte Wicherts
@JelteWicherts
Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology @DenOlmo
link.springer.com/article/10.3758/s13428-023-02277-0 -
Jelte Wicherts
@JelteWicherts
In more than half of 459 preregistered studies, hypotheses were added, omitted, or changed in the published papers. @DenOlmo
journals.sagepub.com/doi/10.1177/25152459231187988 -
Jelte Wicherts
@JelteWicherts
Selective outcome reporting can be corrected in meta-analyses (subject to assumptions)
link.springer.com/article/10.3758/s13428-023-02132-2 -
Jelte Wicherts reposted
Retraction Watch
@RetractionWatch
“Implementing statcheck during peer review is related to a steep decline in statistical reporting errors.”
psyarxiv.com/qejhk/ -
Jelte Wicherts reposted
Physics Magazine
@PhysicsMagazine
“It is disheartening to see that even among…excellent early career researchers, misconduct and academic cheating appear common,” @JelteWicherts. Read the full story by @DalmeetS. physics.aps.org/articles/v16/90
-
Jelte Wicherts
@JelteWicherts
Supervisors matter for open science
doi.org/10.7554/eLife.83484 -
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
19% of 755 phase 3 cancer trials had changes to the primary end points in the paper compared to the registration.
70% of those were not disclosed in the paper.
Changes were associated with likelihood of a positive outcome (OR=1.86).
jamanetwork.com/journals/jamanetworkopen/fullarticle/2805005 -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology
The link to the preprint on @metaarxiv didn't work so I now uploaded it on OSF at osf.io/2m5zv
@lakens @EvoMellor @MamsMandrill @JelteWicherts
Olmo van den Akker
@DenOlmo
In the 2nd paper, we surprisingly found that preregistered studies did NOT have lower proportions of statistically significant results NOR lower effect sizes.
However, this may have been due to our selection of the control group. -
Jelte Wicherts
@JelteWicherts
Vacancy: two fully paid 4-year PhD positions in meta-research as part of the NWO-funded VICI project Examining Variation in Causal Effects in Psychology
tiu.nu/21562 -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
Did papers about COVID-19 (presumably written under high pressure) contain more statistical inconsistencies than non-COVID-19 papers?
Our natural experiment assessing more than 533 preprint pairs did not find evidence for this.
psyarxiv.com/asbfd -
Jelte Wicherts
@JelteWicherts
Arbitrary decisions in the analysis typically create thousands of potential outcomes in a single study
psycnet.apa.org/fulltext/2023-71132-001.html -
Jelte Wicherts
@JelteWicherts
Join our awesome team @TilburgU !
Two PhD positions in meta-research: Examining Variation in Causal Effects in Psychology www.academictransfer.com/en/327337/two-phd-positions-in-m… -
Jelte Wicherts
@JelteWicherts
Join our meta research group @TilburgU !
PhD position in meta-research @MicheleNuijten @PaulTwinMusic www.academictransfer.com/en/327067/phd-position-in-meta-r… -
Jelte Wicherts
@JelteWicherts
Data sharing upon request and statistical consistency errors in psychology: A replication of our earlier work. @PLOSONE dx.plos.org/10.1371/journal.pone.0284243
-
Jelte Wicherts reposted
Lieke Voncken
@LiekeVoncken
🚨PhD vacancy: "How trustworthy are simulation studies? A meta-research perspective"🚨
Robbie van Aert, @MALMvanAssen, and I are looking for a PhD student to improve (psychological) science as part of our Meta-Research Center @TilburgU.
More details: tiu.nu/21530 -
Jelte Wicherts reposted
Dalmeet Singh Chawla | ਦਲਮੀਤ ਸਿੰਘ ਚਾਵਲਾ
@DalmeetS
‘Spell-checker for statistics’ (statcheck) is reducing the number of errors in p-values creeping through during peer review — my latest for @Nature: www.nature.com/articles/d41586-023-00788-6 @MicheleNuijten @PsychScience @AnnaLSchubert @DGPs_Berlin
-
Jelte Wicherts reposted
nature
@Nature
‘Spell-checker for statistics’ reduces errors in the psychology literature go.nature.com/3mQ7mdz
-
Jelte Wicherts
@JelteWicherts
PhD position in meta-research: The effectiveness of interventions to improve psychological science www.academictransfer.com/en/324378/phd-position-in-meta-r…
-
Jelte Wicherts
@JelteWicherts
The Meta-Plot. A Graphical Tool for Interpreting the Results of a Meta-Analysis
econtent.hogrefe.com/doi/10.1027/2151-2604/a000513 -
Jelte Wicherts reposted
Tilburg University
@TilburgU
The NWO has awarded Professor of Methodology @JelteWicherts a Vici grant of 1,5 million euros for his research on differences in causal effects in experiments. He focuses on new psychometric, statistical, and methodological solutions: www.tilburguniversity.edu/current/news/more-news/nwo-vici… @TSBmedia @NWONieuws
-
Jelte Wicherts reposted
Tilburg University
@TilburgU
Psychology researchers often demand more evidence than is necessary to support hypothesis, finds @DenOlmo @TSB_Media. This leads to several problems such as valid research unjustly ending up in desk drawers. www.tilburguniversity.edu/current/news/more-news/scientis…
-
Jelte Wicherts reposted
Retraction Watch
@RetractionWatch
A way to “avoid statistical reporting errors” during peer review.
psyarxiv.com/bxau9 -
Jelte Wicherts
@JelteWicherts
Most psychology researchers interpret the results of multiple replication studies through naive vote counting
link.springer.com/article/10.3758/s13423-022-02235-5 @DenOlmo @MarjanBakker @MALMvanAssen -
Jelte Wicherts reposted
Dalmeet Singh Chawla | ਦਲਮੀਤ ਸਿੰਘ ਚਾਵਲਾ
@DalmeetS
Around 70% of researchers in Europe say they have been involved in projects that listed authors that didn’t contribute sufficiently — my latest for @Nature: www.nature.com/articles/d41586-023-00016-1 @NatureIndex @gowrigopala @NRIN_Integrity @WCRIFoundation @JelteWicherts
-
Jelte Wicherts
@JelteWicherts
How to protect privacy in open data
rdcu.be/cYYPz -
Jelte Wicherts
@JelteWicherts
Comparison of 459 preregistrations and papers shows that more than half of the preregistered studies contained omitted hypotheses (N = 224; 52.2%) or added hypotheses (N = 227; 56.8%), and about one-fifth of studies contain changed hypotheses (N = 82; 19%)
osf.io/preprints/metaarxiv/nf6mq/ -
Jelte Wicherts reposted
BITSS
@UCBITSS
Now on #metaarxiv: Robbie van Aert and @JelteWicherts published "Correcting for outcome reporting bias in a meta-analysis: A meta-regression approach." The researchers propose a new method (CORB) to correct for ORB. Link below:
osf.io/preprints/metaarxiv/bn8vd/ -
Jelte Wicherts
@JelteWicherts
Our School of Social and Behavioral Sciences is recruiting 18 assistant professors (with tenure after 18 months) @TilburgU www.academictransfer.com/en/314817/18-assistant-professors/
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Join us (in person or virtually) at our free symposium on July 5th! We will welcome some wonderful speakers to discuss important issues related to the theme: What Research Performing Organizations can do to promote Research Integrity
Register here: nsri2020.nl/end-2022 -
Jelte Wicherts
@JelteWicherts
Vacancy in our awesome meta-research group: PhD position: Moderator analysis in meta-analysis www.academictransfer.com/en/313344/phd-position-moderator…
-
Jelte Wicherts
@JelteWicherts
Contrary to widespread belief*, stereotype threat effects on test performance do not appear to be different across levels of prior test performance www.sciencedirect.com/science/article/pii/S0160289622000368
*as expressed by Wicherts (2005) and others -
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Join us (in person or virtually) at our free symposium on July 5th! We will welcome some wonderful speakers to discuss important issues related to the theme: What Research Performing Organizations can do to promote Research Integrity
Register here: www.nsri2020.nl/end-2022 -
Jelte Wicherts reposted
DORA
@DORAssessment
👀@gowrigopala @JelteWicherts Gerko Vink @ialstoop @DenOlmo @grietter57 @LexBouter find publication pressure negatively impacts responsible research practices, arguing that lowering publication pressure may be important for fostering research integrity.
f1000research.com/articles/11-471/v1 -
Jelte Wicherts
@JelteWicherts
Around 5% of 2000 open datasets from psychology were found to include (unnecessary) identifying information #openscience #privacy
Privacy Protection in the Era of Open Science psyarxiv.com/ybzu9/ via @OSFramework -
Jelte Wicherts
@JelteWicherts
Vacancy at our department: Assistant Professor in Qualitative Research Methodology (0.8-1.0 FTE) www.academictransfer.com/en/310973/assistant-professor-in…
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Half of academics admit to ‘questionable’ research practices www.timeshighereducation.com/news/half-academics-admit-qu… via @timeshighered @gowrigopala @LexBouter @JelteWicherts @grietter57
-
Jelte Wicherts
@JelteWicherts
Vacancy at our department:
Assistant/Associate Professor in Social or Behavioral Data Science (full time) www.academictransfer.com/en/310311/assistantassociate-pro… -
Jelte Wicherts
@JelteWicherts
Developments in Open Data Norms at the Journal of Open Psychology Data @up_jopd openpsychologydata.metajnl.com/article/10.5334/jopd.60
-
Jelte Wicherts
@JelteWicherts
National Survey on Research Integrity @SurveyIntegrity (N = 6813) highlights common use of questionable research practices in relation to scientific norms and publication pressure
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Vacancy at our awesome department: Assistant professor in social or behavioral data science www.academictransfer.com/en/307222/assistant-professor-in…
-
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
Published!
Reproducibility Project: Cancer Biology
@eLife
* 193 experiments planned, 50 completed. Challenges in transparency, sharing, & implementation doi.org/10.7554/eLife.67995
* Replication effect sizes were 85% smaller on avg than original effects doi.org/10.7554/eLife.71601
1/ -
Jelte Wicherts
@JelteWicherts
Consensus-based guidance for conducting and reporting multi-analyst studies doi.org/10.7554/eLife.72185
-
Jelte Wicherts
@JelteWicherts
“I’ll publish your paper if you publish mine” nepotism in the biomedical literature @dmoher @NaudetFlorian @IoanaA_Cristea @deevybee journals.plos.org/plosbiology/article?id=10.1371/journal.…
-
Jelte Wicherts
@JelteWicherts
Large study using Elsevier submissions shows that during the first wave of the pandemic, women submitted proportionally fewer manuscripts than men. @squazzoni @mehmanib
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
JATSdecoder: a tool to extract statistical results
(including reuse of our open data)
www.nature.com/articles/s41598-021-98782-3 -
Jelte Wicherts
@JelteWicherts
An increase in instructions to authors at scholarly journals from 1987 to 2017 disq.us/t/41pja8w
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Are you a postdoc or assistant professor from the Social Sciences and interested in #researchintegrity?
We need you for an engaging online round table discussion on 28 Oct 9-13 hrs. Mail us @ info@nsri2020.nl if interested. -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
Definitely check this session out at #metascience2021! Amir will present SAM, a very flexible and powerful framework for modeling the effects of QRPs on research results.
I already had a sneak peak at our lab meeting at @MetaTilburg and this could be revolutionary! -
Jelte Wicherts
@JelteWicherts
Statements that "data are available upon request" should be banned from journals and replaced by data availability statements that specify the data repository and procedure to obtain the data (if they can't be open)
www.nature.com/articles/s41597-021-00981-0 -
Jelte Wicherts reposted
Constantin Yves Plessen
@CYPlessen
I don’t recommend papers very often, but this one is brilliant: psyarxiv.com/43yae by @a_collentine and @JelteWicherts
What would´ve happened if the RRR hadn’t been preregistered? And what would happen if those studies were meta-analyzed? Nonsense!
1/6 -
Jelte Wicherts reposted
Marco Valente
@eccemarco
Science is premised on transparency and robust debate. Let's keep the lid open and the conversations going on how to improve its methods www.nature.com/articles/d41586-021-02421-w good editorial by @JelteWicherts
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Preprint advocates must also fight for research integrity.
Read @gowrigopala World View in Nature.
www.nature.com/articles/d41586-021-02481-y -
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
Symposium #metascience2021
"Modeling the process of conducting scientific research"
With @a_collentine @EJWagenmakers @JelteWicherts
@amirmasoudabdol @esthermaassen
Sept 18 10a EDT, 4p CEST
metascience2021.org/events/p-hacking-revisited-comprehens… -
Jelte Wicherts reposted
Peter Suber (@petersuber@fediscience.org)
@petersuber
From @JelteWicherts: "Much of the [progress] has been driven by early-career researchers [#ecrs]…Preregistering studies, replication, publishing negative results, & sharing code, materials & data can…empower the self-corrective mechanisms of science."
www.nature.com/articles/d41586-021-02421-w -
Jelte Wicherts
@JelteWicherts
The Stapel case came out 10 years ago (today) and eventually helped to improve psychology. My world view @Nature www.nature.com/articles/d41586-021-02421-w
-
Jelte Wicherts reposted
nature
@Nature
Grass-roots action against bad behaviour has spurred reform — and should keep going. www.nature.com/articles/d41586-021-02421-w
-
Jelte Wicherts
@JelteWicherts
Vacancy at our department: Assistant professor in social or behavioral data science (Tenure Track, full-time) www.academictransfer.com/en/303234/assistant-professor-in…
-
Jelte Wicherts
@JelteWicherts
PhD-position with @Kim_De_Roover : Comparing latent processes in multigroup data in the social sciences www.academictransfer.com/en/303546/phd-position-comparing…
-
Jelte Wicherts
@JelteWicherts
8% of researchers in Dutch survey have falsified or fabricated data www.nature.com/articles/d41586-021-02035-2
-
Jelte Wicherts
@JelteWicherts
Yeah congrats @Kim_De_Roover !
NWO Nieuws
@NWONieuws
NWO heeft 78 ervaren onderzoekers een Vidi-financiering van 800.000 euro toegekend. Hiermee kunnen zij de komende vijf jaar een eigen, vernieuwende onderzoekslijn ontwikkelen en een onderzoeksgroep opzetten. Lees meer:
www.nwo.nl/nieuws/nwo-vidi-van-800000-euro-voor-78-ervare…
@ZonMw -
Jelte Wicherts
@JelteWicherts
Vacancy at our department:
Assistant professor in social or behavioral data science (Tenure Track, full-time) www.academictransfer.com/en/302668/assistant-professor-in… -
Jelte Wicherts
@JelteWicherts
Another vacancy in our meta-research group:
PhD-candidate Department of Methodology and Statistics (0.8-1.0 fte, 4 years) www.academictransfer.com/en/302646/phd-candidate-departme… -
Jelte Wicherts
@JelteWicherts
Vacancy: PhD-candidate in Psychometrics at the Department of Methodology and Statistics (0.8-1.0 fte) www.academictransfer.com/en/302644/phd-candidate-in-psych…
-
Jelte Wicherts
@JelteWicherts
Landmark research integrity survey finds questionable practices are surprisingly common www.sciencemag.org/news/2021/07/landmark-research-integri…
-
Jelte Wicherts reposted
Journal of Intelligence
@JIntell_MDPI
"Effect Sizes, Power, and Biases in #intelligence Research: A Meta-Meta-Analysis" is available at doi.org/10.3390/jintelligence8040036
#metascience
@MicheleNuijten
@HildeAugusteijn
@JelteWicherts -
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
New in Nature Human Behavior: We had 353 peer reviewers evaluate published Registered Reports versus comparison articles on 19 outcome criteria. We found that RRs were consistently rated higher on rigor and quality.
Paper www.nature.com/articles/s41562-021-01142-4
Green OA osf.io/preprints/metaarxiv/7x9vy/ -
Jelte Wicherts reposted
Heidi Seibold @HeidiSeibold@fosstodon.org
@HeidiBaya
So excited to share that our reproducibility study is now published in @PLOSONE 🎉
We looked at 11 papers with longitudinal analyses and checked if we can reproduce the results.
The project was part of a class for stats students (now all co-authors) 🧑🎓
doi.org/10.1371/journal.pone.0251194 -
Jelte Wicherts
@JelteWicherts
Meta-Analyzing the Multiverse: A Peek Under the Hood of Selective Reporting @a_collentine @MarjanBakker
psyarxiv.com/43yae/ -
Jelte Wicherts reposted
PLOS Biology
@PLOSBiology
Analysis of 176,620 #randomizedcontrolledtrials published 1966-2018 reveals that risk of bias in #rcts fell over time, but high probabilities of bias remain, so further improvement in #rct registration, conduct & reporting is still needed #plosbiology plos.io/3guV4lP
-
Jelte Wicherts
@JelteWicherts
Researcher: Quantum computing science has major reproducibility crisis. Dutch government: cool research! Here’s a €615 million grant.... www.nature.com/articles/d41586-021-00954-8
Jelte Wicherts
@JelteWicherts
Let’s hope they clean up their act with such massive resources!
-
Jelte Wicherts reposted
lexbouter.bsky.social
@LexBouter
Do you want to now how decent an #openaccess journal treats it authors? Consider to consult www.qoam.eu and to submit your own experiences. This could become 'TripAdvisor for authors'. #publicationethics #openscience #researchintegrity
-
Jelte Wicherts
@JelteWicherts
Come work at our department!
Assistant Professor in methodology, applied statistics, or data science (full-time, 2-3 years) www.academictransfer.com/en/297086/assistant-professor-in… -
Jelte Wicherts
@JelteWicherts
Analytic reproducibility in articles receiving open data badges at the journal Psychological Science: an observational study | Royal Society Open Science royalsocietypublishing.org/doi/10.1098/rsos.201494
-
Jelte Wicherts reposted
Center for Open Science
@OSFramework
How can we facilitate specific, precise, and exhaustive preregistrations to improve the credibility of research findings? @MarjanBakker shares. www.cos.io/blog/improving-the-quality-and-specificity-of-…
-
Jelte Wicherts
@JelteWicherts
Preregistration is hard! (& often insufficient to completely wipe out biases due to p-hacking) dx.plos.org/10.1371/journal.pbio.3000937
-
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
Our newest in @PLOSBiology: Ensuring the quality and specificity of preregistrations.
Structured prereg protocols performed better than open-ended ones, but there is still room to improve in design & behavior.
Led by @MarjanBakker & @CoosjeVeldkamp
journals.plos.org/plosbiology/article?id=10.1371/journal.… -
Jelte Wicherts reposted
Gowri Gopalakrishna
@gowrigopala
If 2020 has shown us one thing it’s that trust in science is crucial for our well being. Joining #nsri2020 is one concrete way to help open a much needed critical dialogue on areas we need better focus on. Closing on 7th Dec. Takes about 20 mins
National Survey on Research Integrity
@SurveyIntegrity
249 academics to make it to 7000. Have you completed NSRI2020 yet? The world's largest, multidisciplinary #researchintegrity survey to-date! Join us and make #researchintegrity count! Only 3 days left @natalie_cevans @EmbassySci @UYA_Utrecht @MaastrichtYA @YALeiden @YAGroningen
-
Jelte Wicherts
@JelteWicherts
Latent logistic interaction modeling: A simulation and empirical illustration of Type D personality www.tandfonline.com/doi/full/10.1080/10705511.2020.1838905
-
Jelte Wicherts reposted
Gowri Gopalakrishna
@gowrigopala
We want better science and together we can make that known! Thank you for filling out #nsri2020, Dutch academia. Yesterday showed us what spreading the word can do! The survey remains open til 7 Dec, please continue to fill it in if you haven't!
National Survey on Research Integrity
@SurveyIntegrity
As of this morning, our survey completes jumped by more than a 1000 completes! Thank you!! If you havent completed it, do it before 7 Dec 2020. A big thank you to everyone for spreading the word! Yes, we can, Dutch academia!
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Science magazine's coverage of the challenges faced in launching #nsri2020 with @gowrigopala @grietter57 . If you're an academic in NL, *last call before we close on 7 Dec*! You can still join #nsri2020. Look for an email invite from @LexBouter (VU) webint@tns-nipo.
Jop de Vrieze
@Jopdevrieze
The National Survey on Research Integrity was supposed to be the largest and most multidisciplinary so far. But most Dutch universities refused to collaborate.
www.sciencemag.org/news/2020/11/largest-ever-research-int… -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
The higher echelons of some Dutch universities seem to be more concerned with public image than research integrity.
This puzzles me; I think nothing is worse for the image of a publicly funded university than refusing to participate in a nation-wide survey on research integrity
Jop de Vrieze
@Jopdevrieze
The National Survey on Research Integrity was supposed to be the largest and most multidisciplinary so far. But most Dutch universities refused to collaborate.
www.sciencemag.org/news/2020/11/largest-ever-research-int… -
Jelte Wicherts
@JelteWicherts
In refusing to join the @SurveyIntegrity, @UniLeiden failed to substantiate their methodological critique, but amidst his fellow rectors @CarelStolker argued that universities shouldn't join because its results might provide bad news & reputation damage
www.sciencemag.org/news/2020/11/largest-ever-research-int… -
Jelte Wicherts reposted
Jeroen de Ridder
@ridderjeroen
SAD! I really do wish universities, medical centers, and all of us individual researchers would step up and join the survey after all. Search your inbox or spam folder for an email from Lex Bouter about #nsri2020. @gowrigopala @LexBouter
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
#whyresearchintegrity ? "I hope that we will obtain insights into why researchers do not always do the right thing and that these insights will help us to promote good research practices. " An interview with @JelteWitcherts of @TilburgU Read: www.nsri2020.nl/post/an-interview-with-jelte-wicherts #nsri2020
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Take 20 minutes this weekend to improve the future of research and trust in science in the Netherlands.
Join the #nsri2020. #checkyourmailfornsri (mail from Lex Bouter) nsri2020.nl -
Jelte Wicherts
@JelteWicherts
New meta-analysis by @DenOlmo of sex differences in trust and trustworthiness in the trust game and the gift-exchange game @markvanvugt1 @MALMvanAssen
www.sciencedirect.com/science/article/pii/S0167487020300891 -
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Do reviewers detect insufficiently reported study flaws, failure to report relevant details in a study, do you publish in #openaccess, what #openscience practices do you practice? Join the nation-wide integrity study & tell us #openaccessweek2020 www.nsri2020.nl
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Good morning researchers across the Netherlands, please #checkyourmailforthensri (mail from Kantar) and take 20 minutes today to join this important survey. The future of research is in all of our hands and every voice counts! #nsri2020
-
Jelte Wicherts
@JelteWicherts
Nearly a third of top journals are unclear about how they actually perform peer review
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts reposted
Jeroen de Ridder
@ridderjeroen
I completed the #nsri2020 @SurveyIntegrity today. I think you should too, if you’re employed at a Dutch university. It’s the single largest survey on Research Integrity ever, sent out to >40k researchers at all levels of seniority and across different academic disciplines. 1/3
-
Jelte Wicherts reposted
Daniël Lakens
@lakens
Very exciting - got my invitation to complete the National Dutch Survey on Research Integrity today! Such an important topic to learn how we can improve our science! If you get your invitation, do fill in the survey!
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Dear fellow colleague, a few important points we wanted to share with you on the NSRI:
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Dear academic research community, our Trusted Third Party, Kantar Public (TNS NIPO) is reaching out to you with email invite to join our nation-wide #researchintegrity survey. We never receive survey responses directly. How we protect your privacy? read www.nsri2020.nl/faq-s
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Can we trust science for critical decision making? The answer is becoming increasingly important around the world, and demonstrates why #researchintegritymatters. Here's what integrity means in science: youtu.be/SYvsa-1d_wQ
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
More than 500 registered and counting: Places are still available for tomorrow's (15/10) virtual Symposium on Research Integrity. With @ridderjeroen @bnbakker @ryhertzberger @lakens @MicheleNuijten @JeroenJGGeurts @gowrigopala @NRIN_Integrity & more: www.nsri2020.nl/symposium
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Meet the speakers: Klaas Sijtsma, rector @TilburgU. Prof. Sijtsma will open the symposium on #researchintegrity on Oct 15 with What universities can do to foster responsible research practices. All NL researchers welcome. Register & programme: www.nsri2020.nl/symposium
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
On October 15th we’re organizing an event for all researchers across the Netherlands to discuss and consider topics around #researchintegrity. Have you registered?
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
For researcher in our network: there are still seats available by livestream for the symposium on #researchintegrity on Oct 15th Register @ www.nrin.nl/component/eventbooking/intern/national-survey…
-
Jelte Wicherts reposted
Anna-Lena Schubert
@AnnaLSchubert
Exciting new meta-analysis on meta-analyses in intelligence by @MicheleNuijten and colleagues: www.mdpi.com/2079-3200/8/4/36
-
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Meet the speakers: @ryhertzberger, NRC columnist and microbiologist @RebLab_opensci. Rosanne will speak about #researchintegrity and Why we have too much trust in science on Oct 15. All NL researchers welcome. Register & programme: www.nsri2020.nl/symposium
-
Jelte Wicherts
@JelteWicherts
Meta-meta-analysis of 2442 studies on intelligence shows mean effect of r = .25 and median power around 50%
@MicheleNuijten.
www.mdpi.com/2079-3200/8/4/36/htm -
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
Researchers from all disciplines in NL: save the date. Please join us Oct 15 for the first symposium to include all researchers in NL discussing #researchintegrity. Register for online or livestream www.nsri2020.nl/symposium
@_knaw @hetpnn @postdocnl @NRIN_Integrity -
Jelte Wicherts reposted
Hilde Augusteijn
@HildeAugusteijn
Are you a Psychology student? Please fill out this survey ( max 10 min): tilburgss.co1.qualtrics.com/jfe/form/SV_b3jQkP1tjlEVq4J
-
Jelte Wicherts reposted
ZonMw
@ZonMw
We encourage #researchintegrity to make a difference for all researchers and to the general public. www.youtube.com/watch?time_continue=2&v=SYvsa-1d_wQ Therefore we invite you to join the first symposium for all Dutch researchers on October 15th (live or online) @ www.nsri2020.nl/symposium. @SurveyIntegrity
-
Jelte Wicherts
@JelteWicherts
Vacature: (Junior) Docent Methoden en Technieken van Onderzoek @TilburgU www.academictransfer.com/nl/294341/junior-docent-methoden…
-
Jelte Wicherts reposted
Harlan Campbell
@harlanhappydog
Interesting study by @JelteWicherts
doi.org/10.1371/journal.pone.0236079 -
Jelte Wicherts reposted
DANS | Bluesky: @dans-knaw-nwo.bsky.social
@DANS_knaw_nwo
Op 3 september 2020 organiseren DANS en het LCRDM ‘Voer voor psychologen’, een online event speciaal voor onderzoekers in de psychologie, met tools, tips en tricks op het gebied Research Data Management en het delen van data: dans.knaw.nl/nl/actueel/agenda/voer-voor-psychologen
-
Jelte Wicherts reposted
Rebecca Sear
@RebeccaSear
Statistical power of a study is no higher when researchers are asked to do formal power analysis before collecting data:
Recommendations in pre-registrations & internal review board proposals promote formal power analyses but do not increase sample size
dx.plos.org/10.1371/journal.pone.0236079 -
Jelte Wicherts
@JelteWicherts
Highly cited neuroimaging studies continue to use tiny samples, are often poorly reported, & overwhelmingly ignore the need to perform a priori power analyses
www.sciencedirect.com/science/article/pii/S1053811920306509 -
Jelte Wicherts
@JelteWicherts
#plosbiology: The Hong Kong Principles for assessing researchers: Fostering research integrity @dmoher dx.plos.org/10.1371/journal.pbio.3000737
-
Jelte Wicherts
@JelteWicherts
The hidden moderator account of failed replications is as dead as dodo (in press at Psych Bull) @a_collentine @MALMvanAssen
psyarxiv.com/m23v4 -
Jelte Wicherts reposted
Jelte Wicherts
@JelteWicherts
Come work with us @TilburgU
Assistant or Associate Professor in Data Science (full-time) www.academictransfer.com/en/292305/assistant-or-associate… -
Jelte Wicherts reposted
Jelte Wicherts
@JelteWicherts
Come work with us @TilburgU
Assistant or Associate Professor in Longitudinal Data Methods www.academictransfer.com/en/292306/assistant-or-associate… -
Jelte Wicherts
@JelteWicherts
Back @TilburgU for 1st time in 3 months to verify that the smoking-free campus campaign was a raging succes. Stay healthy!
-
Jelte Wicherts reposted
Gowri Gopalakrishna
@gowrigopala
Assuring research integrity during a pandemic - blogs.bmj.com/bmj/2020/06/08/assuring-research-integrity-…. Our piece in BMJ today. Issues the Dutch National Survey on Research Integrity targeting 40,000 academics will address when launched in Oct in NL.
-
Jelte Wicherts
@JelteWicherts
Come work with us @TilburgU
Assistant or Associate Professor in Data Science (full-time) www.academictransfer.com/en/292305/assistant-or-associate… -
Jelte Wicherts
@JelteWicherts
Come work with us @TilburgU
Assistant or Associate Professor in Longitudinal Data Methods www.academictransfer.com/en/292306/assistant-or-associate… -
Jelte Wicherts
@JelteWicherts
Articles with open data receive more citations
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Federal scientists perceive losses of scientific integrity under the Trump Administration
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts reposted
Alex J Bowers
@Alex_J_Bowers
This week in #orla6641 @TeachersCollege it's all about honest reporting of #stats results! 3 great readings: on how to spot the lies with stats, awesome review of all the different forms of p-hacking @JelteWicherts, & the garden of forking paths @StatModeling
-
Jelte Wicherts
@JelteWicherts
Keep a distance to help save lives!!
RIVM
@rivm
Volg de instructies van Rijksoverheid op: houd 1,5 meter afstand! Ziek of verkouden? Blijf thuis. Bescherm uzelf en de mensen om u heen. Samen tegen #corona.
#covid19 #coronavirus #nlalert
www.rijksoverheid.nl -
Jelte Wicherts reposted
Chris Chambers
@chrisdc77
Attention all scientists (please RT): Announcing an urgent call at Royal Society Open Science for rapidly reviewed Registered Reports in any field related to #coronavirus neurochambers.blogspot.com/2020/03/calling-all-scientists…
#covid19 @RegReports
THREAD -
Jelte Wicherts
@JelteWicherts
Holy sh*t!! These Corona trends replicate well across the globe. We all need to help to lower that trend. Stay away from others, washing hands, etc etc. shinyapps.org/apps/corona/
-
Jelte Wicherts
@JelteWicherts
Dutch government calls all universities in the Netherlands to cancel all teaching and exams (and go to online classes) #covid19nederland www.vsnu.nl/nl_NL/nieuwsbericht.html/nieuwsbericht/569-in…
-
Jelte Wicherts reposted
Flaminio Squazzoni
@squazzoni
A large-scale @PEERe_REVIEW #peere study on #gender #bias with complete data on 145 #journals shows that #women are not penalized in #peerreview! Check it out here: osf.io/preprints/socarxiv/gh4rv/
-
Jelte Wicherts
@JelteWicherts
Large survey among European academics shows that power relations play a role in the reporting of research misconduct
link.springer.com/article/10.1007/s11948-020-00202-8 -
Jelte Wicherts
@JelteWicherts
Survey among 12k authors on 25k citations reveals biases in citations as measures of quality and impact
arxiv.org/abs/2002.10033 -
Jelte Wicherts
@JelteWicherts
Publish less, read more: "in soft psychology theories rise and decline, come and go, more as a function of baffled boredom than anything else"
journals.sagepub.com/doi/full/10.1177/0959354319898250 -
Jelte Wicherts
@JelteWicherts
If your outcome ain't significant, then choose another..... Eeuuhhh, but doesn't that ... bias... and... type 1 error... etc.
link.springer.com/article/10.1007/s10869-018-9539-8 -
Jelte Wicherts
@JelteWicherts
The vast majority of researchers from eight scientific fields misinterpreted p-values and confidence intervals, large survey finds.
www.cambridge.org/core/journals/journal-of-pacific-rim-ps… -
Jelte Wicherts
@JelteWicherts
Most applicants were OK with use of lottery to allocate research funding (with most support among the lucky winners)
researchintegrityjournal.biomedcentral.com/articles/10.11… -
Jelte Wicherts reposted
Steven Goodman
@goodmanmetrics
Still time to apply for a 2020-21 METRICS fellowship at Stanford in meta-science and research reform! Join our terrific and growing team! metrics.stanford.edu/fellowships
@METRICStanford @StanfordEpiNews #epitwitter #metascience @cochranecollab -
Jelte Wicherts reposted
OVT
@OVTradio1
En het boek is nu vertaald!
In 'Superieur' concludeert dat Angela Saini dat de rassenleer terug is van (nooit) weggeweest. Ook in de wetenschap. Zondag bespreken we het boek met @JelteWicherts en Angelie Sens. Tussen 10&12 @NPORadio1 -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
Check out this recap of our Tilburg Meta-Research Day of last November. Including video recordings of the plenary talks by @sarahderijcke @ana_marusic & John Ioannidis, and summaries of all parallel sessions.
Next up is a 2/3-day conference in July 2021!
metaresearch.nl/blog/2020/1/2/a-recap-of-the-tilburg-meta… -
Jelte Wicherts reposted
Balazs Aczel
@BalazsAczel
It is nice to see that @PsychScience adopted the #transparencychecklist in their latest editorial.
The need for transparency in science seems to be self-evident.
journals.sagepub.com/doi/full/10.1177/0956797619898664 -
Jelte Wicherts reposted
Hu Chuan-Peng | @hcp4715.bsky.social
@hcp4715
Congrats to @QingLanLiu1's 1st EN publication, a data descriptor published in J Open Psych Data.
Features:
~10 scales;
Max N = 1100;
Non-western, educated sample from 3 🇨🇳cities;
some scale w/ re-test data.
Plz check: openpsychologydata.metajnl.com/articles/10.5334/jopd.49/ -
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
#research #integrity seems to be in the news of late. We are excited our national survey will contribute to the debate in a constructive way by helping to concretely identify across all disciplines what factors help or hurt responsible conduct of research. www.nsri2020.nl
-
Jelte Wicherts
@JelteWicherts
Gender differences in the framing of research findings
www.bmj.com/content/367/bmj.l6573 -
Jelte Wicherts
@JelteWicherts
Decline effect in Paul Lodder's meta-analysis of money priming: I wouldn't bet my money on money priming
psycnet.apa.org/doi/10.1037/xge0000570
pre-print:
pure.uvt.nl/ws/portalfiles/portal/29126856/Lodder_et_al._… -
Jelte Wicherts
@JelteWicherts
What’s next for psychology’s embattled field of social priming?
www.nature.com/articles/d41586-019-03755-2 -
Jelte Wicherts
@JelteWicherts
Predatory journals prioritize self-interest at the expense of scholarship and are characterized by misleading information, deviation from best editorial practices, a lack of transparency, and/or the use of aggressive & indiscriminate solicitation practices
www.nature.com/articles/d41586-019-03759-y -
Jelte Wicherts reposted
National Survey on Research Integrity
@SurveyIntegrity
"The focus of our research is not on how often integrity violations occur, but on which variables determine how academics deal with research integrity," explains the leader of our research project Lex Bouter in this interview with Research Professional.
-
Jelte Wicherts
@JelteWicherts
Go preprints !
elifesciences.org/articles/52646 -
Jelte Wicherts
@JelteWicherts
Nationwide integrity survey to start in May www.researchprofessionalnews.com/rr-news-europe-netherlan…
-
Jelte Wicherts
@JelteWicherts
Predicting the replicability of social science lab experiments
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts reposted
METRICStanford
@METRICStanford
Please RT! Exciting #metaresearch postdoc opportunity @METRICStanford. Apply by January 29, 2020. Postdoc fellowship to start between June-September 2020. Announcement on the METRICS website: metrics.stanford.edu/education/postdoctoral-fellowship-an…
-
Jelte Wicherts
@JelteWicherts
A consensus-based transparency checklist
www.nature.com/articles/s41562-019-0772-6 -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
Preprint time!
Here, we provide a template and tutorial (including example preregistration) for preregistering secondary data analyses.
The tutorial focuses on how to handle prior knowledge of the data but also involves general preregistration advice.
psyarxiv.com/hvfmr -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
Keynote talk of @ana_marusic: "This community, that studies publication bias, doesn't publish 30% or more of scientific papers."
We need meta-meta-research!
#tilburgmeta -
Jelte Wicherts reposted
Tilburg University
@TilburgU
Congratulations on receiving your honorary doctorates, Professor Anita L. Allen, University of Pennsylvania (@penn) and Professor John P.A. Ioannidis, @Stanford University. #tilburgu #diesnatalis
-
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
My PhD-supervisor @JelteWicherts awards a @TilburgU honorary doctorate to John Ioannidis for his work in shaping the field of meta-research.
"I was born in Athens so I am used to ruins. Maybe that's why I feel so at home with the ruins of the scientific literature"
#tilburgmeta -
Jelte Wicherts
@JelteWicherts
No academic journals were harmed in the making of this Open Access policy #openscience @NIH
journals.plos.org/plosbiology/article?id=10.1371/journal.… -
Jelte Wicherts
@JelteWicherts
Meta-analysis offers 9216 different ways to compute an effect size @BioMedCentral @METRICStanford @NaudetFlorian
bmcmedicine.biomedcentral.com/articles/10.1186/s12916-019… -
Jelte Wicherts reposted
simine vazire
@siminevazire
A stereotype threat study and a mortality salience study - there’s still time to join if you’re interested!
-
Jelte Wicherts
@JelteWicherts
About half of the 500 checked effect size computations from psychological meta-analyses are irreproducible @esthermaassen
psyarxiv.com/g5ryh/ -
Jelte Wicherts
@JelteWicherts
Academic resilience: early setback in academic careers strenghtens perseverant researchers
www.nature.com/articles/s41467-019-12189-3 -
Jelte Wicherts reposted
Andrea Stoevenbelt
@AStoevenbelt
I am very happy to annouce that our stereotype threat RRR is finally live! Join me, Paulette Flore and @JelteWicherts in this exciting project! www.psychologicalscience.org/publications/ampps/project-a…
-
Jelte Wicherts
@JelteWicherts
Registered Replication Report (RRR) of famous stereotype threat study coming to your lab soon! Join @AStoevenbelt, Paulette Flore, and me and many others in studying the effect of gender stereotype threat on math performance.
www.psychologicalscience.org/publications/ampps/project-a…
Jelte Wicherts
@JelteWicherts
Jelte Wicherts
@JelteWicherts
All materials and pre-registration here:
osf.io/zwnxy/
Jelte Wicherts
@JelteWicherts
Contributor Application Form here:
docs.google.com/forms/d/e/1FAIpQLSfE2Ru3CB1UjwjowFDlICMqr… -
Jelte Wicherts
@JelteWicherts
University rankings mostly reflect university wealth
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts reposted
Andrea Stoevenbelt
@AStoevenbelt
Why I believe academic cv's should be judged differently to ensure that #openscience remains a sustainable option for ECRs: rdcu.be/bTWWE
-
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
Why I think open peer review benefits PhD students:
socialsciences.nature.com/channels/2140-is-it-publish-or-…
Check out my blog post as part of @NatureHumBehav's initiative to have early career researchers give their opinions on the "publish or perish" culture.
#academictwitter #ecrchat #phdchat #openscience -
Jelte Wicherts
@JelteWicherts
Over the time, Nobel Prize speeches have become more technical, less ceremonial, and more lecture-oriented.
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts reposted
Dalmeet Singh Chawla | ਦਲਮੀਤ ਸਿੰਘ ਚਾਵਲਾ
@DalmeetS
Metaresearch is gaining steam. @RoRInstitute — launched by @sheffielduni, @wellcometrust, @cwtsleiden & @digitalsci — is the latest boost to the field. Me for @cenmag: cen.acs.org/research-integrity/reproducibility/Research-r… @Neuro_Skeptic @BrianNosek @MarcusMunafo @JelteWicherts @jameswilsdon @LudoWaltman
-
Jelte Wicherts reposted
Ludo Waltman
@LudoWaltman
Today the Research on Research Institute was launched; this visualization shows how research on research is embedded in the landscape of science @RoRInstitute @cwtsleiden @digitalsci @DSDimensions @jameswilsdon
-
Jelte Wicherts
@JelteWicherts
What happens in the psychological laboratories is often not reported in the method section of articles..... here's what researchers the say.
www.collabra.org/article/10.1525/collabra.221/ -
Jelte Wicherts
@JelteWicherts
Formatting of scientific papers wastes time & money (that would be better spent on actual research)
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts reposted
Damiano D'Urso, PhD
@Damiano_Durso
Only a few spots left for our free symposium on Classification in Social and Behavioral Sciences @TilburgU on the 15th of October (with our keynote speakers Prof. Dr. E. Ceulemans,Prof. Dr. M.E. Timmerman , Dr. @Kim_De_Roover ,Dr. K. Van Deun).
Check out the final program!🥳 -
Jelte Wicherts
@JelteWicherts
PEER REVIEW REALLY WORKS!
(but please note the limitations)
researchintegrityjournal.biomedcentral.com/articles/10.11… -
Jelte Wicherts
@JelteWicherts
Distinguishing Specific from General Effects in Cognition Research @esthermaassen `
doi.org/10.1016/j.jarmac.2019.06.007
authors.elsevier.com/c/1Zg~D_oHzj7p7~ -
Jelte Wicherts
@JelteWicherts
Citation biases impede myth busting in science
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
All male panels and unbalanced sets of invited speakers at academic conferences are increasingly being replaced by more gender-representative panels and invited addresses
www.nature.com/articles/d41586-019-02658-6 -
Jelte Wicherts reposted
Todd Vision
@tjvision
Important new paper from @seedykelly in @thepeerj finds that published replication studies are vanishingly rare in ecology & evolution peerj.com/articles/7654/
-
Jelte Wicherts reposted
Chris Chambers
@chrisdc77
My new comment piece for @nature on how Registered Reports are changing science, and what the future holds
www.nature.com/articles/d41586-019-02674-6 -
Jelte Wicherts
@JelteWicherts
Research funding strongly predict QS World University Ranking
link.springer.com/article/10.1007%2Fs11192-019-03202-z -
Jelte Wicherts
@JelteWicherts
The mighty power of p-hacking
smbc-comics.com/comic/p-2 -
Jelte Wicherts
@JelteWicherts
Session w/ Kathleen Vohs presenting small & partial null pre reg result, Norbert Schwarz talking about
info gained from failed manip checks & Lisa Feldman Barrett stressing contextual sensitivity
THEY’R MAKING THE CASE THAT WE SHOULD PUBLISH NULL RESULTS!! #metascience2019 -
Jelte Wicherts
@JelteWicherts
Citations to papers have become more concentrated with the introduction of Google Scholar, thereby strengthening the Matthew Effect in science. @jevinwest #metascience2019
-
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
I actually studied whether psychology researchers do this correctly. Turns out they don't, most use simple heuristics like vote counting to make sense of situations like this.
psyarxiv.com/xyks4
#metascience2019 -
Jelte Wicherts
@JelteWicherts
Papers reporting studies that failed to replicate in the reproducibility project psychology have been cited (directly and indirectly) just as often as those that did replicate #metascience2019
-
Jelte Wicherts
@JelteWicherts
Meta-science symposium in Tilburg on November 22 @TilburgU #metascience2019 www.tilburguniversity.edu/about/schools/socialsciences/or…
-
Jelte Wicherts
@JelteWicherts
@MicheleNuijten proposes to first check original results before replicating results. #metascience2019
-
Jelte Wicherts
@JelteWicherts
Multi-lab studies in pre-clinical research deal better with variation and therefore improve replicability over single-lab studies (keeping total N constant). #metascience2019
-
Jelte Wicherts
@JelteWicherts
Instructions to authors in academic journals typically lack data policies: of 835 journals only 29% mentioned data sharing. A meager 0.8% of journals required data sharing. @Mario_Malicki journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
Of 109 articles in developmental economy, only 27 were replicable through reanalysis of the raw data journals.plos.org/plosone/article?id=10.1371/journal.pone… #metascience2019
-
Jelte Wicherts
@JelteWicherts
Reanalysis of 150 published database studies shows widespread discrepancies in results due to poor reporting #metascience2019
-
Jelte Wicherts
@JelteWicherts
In the reproducibility project Biology, Tim Errington et al. found vast majority of data sets from original studies in top journals to be unavailable & many answers from researchers to be unhelpful #metascience2019
-
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
#metascience2019
Co-authorship opportunity!
I'm initiating a big project to gauge the effectiveness of preregistration (Do published papers mimic their preregs? Are preregistered studies more reproducible?) and I need help!
Interested? Come find my poster during dinner. -
Jelte Wicherts
@JelteWicherts
In large scale study, Carole Lee finds that researchers tend to co-author with researchers from their own gender in many scientific fields #metascience2019
-
Jelte Wicherts
@JelteWicherts
Over the years, it has become harder to publish in Nature for those who haven’t published in Nature before (either with or without an established researcher) @robysinatra #metascience2019
-
Jelte Wicherts
@JelteWicherts
Top hit papers are quite randomly distributed over academic careers. (There is hope as long as you keep productivity up) @robysinatra #metascience2019
-
Jelte Wicherts
@JelteWicherts
“If we knew what we’re doing we wouldn’t call it research” Dean Keith Simonton talks about the unlikely events of true scientific creativity #metascience2019
-
Jelte Wicherts
@JelteWicherts
Here we go: 400 meta-scientists gathering at Stanford for #metascience2019 @BrianNosek
-
Jelte Wicherts reposted
Replication Network
@TheReplicateNet
Statistical tools to detect data fabrication: Caveat emptor. @chartgerink @JelteWicherts @MALMvanAssen replicationnetwork.com/2019/08/31/statistical-tools-to-de…
-
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
The Metascience Meeting (metascience2019.org) is a next week (5th-8th) at Stanford. An amazing interdisciplinary line-up of presenters.
If you are not attending, follow along at #metascience2019. Talks will be recorded and released at a later date. -
Jelte Wicherts
@JelteWicherts
Excessive effect sizes, awkwardly consistent results, and weird multivariate relations found to be red flags for fabricated data in @chartgerink's excellent data faking study
psyarxiv.com/jkws4 -
Jelte Wicherts reposted
Neuroskeptic 🇺🇦
@Neuro_Skeptic
Rule out conflicts of interest in psychology awards www.nature.com/articles/d41586-019-02429-3 feat. @JelteWicherts
-
Jelte Wicherts
@JelteWicherts
And the winner is... my good friend dr. X!
The majority of academic societies in psychology that we checked had no regulations to avoid nepotism in handing out academic awards to its members.
psyarxiv.com/phyu3/
www.nature.com/articles/d41586-019-02429-3 -
Jelte Wicherts
@JelteWicherts
Rule out conflicts of interest in psychology awards
www.nature.com/articles/d41586-019-02429-3 -
Jelte Wicherts
@JelteWicherts
#plosbiology: A standardized citation metrics author database annotated for scientific field dx.plos.org/10.1371/journal.pbio.3000384
-
Jelte Wicherts
@JelteWicherts
Gender variations in citation distributions in medicine are very small and due to self-citation and journal prestige doi.org/10.7554/eLife.45374
-
Jelte Wicherts
@JelteWicherts
With 500+ folks dedicated to improving (psychological) science, #sips2019 was amazing! But frankly it was also overwhelming & somewhat disappointing as I felt I could have contributed much more to the great projects that were set up during the hackathons…
Post not available here, view on X
Jelte Wicherts
@JelteWicherts
They couldn’t help that (as early career or working in other areas), but I could have helped if I had a chance to
Jelte Wicherts
@JelteWicherts
For instance, the 15 years of experience I have in promoting data access (through meta-research, being in committees & by trying to keep up the vast lit.) & my connections (I am in a committee stipulating data policy in the NL) are assets that I want to share as widely as I can..
Post not available here, view on X
Jelte Wicherts
@JelteWicherts
I am not suggesting we only put 40+ white males like me on the platform (I've had my chances & certainly don’t need it career-wise), but I might have contributed more if I had been given a chance to inform SIPSers about the work we & others have already done to improving science
Jelte Wicherts
@JelteWicherts
Anyway, SIPS is awesome (10 years ago hardly anyone gave a crap about methods and rigour & open science). Keep up the good work!! @improvingpsych @katiecorker @AnitaEerland @siminevazire @hardsci @Tom_Hardwicke @MicheleNuijten @JoeHilgard
-
Jelte Wicherts
@JelteWicherts
Study of 500k articles shows that data availability statements increase data availability and that open data is associated with 25% increase in citations
arxiv.org/pdf/1907.02565.pdf -
Jelte Wicherts
@JelteWicherts
#sips2019 organisers asked conference attendees to bring their own lanyard to save on waste. I estimate CO2 waste of a single polyester (4 kg CO2 per kg) lanyard (20 grams?) at less than .1 kg CO2. One return flight from Melbourne to Amsterdam is 2500 kg CO2. That's >25k lanyards
Jelte Wicherts
@JelteWicherts
Lesson: there are better ways to save on the environment as an academic: stop using the plane, don't attend long distance conferences, compensate CO2, or make your ATTENDANCE WORTH IT by improving science and scientific knowledge (As the Melbourne group did with #replicats!)
Jelte Wicherts
@JelteWicherts
Oh and discuss the future of academic conferences with @DenOlmo on Tuesday's session.
-
Jelte Wicherts
@JelteWicherts
Job opening: Assistant Professor in Psychometrics
(Quantitative research methods) Tenure Track, full-time
Come work at our Departement of Methodology and Statistics @TilburgU ! tiu.nu/16373 -
Jelte Wicherts
@JelteWicherts
Ioannidis & Thombs provide some practical guidance for journal editors on how to pump up their journal impact factor
onlinelibrary.wiley.com/doi/full/10.1111/eci.13151 -
Jelte Wicherts
@JelteWicherts
89% of introduction to psychology textbooks define or explain significance testing incorrectly
journals.sagepub.com/doi/full/10.1177/2515245919858072 -
Jelte Wicherts
@JelteWicherts
Critical assessment and two large scale replications highlight puzzling findings in puzzling behaviour in Vohs' 2006 original money priming study and a failure to replicate
doi.org/10.1080/01973533.2019.1624965 -
Jelte Wicherts
@JelteWicherts
The power of statistical tests for replication is often low
journals.sagepub.com/doi/abs/10.3102/1076998619852953 -
Jelte Wicherts
@JelteWicherts
Postdocs and assistant professors experience the highest publication pressure in large scale survey among Amsterdam-based academics
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
A single highly cited paper can boost the impact factor of a journal
arxiv.org/abs/1906.02660 -
Jelte Wicherts
@JelteWicherts
Use of reporting guidelines and methodological reviewers increased the citations counts of clinical medicine papers by 43%
bmcmedresmethodol.biomedcentral.com/articles/10.1186/s128… -
Jelte Wicherts
@JelteWicherts
Another study on nepotism in peer review showing that author-suggested reviewers assess manuscripts more favourably than editor-selected reviewers
link.springer.com/article/10.1007/s11948-019-00118-y -
Jelte Wicherts
@JelteWicherts
Meta-meta-meta-meta alert!
I wonder how many articles will eventually cite this article that cites an article on citations to articles on citations
link.springer.com/article/10.1007/s11192-019-03113-z -
Jelte Wicherts
@JelteWicherts
Misreporting of statistical outcomes is worryingly common in innovation research. A quarter of articles checked in this meta-study misreported at least one non-significant result as being significant (at the alpha=.10 level).
www.sciencedirect.com/journal/research-policy/vol/48/issue/9 -
Jelte Wicherts
@JelteWicherts
Pre-registration is hard!
www.sciencemag.org/news/2019/05/solution-psychology-s-rep… -
Jelte Wicherts
@JelteWicherts
Study of 52 principal investigators highlights best practices that create safe work environment in which lab members openly collaborate to scrutinize their work and share in accountability for rigorous research
dx.plos.org/10.1371/journal.pone.0214595 -
Jelte Wicherts reposted
Replication Network
@TheReplicateNet
Does psychology have a publication bias problem? Yes and no. @JelteWicherts @MALMvanAssen replicationnetwork.com/2019/04/18/does-psychology-have-a-…
-
Jelte Wicherts
@JelteWicherts
Psychological effects are larger in non pre-registered studies than in pre-registered studies, highlighting potential biases due to p-hacking and failure to publish when studies are not pre-registered
www.frontiersin.org/articles/10.3389/fpsyg.2019.00813/full
Jelte Wicherts
@JelteWicherts
HT @robinnkok
-
Jelte Wicherts
@JelteWicherts
Meta-meta-analysis reveals hardly any evidence for publication bias in 732 homogeneous subsets of studies from meta-analyses in psychology and medicine
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Study of 412 scientists reviewing 48 grant proposals highlights that grant peer review is depressingly unreliable
psyarxiv.com/483zj -
Jelte Wicherts
@JelteWicherts
How to model interactions between latent variables
Excellent work by Paul Lodder @TilburgU
www.tandfonline.com/doi/full/10.1080/00273171.2018.1562863 -
Jelte Wicherts
@JelteWicherts
Study of the policies at 129 universities 381 academic units highlights the widespread use of journal Impact Factors in academic review, tenure, and promotion evaluations @emckiernan13
peerj.com/preprints/27638/ -
Jelte Wicherts
@JelteWicherts
Reviewers who were more closely connected to the authors provided more more positive reviews
www.sciencedirect.com/science/article/pii/S1751157718304206 -
Jelte Wicherts
@JelteWicherts
Stress due to publication pressure predicts burnout symptoms in a survey among Dutch academics
researchintegrityjournal.biomedcentral.com/articles/10.11… -
Jelte Wicherts
@JelteWicherts
Systematic review: Per 10,000 journal articles in psychology, 0.82 were retracted due to scientific misconduct.
econtent.hogrefe.com/doi/full/10.1027/2151-2604/a000356 -
Jelte Wicherts reposted
Emil Kirkegaard
@KirkegaardEmil
Great new meta-analysis on money #priming by Lodder et al (with @JelteWicherts). Results will shock you!
Just kidding, results are basically what skeptics would expect. ZERO effect size seen in pre-reg studies! (k=47) + obvious indications of pub bias.
pure.uvt.nl/ws/portalfiles/portal/29126856/Lodder_et_al._… -
Jelte Wicherts
@JelteWicherts
Pre-print study finds pre-print studies to be of somewhat lower (reporting) quality than peer reviewed studies.
www.biorxiv.org/content/biorxiv/early/2019/03/22/581892.f… -
Jelte Wicherts reposted
Emil Kirkegaard
@KirkegaardEmil
Nice study by @JelteWicherts on language bias in IQ tests showing up as intercept bias on language loaded tests.
www.researchgate.net/profile/Jelte_Wicherts/publication/2… -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
Here's an overview of all activities of our meta-research group at #icps19paris: metaresearch.nl/blog/2019/3/12/meta-research-center-at-ic….
Featuring #preregistration #metaanalysis and the teaching of #openscience.
@MicheleNuijten @JelteWicherts @esthermaassen @MarjanBakker @MALMvanAssen et al. -
Jelte Wicherts
@JelteWicherts
Systematic review of systematic reviews highlights that mediation analyses in the health science literature are often poorly reported and inappropriately conducted
doi.org/10.1016/j.jclinepi.2019.03.005 -
Jelte Wicherts
@JelteWicherts
The American Statistician publishes 43 open access articles on the p-value in a single issue. For those who cannot get enough of the NHST debate!
www.tandfonline.com/toc/utas20/73/sup1?nav=tocList
HT @andrewang91 -
Jelte Wicherts
@JelteWicherts
During the 1980s and 1990s, prominent psychologist Eysenck published astonishing findings that raise serious questions about the conduct of one of his co-workers.
doi.org/10.1177%2F1359105318822045 -
Jelte Wicherts
@JelteWicherts
Study of 25K scientists shows that becoming a principal investigator can be predicted by no. of publications as 1st or 2nd author, h-index, and pubs in high impact factor journals.
www.cell.com/current-biology/fulltext/S0960-9822(14)00477-1 -
Jelte Wicherts
@JelteWicherts
Citations reflect impact and relevance, but not other aspects of what can be considered high quality research
journals.sagepub.com/doi/full/10.1177/2158244019829575 -
Jelte Wicherts
@JelteWicherts
The world’s most prolific peer reviewers hardly publish any work of their own (Reviewer 2 needs to sleep too)
www.mdpi.com/2304-6775/7/1/15 -
Jelte Wicherts
@JelteWicherts
Of 447 journals checked for data policies, only 47 required data sharing (10.5%). Another 181 journals (40.5%) encouraged data sharing, while 195 journals (43.6%) did not even mention data sharing.
www.tandfonline.com/doi/full/10.1080/08989621.2019.1591277 -
Jelte Wicherts
@JelteWicherts
Of 500 checked effect size computations in psychological meta-analyses, only 45% were reproducible. @esthermaassen #icps19paris
-
Jelte Wicherts
@JelteWicherts
A dozen analysis teams analyzed the same experience sampling data set. Their results looked like a pile of confetti composed of heterogenous results. @CaAl #icps19paris
-
Jelte Wicherts
@JelteWicherts
New freely available fact-checking tool finds and checks 91 impossible nucleotide sequence reagents used in biomedical research publications
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Hirsch suggested to attribute credit only to senior researchers of collaborative publications. This alpha-h-index raises the question: do scientists act like chimpanzees or bonobos?
link.springer.com/article/10.1007/s11192-019-03004-3 -
Jelte Wicherts
@JelteWicherts
Scientists throughout the world trust peer review, but we hardly know how to measure its quality. Of all 24 tools to assess the quality of peer review reports identified in this systematic review, only one was rigorously developed.
bmcmedresmethodol.biomedcentral.com/articles/10.1186/s128… -
Jelte Wicherts
@JelteWicherts
Publication bias affects estimates of heterogeneity in meta-analysis in a complex manner (yielding plots that resemble the Norwegian coastline)
psycnet.apa.org/fulltext/2018-58847-001.html
preprint: osf.io/gv25c/ -
Jelte Wicherts
@JelteWicherts
Preregistering Qualitative Research
www.tandfonline.com/doi/full/10.1080/08989621.2019.1580147 -
Jelte Wicherts
@JelteWicherts
Did a change in Nature journals’ editorial policy for life sciences research improve reporting?
Yes, but high quality reporting still way too uncommon openscience.bmj.com/content/3/1/e000035 -
Jelte Wicherts
@JelteWicherts
Most UK scientists who publish extremely highly-cited papers do not secure funding from major public and charity funders dx.plos.org/10.1371/journal.pone.0211460
-
Jelte Wicherts
@JelteWicherts
Study of 44k psychology articles shows no increase in the reporting of marginally significant results from 1985 to 2016
journals.sagepub.com/doi/10.1177/0956797619830326 -
Jelte Wicherts
@JelteWicherts
Outcome misreporting is depressingly common in clinical trials.
Just imagine how bad things are (could be?) in fields where there is no way to check potential switching of outcomes
trialsjournal.biomedcentral.com/articles/10.1186/s13063-0… -
Jelte Wicherts
@JelteWicherts
FUNDERS, EDITORS, & PUBLISHERS PLEASE WAKE UP: over 90% of anesthesiological studies in "top journals" are irreproducible.
Efforts to obtain raw data from 619 RCTs published in top anesthesiology journals yielded only 24 data sets (4%)
www.sciencedirect.com/science/article/pii/S0895435618306061 -
Jelte Wicherts
@JelteWicherts
Largest experiment of stereotype threat in high schools ever (N=2064) shows no effect of gender stereotypes on math performance (contrary to dozens of previous non-registered small studies in the literature)
www.tandfonline.com/doi/full/10.1080/23743603.2018.1559647 -
Jelte Wicherts reposted
eLife - the journal
@eLife
In an analysis of over 300 physiology papers, 95% of those using ANOVA did not contain the information needed to determine what type of ANOVA was performed elifesciences.org/articles/36163 #metaresearch
-
Jelte Wicherts
@JelteWicherts
Think about it! Multiverse approach involving 250 different analyses of the same experimental data yields no evidence of unconscious arithmetic processing.
doi.org/10.1016/j.concog.2019.01.003 -
Jelte Wicherts
@JelteWicherts
In this large study, open review hardly affected peer reviewers’ willingness to review, recommendations, or turn-around times. Yet, only 8% of reviewers signed their reviews. And review request acceptance rates are going down regardless of PR openness
rdcu.be/bhZJl -
Jelte Wicherts
@JelteWicherts
Large survey among Amsterdam-based academics finds that early career researchers perceive the research integrity climate more negatively than senior researchers.
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Meta-science seen as astrology:
uh..yeah, we sometimes encounter stars that fail to illuminate
(perhaps one should read before passing judgment?)
Nassim Nicholas Taleb
@nntaleb
Psychologists hope that I did not look at the literature.
This, adjusted for padding, is astrology. -
Jelte Wicherts
@JelteWicherts
Comprehensive meta-analysis of 246 experiments into money priming finds clear sings of publication bias and highlights need for powerful pre-registered studies.
osf.io/3sh5a/ -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
First meta-research paper submitted!
How do academics assess the results of multiple experiments?
Many use simple vote counting heuristics that undervalue the evidence for the underlying theory
Preprint: psyarxiv.com/xyks4
Data & materials: osf.io/2g4wf -
Jelte Wicherts
@JelteWicherts
Study of peer review procedures used in 833K articles shows that not all approaches to peer review perform equally well in catching errors & misconduct
link.springer.com/article/10.1007/s11192-018-2969-2 -
Jelte Wicherts
@JelteWicherts
AI peer reviewers unleashed to ease publishing grind www.nature.com/articles/d41586-018-07245-9
-
Jelte Wicherts
@JelteWicherts
Reproducibility in the biomedical sciences journals.plos.org/plosbiology/article?id=10.1371/journal.…
-
Jelte Wicherts
@JelteWicherts
Almost all 161 RCTs checked for generalizability of findings showed deficiencies in their description of patient selection & study settings
www.sciencedirect.com/science/article/pii/S0895435618306668 -
Jelte Wicherts
@JelteWicherts
Over three-quarters of surveyed researchers from psychology & educational sciences admit to not having read all the articles they cited
www.emeraldinsight.com/doi/full/10.1108/JD-03-2018-0047 -
Jelte Wicherts reposted
Tilburg University
@TilburgU
Congratulations to @MicheleNuijten on winning the PhD Thesis Award with her research on research! #researchonresearch #award #diesnatalis #gobeyondborders #interdisciplinarity
-
Jelte Wicherts
@JelteWicherts
In the past 5 years, nearly 80% of young biostatisticians were asked by researchers to conduct or report inappropriate statistical analyses (e.g., remove data, ignore violated assumptions, shifting outcomes). annals.org/aim/article-abstract/2706170/researcher-reques…
-
Jelte Wicherts
@JelteWicherts
Ioannidis on the popularity of substandard methods that are simple and easy to (mis)use
link.springer.com/article/10.1007/s10654-018-0449-x -
Jelte Wicherts
@JelteWicherts
Although it lacks stability & reliability, and its database remains mysterious, Google Scholar is by far the most comprehensive academic search engine, with 389 million records
link.springer.com/article/10.1007/s11192-018-2958-5 -
Jelte Wicherts
@JelteWicherts
How Power Poses Took Over the World
medium.com/s/powertrip/how-power-poses-took-over-the-worl… -
Jelte Wicherts
@JelteWicherts
Who Should Do Replication Labor? - Felipe Romero, 2018 journals.sagepub.com/doi/full/10.1177/2515245918803619
-
Jelte Wicherts
@JelteWicherts
Do authors comply when funders enforce open access to research? www.nature.com/articles/d41586-018-07101-w
-
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
First first author paper submitted!
Sex differences in trust and trustworthiness: A meta-analysis of the trust game and the gift-exchange game
Preprint here: psyarxiv.com/5zbja
All data & materials here: osf.io/4k2wm
@markvanvugt1 @MALMvanAssen @JelteWicherts -
Jelte Wicherts
@JelteWicherts
Ten quick tips for getting the most scientific value out of numerical data dx.plos.org/10.1371/journal.pcbi.1006141
-
Jelte Wicherts
@JelteWicherts
New large meta-meta-analysis shows that the median of median power across 200 psychological research lines (12k studies) is about 36%
www.deakin.edu.au/__data/assets/pdf_file/0009/1459620/Pre…
Jelte Wicherts
@JelteWicherts
Also, intriguing corroboration of @MarjanBakker's "back of envelope" computation of typical power in psychology being .35
journals.sagepub.com/doi/abs/10.1177/1745691612459060 -
Jelte Wicherts
@JelteWicherts
"Dear Dr. Matthew, congratulations on winning yet another award!"
Academic awards are often awarded to academics who already won other awards (particularly in Economics and Business & Management)
link.springer.com/article/10.1007/s11192-018-2928-y -
Jelte Wicherts
@JelteWicherts
New version of P-uniform that corrects for publication bias in random effects meta-analyses.
osf.io/preprints/bitss/zqjr9/ -
Jelte Wicherts reposted
Tilburg University
@TilburgU
"In its drive to expose weaknesses in science, an up-and-coming research group doesn't mind stepping on some toes." - @sciencemagazine about our 'Tilburg Truth Squad’. Want to know more about this team and #metaresearch @TilburgU? Visit the website! tilburguniversity.edu/current/news/news-the-truth-squad-s…
-
Jelte Wicherts
@JelteWicherts
Perhaps the tenure and promotion committee @UWaterloo would like to comment on how they somehow managed not to promote a @NobelPrize winning female academic to the rank of full professor?
-
Jelte Wicherts
@JelteWicherts
Of 126K empirical articles in top economy journals, only 0.1% were replication studies. Also, a third of articles subject to data sharing requirements failed to share data.
www.sciencedirect.com/science/article/pii/S0048733318301847 -
Jelte Wicherts
@JelteWicherts
Contexts might lead researchers to justify use of certain Questionable Research Practices
link.springer.com/article/10.1007/s11948-018-0065-x -
Jelte Wicherts reposted
Collabra: Psychology
@CollabraOA
Enjoyed this profile of the metaresearch.nl in @sciencemagazine www.sciencemag.org/news/2018/09/research-group-seeks-expo…
-
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
ScienceMag: "A Recipe for Rigor" Profile of the dramatically accelerating adoption of preregistration (osf.io/prereg/) and Registered Reports (cos.io/rr/) in basic sciences, particularly social-behavioral sciences. science.sciencemag.org/content/361/6408/1192
-
Jelte Wicherts
@JelteWicherts
The truth squad @TilburgU science.sciencemag.org/content/361/6408/1189
-
Jelte Wicherts
@JelteWicherts
‘Journalologists’ use scientific methods to study academic publishing. Is their work improving science? www.sciencemag.org/news/2018/09/journalologists-use-scien…
-
Jelte Wicherts
@JelteWicherts
Review of peer review in all its forms researchintegrityjournal.biomedcentral.com/articles/10.11… #riprjournal
-
Jelte Wicherts
@JelteWicherts
Excellent. Two years after its "ban statcheck letter", DGPs is now investing its energy in improving psychological science.
Leibniz-Institut für Psychologie (ZPID)
@ZPID
The German Psychological Society, the Hogrefe Publishing Group, and ZPID have entered a partnership to foster research transparency, reproducibility, and replicability in Psychology. #dgps2018 leibniz-psychology.org/en/news/article/news/open-science-… @HogrefeCEO @AntoniConny @prof_bosnjak
-
Jelte Wicherts
@JelteWicherts
Meta-analyses were supposed to end scientific debates. Often, they only cause more controversy www.sciencemag.org/news/2018/09/meta-analyses-were-suppos…
-
Jelte Wicherts
@JelteWicherts
A home advantage at grant decisions? Higher share of grant panel members from applicant's academic institution positively predicts chances of obtaining a grant (particularly among male applicants)
openaccess.leidenuniv.nl/bitstream/handle/1887/65246/STI2… -
Jelte Wicherts
@JelteWicherts
Mankind Quarterly's latest issue contains seven articles written by former editor (and now assistant editor) Richard Lynn. It would be interesting to read the peer review reports by those independent experts (without any conflict of interest)
Emil Kirkegaard
@KirkegaardEmil
New issue of Mankind Quarterly is out. As usual, a lot of new data to ponder! It's probably one of the most data-centric journals out there.
mankindquarterly.org/archive/issue/59-1
You can usually get papers by looking on ResearchGate. Or email me/authors. -
Jelte Wicherts
@JelteWicherts
New Netherlands Code of Conduct for Research Integrity:
Open data or else provide reasons for not sharing.
This effectively calls for a data statement in each publication.
www.vsnu.nl/files/documents/Netherlands Code of Conduct f… -
Jelte Wicherts
@JelteWicherts
Reporting of statistical inference in abstracts in top psychiatry journals shows decline in mentions of significance & increase in mentions of confidence intervals from 1975 to 2015
onlinelibrary.wiley.com/doi/abs/10.1002/mpr.1735 -
Jelte Wicherts reposted
Lorne Campbell
@LorneJCampbell
Re the Chronicle article www.chronicle.com/article/I-Want-to-Burn-Things-to/244488…"And he’s [Nisbett] annoyed that it’s led to the belief that social psychology is riddled with errors. How do they know that?, Nisbett asks, dropping in an expletive for emphasis." Here are a few things to consider... /n
-
Jelte Wicherts
@JelteWicherts
Only 14% of public health analysts shared code and/or data from their latest article. Lack of time, privacy concerns, and lack of incentives seen as main reasons for not sharing.
dx.plos.org/10.1371/journal.pone.0202447 -
Jelte Wicherts
@JelteWicherts
Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole dx.plos.org/10.1371/journal.pone.0202762
-
Jelte Wicherts
@JelteWicherts
In the competitive US funding environment, repeated funding success can be predicted by good grant writing skills, high frequency of grant submissions, and the writing of broad & relevant proposals dx.plos.org/10.1371/journal.pone.0199648
-
Jelte Wicherts
@JelteWicherts
Transparency, Reproducibility, and the Credibility of Economics Research
www.aeaweb.org/articles?id=10.1257/jel.20171350 -
Jelte Wicherts
@JelteWicherts
The Impact of P-hacking on “Redefine Statistical Significance” www.tandfonline.com/doi/full/10.1080/01973533.2018.147411…
-
Jelte Wicherts
@JelteWicherts
Of 92 articles that made recommendations on how to conduct systematic reviews & meta-analyses, only 20 (22%) pointed at the issue of publication bias bmcmedresmethodol.biomedcentral.com/articles/10.1186/s128… #bmcmedresmethodol
-
Jelte Wicherts
@JelteWicherts
Making the scientific literature fail-safe www.jci.org/articles/view/123884
-
Jelte Wicherts
@JelteWicherts
Study of a cohort of biomedical PhD students again highlights the importance of good mentorship dx.plos.org/10.1371/journal.pone.0203783
-
Jelte Wicherts
@JelteWicherts
Meta-analysis of 105 studies shows that a popular implicit measure of self-esteem (the initial preference task) hardly predicts explicit self-esteem
dx.plos.org/10.1371/journal.pone.0202873 -
Jelte Wicherts
@JelteWicherts
Registered Replication Report of Srull & Wyer's (1979) classic priming study throws doubt on its incredible result (d=5.7). Wyer now hints at an "error in reported statistics", but how could any reporting error create such regularities with N=8 per cell?
journals.sagepub.com/doi/full/10.1177/2515245918777487 -
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
Preprint: "Ensuring the quality and specificity of preregistrations" by @Coosje_Veldkamp and 8 more of us.
"Preregistering research is an acquired skill, and registration formats that provide effective guidance will improve the quality of research." psyarxiv.com/cdgyh -
Jelte Wicherts reposted
Olmo van den Akker
@DenOlmo
European science funders ban grantees from publishing in paywalled journals!
www.sciencemag.org/news/2018/09/european-science-funders-… -
Jelte Wicherts
@JelteWicherts
Dutch funder NWO will require grant holders to publish all their work in full & immediate open access journals starting in 2020. Publishing in hybrid journals will be allowed until 2021 #openaccess
www.scienceguide.nl/2018/09/nwo-wil-weg-van-de-impact-fac… -
Jelte Wicherts
@JelteWicherts
In judging the quality of manuscripts in normal science, reputation might work better than actual peer review. At least according to this simulation study.
link.springer.com/article/10.1007/s11192-018-2826-3 -
Jelte Wicherts
@JelteWicherts
Questionable research practices in student final theses – Prevalence, attitudes, and the role of the supervisor’s perceived attitudes
dx.plos.org/10.1371/journal.pone.0203470 -
Jelte Wicherts
@JelteWicherts
Populating the Data Ark: An attempt to retrieve, preserve, and liberate data from the most highly-cited psychology and psychiatry articles dx.plos.org/10.1371/journal.pone.0201856
-
Jelte Wicherts
@JelteWicherts
Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition
rsos.royalsocietypublishing.org/content/5/8/180448 -
Jelte Wicherts
@JelteWicherts
Machiavellianism predicting QRPs among German psychologists is a close replication of key result in Tijdink et al.'s work among Dutch biomedical researchers (not cited by Janke et al.).
journals.plos.org/plosone/article?id=10.1371/journal.pone…
Jelte Wicherts
@JelteWicherts
Machiavellianism and achievement goals predict use of Questionable Research Practices (QRPs) among German psychologists (N=217). Over 40% of respondents admitted to selective publication of studies, HARKing, and/or failure to report all dependent measures
journals.sagepub.com/doi/abs/10.1177/1948550618790227 -
Jelte Wicherts
@JelteWicherts
Machiavellianism and achievement goals predict use of Questionable Research Practices (QRPs) among German psychologists (N=217). Over 40% of respondents admitted to selective publication of studies, HARKing, and/or failure to report all dependent measures
journals.sagepub.com/doi/abs/10.1177/1948550618790227 -
Jelte Wicherts
@JelteWicherts
At age 92.5, John C. Loehlin continues to publish interesting work on intelligence
www.sciencedirect.com/science/article/pii/S0160289618300497 -
Jelte Wicherts
@JelteWicherts
Timeline on a flawed method to study of race diffs in IQ
2009 We write paper showing method to be crappy
2015 teN uses method in 5 papers, despite me sending him 2009 paper
2016 I write another paper on method=crap
2017 teN uses method in 2 papers
2018 www.cambridge.org/core/journals/journal-of-biosocial-scie… -
Jelte Wicherts
@JelteWicherts
Support for the null hypothesis? 72% of non-significant findings mentioned in article abstracts in experimental psychology are interpreted incorrectly.
journals.sagepub.com/doi/full/10.1177/2515245918773742 -
Jelte Wicherts
@JelteWicherts
Survey on questionable research practices among researchers in ecology & evolution shows that 51% used HARKing, 42% employed optional stopping, and 64% selectively reported results. @PLOSONE dx.plos.org/10.1371/journal.pone.0200303
-
Jelte Wicherts reposted
Florian Kunze
@ProfKunze
Are result-blind reviews a step forward for the publication process? 75% of board members of OB and IO Psychology Journals say yes, but 34% also expect unintended negative consequences finds study also including recommendations for reviewers and editors www.tandfonline.com/doi/full/10.1080/1359432X.2018.1496081
-
Jelte Wicherts
@JelteWicherts
There are a lot of excellent female psychometricians out there.
For #imps2019 the M:F ratio should be 1:12. -
Jelte Wicherts
@JelteWicherts
Survey on replication debate & QRPs among 111 Swedish and Dutch PhD students in psychology shows that 24% considered quitting because of methodological problems, particularly after encountering QRPs
osf.io/bmcdw/ -
Jelte Wicherts reposted
Sean C. Rife
@seanrife
A new version of the #statcheck web app is now available, featuring simplified & improved reporting (full reports are still available via downloadable CSV). Many thanks to @MicheleNuijten for her work on this new version! statcheck.io #openscience
-
Jelte Wicherts
@JelteWicherts
A funder-imposed data publication requirement seldom inspired data sharing dx.plos.org/10.1371/journal.pone.0199789
-
Jelte Wicherts reposted
Tilburg University
@TilburgU
This afternoon Robbie van Aert defended his PhD thesis on meta-analysis cum laude @TilburgU Congratulations! #cumlaude #phd #thesis
Jelte Wicherts
@JelteWicherts
This afternoon, Robbie van Aert wil defend his excellent PhD thesis on meta-analysis, p-uniform, replication, and publication bias at @TilburgU
Robbie is not on social media, but his thesis and all his scripts, tools, & data are freely available:
osf.io/drav5/ -
Jelte Wicherts
@JelteWicherts
This afternoon, Robbie van Aert wil defend his excellent PhD thesis on meta-analysis, p-uniform, replication, and publication bias at @TilburgU
Robbie is not on social media, but his thesis and all his scripts, tools, & data are freely available:
osf.io/drav5/ -
Jelte Wicherts
@JelteWicherts
Among 136K clinical trials in @cochranecollab database, only 7% had sufficient power.
www.sciencedirect.com/science/article/pii/S0895435618301409 -
Jelte Wicherts reposted
Ash Paul
@pash22
Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals
journals.plos.org/plosone/article?id=10.1371/journal.pone… via @JelteWicherts -
Jelte Wicherts
@JelteWicherts
Fallibility in Science: Responding to Errors in the Work of Oneself and Others @deevybee journals.sagepub.com/doi/full/10.1177/2515245918776632
-
Jelte Wicherts
@JelteWicherts
In an anonymous survey (N=277), 38% of ego depletion researchers admitted to having used questionable research practices like selectively reporting outcomes or excluding data after witnessing the impact on results. @PLOSONE dx.plos.org/10.1371/journal.pone.0199554
-
Jelte Wicherts
@JelteWicherts
Good thing there exist some meta-research on how to separate the bullshit from the genuine in peer reviewed (open access) journals.
journals.plos.org/plosone/article?id=10.1371/journal.pone…
Gary Lewis
@Gary_Lewis1
I submitted a hoax manuscript to a predatory journal. The finding? Politicians from the right wipe their ass with their left hand (and vice versa) - big breakthrough! Manuscript accepted w/o review. I then haggled the OA fee down to $0 - so here it is -> crimsonpublishers.com/pprs/pdf/PPRS.000516.pdf
-
Jelte Wicherts reposted
Johan Braeken
@JohanBraeken
Psychometrics / Measurement people we @CEMO_UiO are hiring!
2 Postdocs & 3 PhDs www.uv.uio.no/cemo/english/about/vacancies/
Personally looking for a postdoc to work on Modern Test Design projects involving explanatory IRT for test validation and AIG & CAT :) -
Jelte Wicherts
@JelteWicherts
As many as 35,000 papers in the literature are candidates for retraction due to image duplication.
www.biorxiv.org/content/biorxiv/early/2018/06/24/354621.f… -
Jelte Wicherts reposted
Journal of Open Psychology Data
@up_jopd
We have a new call for papers - in the form of an exciting challenge to authors! Learn more here: openpsychologydata.metajnl.com/announcement
-
Jelte Wicherts
@JelteWicherts
Meta-meta-study highlights common reporting biases and excess significance in 20% of meta-analyses on associations between health-related behaviors and cardiovascular disease & mortality
dx.plos.org/10.1371/journal.pbio.2005761 -
Jelte Wicherts
@JelteWicherts
Investing time in teaching programs does not appear to hurt research productivity among PhD students in the life sciences.
dx.plos.org/10.1371/journal.pone.0199576 -
Jelte Wicherts
@JelteWicherts
Multiple studies on statistical inferences show that 20% of teachers of statistics in psychology, 39% of psych professors/lectures, & 66% of psych students misinterpret the p-value as reflecting the probability of a successful replication
journals.sagepub.com/doi/full/10.1177/2515245918771329 -
Jelte Wicherts
@JelteWicherts
Survey on scientific misbehaviors among biomedical doctoral students in Oslo:
18% added honorary authors
12% collected more data to obtain significance
11% turned a blind eye to colleagues' QRPs
10% resorted to HARKing www.tandfonline.com/doi/abs/10.1080/08989621.2018.1485493 -
Jelte Wicherts
@JelteWicherts
Resampling study highlights that fMRI studies with small sample sizes will yield results that are not replicable.
www.nature.com/articles/s42003-018-0073-z -
Jelte Wicherts
@JelteWicherts
Prevalence of statistical reporting errors (related to significance) shows clear drop in @PsychScience articles after implementation of statcheck during peer review @MicheleNuijten
-
Jelte Wicherts
@JelteWicherts
Published intimate partner violence studies often differ from their trial registration records. Discrepancies found in primary outcomes (39% of studies), secondary outcomes (64%), and sample sizes (39%). www.tandfonline.com/doi/abs/10.1080/03630242.2017.1421287
-
Jelte Wicherts reposted
BITSS
@UCBITSS
New preprint from meta-scientist Robbie van Aert from @TilburgU on publication bias and reproducibility in meta-analysis + new methods!
osf.io/preprints/bitss/eqhjd/ -
Jelte Wicherts
@JelteWicherts
Study alert: Most clinical trial protocols offer inadequate specification of statistical analyses. I wish all the researchers the best of luck in chasing false positives & pumping up mediocre results in their ad hoc analyses.
www.sciencedirect.com/science/article/pii/S0895435618301616
Jelte Wicherts
@JelteWicherts
...and also my sincere apologies to all patients who are about to die because so many (medical) researchers are unwilling to accept the fact that loose protocols introduce massive biases in research that distort knowledge of medical treatments.
-
Jelte Wicherts
@JelteWicherts
The Epistemic Importance of Establishing the Absence of an Effect journals.sagepub.com/doi/full/10.1177/2515245918770407
-
Jelte Wicherts
@JelteWicherts
Over half of media articles contain inaccurately reports of questions, results, interventions, or populations of health studies. Unjustified causal language used in 34% of scientific articles and in 48% of media items.
dx.plos.org/10.1371/journal.pone.0196346 -
Jelte Wicherts
@JelteWicherts
A large proportion of RCTs presented at pediatrics conferences remain unregistered and unpublished.
jamanetwork.com/journals/jamanetworkopen/fullarticle/2680418 -
Jelte Wicherts
@JelteWicherts
Replication and Reproducibility in Cross-Cultural Psychology journals.sagepub.com/doi/abs/10.1177/0022022117744892
-
Jelte Wicherts reposted
Trouw
@trouw
De #marshmallowtest maakte de klassieke fout om een oorzakelijk verband te suggereren. 'Meisjes doen het tegenwoordig beter op school. Dat betekent niet dat jongens beter presteren als ze hun haar laten groeien', legt @JelteWicherts uit.
www.trouw.nl/home/marshmallows-kunnen-toch-niet-de-toekom… -
Jelte Wicherts
@JelteWicherts
The General Data Protection Regulation (GDPR) will be a real kicker to psychologists working within the EU and/or with data from EU inhabitants. It involves unprecedented regulations on ANY use of psychological data, as these are almost always "related" to individuals...
Post not available here, view on X
Jelte Wicherts
@JelteWicherts
..To give an example of excessive GDPR regulation: if I download openly shared data that "relate to individuals" I become a data controller & need to follow all the GDPR regulations wrt processing of personal data (incl. register submissions, DPIA assessment, encryption, etc.)..
Jelte Wicherts
@JelteWicherts
..Sure, it would be nice to have mandatory registration of studies & to protect privacy well, but the whole GDPR strikes me as overkill in ensuring privacy protection in the context of non-profit research that aims to better understand human behavior.
-
Jelte Wicherts
@JelteWicherts
P values in top journals are almost always significant. @IoanaA_Cristea journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
Systematic review of 280 articles on reproducibility/replication crisis highlights a need for more systematic meta-research on reproducibility and research practices.
www.preprints.org/manuscript/201804.0068/download/final_file -
Jelte Wicherts
@JelteWicherts
Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency. dx.plos.org/10.1371/journal.pone.0196914
-
Jelte Wicherts reposted
Lorraine Hope
@lorraine_hope
Avoiding "more the merrier" research! Checklist to stay p-hacking safe - great overview by @JelteWicherts #psamsterdam18
-
Jelte Wicherts
@JelteWicherts
Colliding ideals – an interview study of how intervention researchers address adherence and adaptations in replication studies bmcmedresmethodol.biomedcentral.com/articles/10.1186/s128… #bmcmedresmethodol
-
Jelte Wicherts
@JelteWicherts
Spinning out of control. Meta-spin cycles, the blindness of bias, and rebuilding trust in science dx.plos.org/10.1371/journal.pbio.2005972
-
Jelte Wicherts
@JelteWicherts
Data sharing in PLOS ONE: An analysis of Data Availability Statements dx.plos.org/10.1371/journal.pone.0194768
-
Jelte Wicherts
@JelteWicherts
Quantity vs. Quality: Adding publications from lower-ranked journals to a good publication record lowers judgments of an academic's resume
www.sciencedirect.com/science/article/pii/S016748701830059X -
Jelte Wicherts
@JelteWicherts
The ten most cited randomised controlled trials (RCTs) ever published are all biased in one way or another.
www.tandfonline.com/doi/full/10.1080/07853890.2018.1453233 -
Jelte Wicherts
@JelteWicherts
Meta-study shows that registered trials report less beneficial treatment effects than unregistered trials.
www.sciencedirect.com/science/article/pii/S0895435617311381 -
Jelte Wicherts
@JelteWicherts
Random audits could shift the incentive for researchers from quantity to quality blogs.lse.ac.uk/impactofsocialsciences/2018/04/30/random-…
-
Jelte Wicherts
@JelteWicherts
The rich get richer pt.2: even in a system of equally talented scientists & egalitarian peer-to-peer funding, eventually disproportionate funding falls into the hands of a small group of scientists.
www.sciencedirect.com/science/article/pii/S0378437118303467 -
Jelte Wicherts
@JelteWicherts
The rich gets richer: winners of early career VENI grant who scored just above funding threshold accumulate much more funding during the subsequent 8 years as nonwinners with near-identical review scores.
www.pnas.org/content/early/2018/04/18/1719557115 -
Jelte Wicherts
@JelteWicherts
The high prevalence of “positive” results and the weak link between sample sizes & numbers of discovered foci reflect probable reporting biases in neuroimaging studies of sex differences
www.nature.com/articles/s41598-018-23976-1 -
Jelte Wicherts
@JelteWicherts
Chilling report of how Karolinska and the Lancet handled the misconduct of Paolo Macchiarini. As patients died, a market-oriented focus on brand & image prevailed over patient care and handling of misconduct.
www.sciencedirect.com/science/article/pii/S0048733318300817 -
Jelte Wicherts
@JelteWicherts
Only 25% of the syntaxes from structural equation modeling articles are available upon request www.tandfonline.com/doi/full/10.1080/08989621.2017.1396214
-
Jelte Wicherts
@JelteWicherts
Altmetrics predict citation impact among 245K psychology articles. Online media are becoming increasingly important as vehicles for disseminating scientific information in psychology.
link.springer.com/article/10.1007/s11192-018-2727-5 -
Jelte Wicherts
@JelteWicherts
The gender gap among life scientists mostly emerges between the post-doctoral and associate professor levels. Tenure/grant committees should know this. And the dads should care more.
www.sciencedirect.com/science/article/pii/S0048733318300404 -
Jelte Wicherts
@JelteWicherts
Only 155 out of 291 (53%) highly-ranked social science journals have data sharing policies. Only 53 journals (18%) require data sharing alongside articles. osf.io/preprints/socarxiv/9h7ay
-
Jelte Wicherts
@JelteWicherts
Ulster University withdraws professor emeritus status from Richard Lynn.
www.bbc.com/news/uk-northern-ireland-43768132 -
Jelte Wicherts reposted
Daniël Lakens
@lakens
Heading over to Utrecht today to talk about replication and falsification and listen to @FredHasselman @JelteWicherts and EJ Wagemakers in a James Coleman symposium in honor of @MALMvanAssen getting a prof in mathematical sociology chair at @UtrechtUni .
-
Jelte Wicherts reposted
Dan Quintana
@dsquintana
Do your folders look like this?
analysis.R
analysis_v2.R
analysis_v3.R
FINAL.R
THISONE.R
THISONE_v2.R
If so, you need version control.
Check out this excellent tutorial paper on using git in RStudio from @vuorre and @jalapic journals.sagepub.com/eprint/CxmDEDrWCmqw6sZTGNEh/full -
Jelte Wicherts
@JelteWicherts
Interesting study using PLOS ONE review data shows that reviewers with closer co-authorship ties to submitting authors are less likely to recommend rejection of neuroscientific papers.
arxiv.org/abs/1802.01270 -
Jelte Wicherts
@JelteWicherts
Despite clear signs of publication bias, the majority of 222 meta-analyses in (special) education research failed to use rigorous methods to check for & deal with publication bias
rdcu.be/K7ee -
Jelte Wicherts
@JelteWicherts
Estimating the Reproducibility of Experimental Philosophy: Around 70% of experimental philosophy studies successfully replicated in a large-scale replication project.
psyarxiv.com/sxdah -
Jelte Wicherts
@JelteWicherts
What’s wrong with the JIF in 5 graphs | Nature Index www.natureindex.com/news-blog/whats-wrong-with-the-jif-in…
-
Jelte Wicherts
@JelteWicherts
New data and reanalyses of old data highlight that item-level semantic priming effects are extremely unreliable
link.springer.com/article/10.3758/s13428-018-1040-9 -
Jelte Wicherts
@JelteWicherts
Integrity survey among Danish PhD students shows that 22% felt unethical pressure to add (or re-order) co-authors in the last year
ugeskriftet.dk/files/a5469_research_integrity_among_phd_s… -
Jelte Wicherts
@JelteWicherts
Study of RCTs shows that current bibliometric incentives lower innovation by encouraging scientists to run uninformative studies of subjects that are already being heavily investigated
dx.plos.org/10.1371/journal.pone.0195321 -
Jelte Wicherts
@JelteWicherts
The world of research has gone berserk: modeling the consequences of requiring “greater statistical stringency” for scientific publication
arxiv.org/abs/1803.06053 -
Jelte Wicherts
@JelteWicherts
Hot stuff bias and many more biases in the excellent Catalogue of Bias
catalogofbias.org/biases/hot-stuff-bias/ -
Jelte Wicherts reposted
Association for Psychological Science
@PsychScience
APS is proud to present the first issue of its unique and innovative new journal Advances in Methods and Practices in Psychological Science (#ampps for short!) journals.sagepub.com/toc/amp/current
-
Jelte Wicherts reposted
Daniël Lakens
@lakens
I'm looking for a post-doc on a project aimed at increasing the reliability and efficiency of psychological science (V39.3285). 75% research, 25% teaching, for 4 years. Please RT. jobs.tue.nl/nl/vacature/postdoc-on-increasing-the-reliabi…
-
Jelte Wicherts
@JelteWicherts
Social backlash of scientific misconduct: Citations to work by prior collaborators of scientific fraudsters drops 8-9% after exposure of misconduct.
www.sciencedirect.com/science/article/pii/S004873331830012X -
Jelte Wicherts
@JelteWicherts
Gaming the system: When in 2010 Italian universities incorporated citations in promotion decisions, self-citation rates among social scientists went up by 81-179%
www.sciencedirect.com/science/article/pii/S004873331730210X -
Jelte Wicherts
@JelteWicherts
Intriguing game theory analysis of p-hacking & Questionable Research Practices (QRPs). Reporting guidelines might reduce QRPs, while audits to deal with misconduct might actually backfire
www.sciencedirect.com/science/article/pii/S0048733317302111 -
Jelte Wicherts
@JelteWicherts
To rank scientists, Prof Z creates new citation metric for researchers' articles that uses ISI impact factor times 10 (+1!).
He names the new metric the Z score.
Yes, but, euhm....
www.sciencedirect.com/science/article/pii/S1532046417302265 -
Jelte Wicherts reposted
METRICStanford
@METRICStanford
Viewpoint: "The Proposal to Lower P Value Thresholds to .005" by John Ioannidis in @JAMA_current jamanetwork.com/journals/jama/fullarticle/2676503
-
Jelte Wicherts
@JelteWicherts
1-hour lecture on replicability crisis in psychology lowers trust in psych studies (and in replicability of Williams & Bargh, 2008), yet strengthens view that psychology is an exact science
journals.sagepub.com/doi/abs/10.1177/0098628318762900 -
Jelte Wicherts
@JelteWicherts
Reanalysis of PACE trial data based on original protocol-specified procedures yield no relevant effects bmcpsychology.biomedcentral.com/articles/10.1186/s40359-0… #bmcpsychology
-
Jelte Wicherts
@JelteWicherts
Simulation studies are often poorly reported.
arxiv.org/abs/1712.03198 -
Jelte Wicherts
@JelteWicherts
Something is smelly in software land.
Eleven common problems in software analytic papers
arxiv.org/pdf/1803.05518.pdf -
Jelte Wicherts reposted
Martin Enserink
@martinenserink
When asked to draw a scientist, school-age kids in the United States are increasingly sketching women. www.sciencemag.org/news/2018/03/what-does-scientist-look-… by @k_langin
-
Jelte Wicherts
@JelteWicherts
Undisclosed analytic flexibility makes it unacceptably easy to data mine for and selectively report consensus in Delphi processes
www.sciencedirect.com/science/article/pii/S0895435617300161 -
Jelte Wicherts
@JelteWicherts
Top ten errors of statistical analysis in observational studies
link.springer.com/article/10.1007/s12094-017-1817-9 -
Jelte Wicherts
@JelteWicherts
Misrepresentations and distortions of research results are common in the biomedical literature www.pnas.org/content/early/2018/03/08/1710755115
-
Jelte Wicherts
@JelteWicherts
John Ioannidis explains why research on research matters dx.plos.org/10.1371/journal.pbio.2005468
-
Jelte Wicherts
@JelteWicherts
Yet another study showing that the "sharing upon request" model of sharing data & code fails to ensure reproducibility for the majority of papers. How much evidence do stakeholders need to improve this situation?
www.pnas.org/content/115/11/2584 -
Jelte Wicherts
@JelteWicherts
An empirical analysis of journal policy effectiveness for computational reproducibility www.pnas.org/content/early/2018/03/08/1708290115
-
Jelte Wicherts
@JelteWicherts
Issues with data and analyses: Errors, underlying themes, and potential solutions www.pnas.org/content/early/2018/03/08/1708279115
-
Jelte Wicherts
@JelteWicherts
Low agreement among reviewers evaluating the same NIH grant applications www.pnas.org/content/early/2018/02/27/1714379115
-
Jelte Wicherts
@JelteWicherts
Trial completion status on registries is commonly inaccurate dx.plos.org/10.1371/journal.pone.0193088
-
Jelte Wicherts
@JelteWicherts
Around 8% of surveyed social and personality psychologists believe that pre-registration is not needed when researchers are honest. This reflects a poor understanding of human biases in research
journals.sagepub.com/doi/full/10.1177/2515245918757427 -
Jelte Wicherts reposted
Emil Kirkegaard
@KirkegaardEmil
Jelte Wicherts (@JelteWicherts) reviews methodological issues in contemporary science. www.mdpi.com/2076-2615/7/12/90/htm
-
Jelte Wicherts
@JelteWicherts
Study of 760K articles and 2M figures with a new figure reuse detection tool finds that 0.6% of articles contain fraudulent images. www.biorxiv.org/content/early/2018/02/22/269415.1
-
Jelte Wicherts
@JelteWicherts
In preclinical animal studies, multi-laboratory designs might increase reproducibility without a need for larger sample sizes dx.plos.org/10.1371/journal.pbio.2003693
-
Jelte Wicherts reposted
LSE Impact Blog
@LSEImpactBlog
statcheck – a spellchecker for statistics lse-blogs.demo.bbdtest.co.uk/impactofsocialsciences/?p=32609 #ecrchat #phdchat
-
Jelte Wicherts
@JelteWicherts
Nearly 80% of popular introduction to psychology textbooks contained factual errors in discussing intelligence and IQ
psycnet.apa.org/fulltext/2018-07714-001.pdf -
Jelte Wicherts
@JelteWicherts
Sharing and reuse of individual participant data from clinical trials: principles and recommendations bmjopen.bmj.com/content/7/12/e018647
-
Jelte Wicherts
@JelteWicherts
Early studies (of treatments for chronic diseases) commonly demonstrate an exaggerated treatment effect compared with subsequent studies www.mayoclinicproceedings.org/article/S0025-6196(17)30836…
-
Jelte Wicherts
@JelteWicherts
Lack of time is the most common reason to decline a request to review www.tandfonline.com/doi/full/10.1080/08989621.2018.1435280
-
Jelte Wicherts
@JelteWicherts
The search and selection for primary studies in systematic reviews published in dental journals indexed in MEDLINE was not fully reproducible
and (interesting subtitle):
I was not able to extract the web only files from the word doc
www.sciencedirect.com/science/article/pii/S0895435617307424 -
Jelte Wicherts
@JelteWicherts
Using OSF to Share Data: A Step-by-Step Guide by @cksoderberg journals.sagepub.com/doi/full/10.1177/2515245918757689
-
Jelte Wicherts
@JelteWicherts
Data sharing platforms contribute to open science, but some are also money-makers for private firms.
journals.sagepub.com/doi/abs/10.1177/2053951718756683 -
Jelte Wicherts
@JelteWicherts
Comparison of papers with and without problematic image duplication suggests that academic culture, peer control, cash-based publication incentives & national misconduct policies affect scientific integrity
link.springer.com/article/10.1007/s11948-018-0023-7 -
Jelte Wicherts
@JelteWicherts
Methodological and reporting quality in laboratory studies of human eating behavior
www.sciencedirect.com/science/article/pii/S0195666317316999 -
Jelte Wicherts
@JelteWicherts
"Sure I would be happy to share my data for €694. You see, we analysed all data by hand and would have to digitise them before sharing"
Reasons for not sharing in: www.bmj.com/content/360/bmj.k400 -
Jelte Wicherts
@JelteWicherts
A minority of Randomized Controlled Trials (RCTs) in top journals meet criteria for data availability. Only 37% of RCTs could be fully reproduced through reanalysis www.bmj.com/content/360/bmj.k400
-
Jelte Wicherts
@JelteWicherts
Data Sharing in Psychology: A Survey on Barriers and Preconditions journals.sagepub.com/doi/full/10.1177/2515245917751886
-
Jelte Wicherts
@JelteWicherts
Sharing is caring (for privacy): practical guidance on anonymising datasets trialsjournal.biomedcentral.com/articles/10.1186/s13063-0…
-
Jelte Wicherts reposted
Journal of Open Psychology Data
@up_jopd
"Data from, ‘Web-based Positive Psychology Interventions: A Reexamination of Effectiveness’" doi.org/10.5334/jopd.35
-
Jelte Wicherts
@JelteWicherts
Ulster University seeks to rid Richard Lynn of his longstanding professor emeritus title.
www.bbc.com/news/uk-northern-ireland-43043242
Jelte Wicherts
@JelteWicherts
I have criticised Lynn on many occasions, but would prefer academic debate above removing of titles.
-
Jelte Wicherts
@JelteWicherts
About 50% of authors fail to respond to requests for information that is needed for including their studies in meta-analyses. Meta-analysts suggest naming these non-responding authors in their meta-analysis to increase responsibility
www.sciencedirect.com/science/article/pii/S0895435618300258 -
Jelte Wicherts
@JelteWicherts
Taking an educational psychology course improves neuroscience literacy but does not reduce belief in neuromyths dx.plos.org/10.1371/journal.pone.0192163
-
Jelte Wicherts
@JelteWicherts
Quality science from quality measurement: The role of measurement type with respect to replication and effect size magnitude in psychological research dx.plos.org/10.1371/journal.pone.0192808
-
Jelte Wicherts
@JelteWicherts
Dynamics of co-authorship and productivity across different fields of scientific research dx.plos.org/10.1371/journal.pone.0189742
-
Jelte Wicherts
@JelteWicherts
Vacature Postdoc National Survey on Research Integrity refurl.nl/topwj1s2
-
Jelte Wicherts
@JelteWicherts
Over 90% of 590 surveyed researchers in health professions education admit to having engaged in at least one questionable research practice. QRP prevalences vary from 60% (adding guest authors) to 2% (fabrication)
www.biorxiv.org/content/biorxiv/early/2018/01/31/256982.f… -
Jelte Wicherts
@JelteWicherts
Focus on preferred findings and poor or flexible research designs are seen as the main determinants of selective reporting in science dx.plos.org/10.1371/journal.pone.0188247
-
Jelte Wicherts
@JelteWicherts
Author-suggested reviewers are 2.4 times more likely to recommend acceptance over rejection as opposed to reviewers not recommended by authors. onlinelibrary.wiley.com/doi/10.1111/jnc.14314/full/
-
Jelte Wicherts
@JelteWicherts
There are at least 13 different reasons for correcting or retracting an article.
Not all of them highlight quality.
Interesting review by Fanelli, Goodman, and Ioannidis onlinelibrary.wiley.com/doi/10.1111/eci.12898/full/ -
Jelte Wicherts
@JelteWicherts
Empirical critiques and ad hominem attacks have a similar impact on credibility of scientific claims. Allegations of conflicts of interest appear just as influential as allegations of outright fraud dx.plos.org/10.1371/journal.pone.0192025
-
Jelte Wicherts reposted
Alex J Bowers
@Alex_J_Bowers
Great paper that discusses 34 different researcher degrees of freedom to avoid to help prevent p-hacking. Are you doing #stats? Read this paper! @JelteWicherts doi.org/10.3389/fpsyg.2016.01832
-
Jelte Wicherts
@JelteWicherts
Improving the Replicability of Psychological Science Through Pedagogy journals.sagepub.com/doi/abs/10.1177/2515245917740427
-
Jelte Wicherts
@JelteWicherts
Survey among authors of 258 clinical trials shows that editors & peer reviewers ask for another primary outcome (in 3%), changes in analysis of primary outcome (27%), and supplementary (non-registered) analyses (36%).
trialsjournal.biomedcentral.com/articles/10.1186/s13063-0… -
Jelte Wicherts reposted
Jeromy Anglim
@JeromyAnglim
"Checklist for different types of researcher degrees of freedom in the planning, executing, analyzing, and reporting of psychological studies". via @JelteWicherts et al www.frontiersin.org/articles/10.3389/fpsyg.2016.01832/full
-
Jelte Wicherts
@JelteWicherts
There are at least 13 different reasons for citing an article.
Not all of them highlight quality.
Interesting review by @Imantahamtan @lutzbornmann
www.sciencedirect.com/science/article/pii/S1751157717302687 -
Jelte Wicherts
@JelteWicherts
Around 70% of articles in the Strategic Management Journal did not disclose sufficient data to assess reproducibility of findings
journals.sagepub.com/doi/abs/10.1177/1476127017701076 -
Jelte Wicherts reposted
Chris Chambers
@chrisdc77
This is why clinical trials should be published as Registered Reports, just as @BMCMedicine are now doing. See bmcmedicine.biomedcentral.com/about/registered-reports and cos.io/rr/
Jelte Wicherts
@JelteWicherts
Of 66 registered studies on intimate partner violence, 44% were registered after study began, 39% showed discrepancy in primary outcomes & 64% showed discrepancy in secondary outcome www.tandfonline.com/doi/full/10.1080/03630242.2017.1421287
-
Jelte Wicherts
@JelteWicherts
Of 66 registered studies on intimate partner violence, 44% were registered after study began, 39% showed discrepancy in primary outcomes & 64% showed discrepancy in secondary outcome www.tandfonline.com/doi/full/10.1080/03630242.2017.1421287
-
Jelte Wicherts
@JelteWicherts
Blog: Quantity does matter as citation impact increases with productivity blogs.lse.ac.uk/impactofsocialsciences/2018/01/23/quantit…
-
Jelte Wicherts
@JelteWicherts
Study of 196K MEDLINE articles show that around 14% of articles show discrepancies between published ratios and their reported confidence intervals & p-values academic.oup.com/bioinformatics/advance-article/doi/10.10…
-
Jelte Wicherts
@JelteWicherts
In computer science, authors' reputations predict whether submissions with negative reviews are rejected
www.sciencedirect.com/science/article/pii/S1751157717303176 -
Jelte Wicherts
@JelteWicherts
Calculating reproducibility www.sciencemag.org/news/2018/01/online-tool-calculates-re…
-
Jelte Wicherts
@JelteWicherts
Study among Norwegian researchers shows only weak correlation between no. of publications and salaries.
rdcu.be/FfUv -
Jelte Wicherts
@JelteWicherts
Centralized “big science” communities more likely generate non-replicable results
arxiv.org/pdf/1801.05042.pdf -
Jelte Wicherts
@JelteWicherts
Hyped headlines of research results have become more common, while journalists devote little to replication of initial findings. journals.sagepub.com/doi/abs/10.1177/1075547017752166
-
Jelte Wicherts
@JelteWicherts
Royal Netherlands Academy of Arts & Sciences @_knaw calls for more replication, increased transparency, better reporting, & pre-registration
www.knaw.nl/shared/resources/actueel/publicaties/pdf/2018… -
Jelte Wicherts
@JelteWicherts
Replication cricis blamed on gender of the experimenter advances.sciencemag.org/content/4/1/e1701427
-
Jelte Wicherts
@JelteWicherts
Decreasing available funding has negative consequences for the trustworthiness of science.
rsos.royalsocietypublishing.org/content/5/1/171511 -
Jelte Wicherts
@JelteWicherts
Doctoral thesis devoted to p-hacking uncovers biases in the literature on job strain and breast cancer
www.diva-portal.org/smash/get/diva2:1086273/FULLTEXT01.pdf -
Jelte Wicherts
@JelteWicherts
Fact or fiction: reducing the proportion and impact of false positives www.cambridge.org/core/journals/psychological-medicine/ar…
-
Jelte Wicherts
@JelteWicherts
Meta-study: Registered trials did not show higher chances of publication and citation rates as opposed to non-registered or retrospectively registered trials
onlinelibrary.wiley.com/doi/10.1111/anae.14189/full/ -
Jelte Wicherts
@JelteWicherts
Getting past Reviewer 2 pays off: Articles that are revised more often garner more citations. link.springer.com/article/10.1007/s11192-017-2630-5
-
Jelte Wicherts
@JelteWicherts
Review of meta-studies shows that in the biomedical literature around 39% of the abstracts are inconsistent with the full reports bmcmedresmethodol.biomedcentral.com/articles/10.1186/s128… #bmcmedresmethodol
-
Jelte Wicherts reposted
Dorothy Bishop (inactive account)
@deevybee
Great and v comprehensive review by @JelteWicherts on the weak spots in science and how to fix them www.mdpi.com/2076-2615/7/12/90/htm
-
Jelte Wicherts
@JelteWicherts
Survey on reading of scientific papers: while less experienced researchers read abstracts, more experienced researchers read methods and results dx.plos.org/10.1371/journal.pone.0189753
-
Jelte Wicherts
@JelteWicherts
Attitudes and norms affecting scientists’ data reuse dx.plos.org/10.1371/journal.pone.0189288
-
Jelte Wicherts
@JelteWicherts
Well done Michèle!
-
Jelte Wicherts
@JelteWicherts
Reputation matters: Newcomers disadvantaged by Single Blind Review (as opposed to Double Blind Review) in assessment of conference submissions link.springer.com/article/10.1007/s11192-017-2264-7
-
Jelte Wicherts
@JelteWicherts
Work on Experience Sampling Methodology!
Angélique Cramer
@angecramer
Spread the word, @TilburgU_TESC is currently hiring! 0.5fte, main tasks will consist of organizing various TESC activities (e.g., workshops, seminars) and supporting TESC researchers in their innovative experience sampling research. Link to vacancy: tiu.nu/12281.
-
Jelte Wicherts
@JelteWicherts
Registrations of statistical analyses of clinical trials should include at least 55 items jamanetwork.com/journals/jama/fullarticle/2666509
-
Jelte Wicherts
@JelteWicherts
Hypothesizing after the results are known (HARKing) comes in different shapes. Interesting article published by APA that does not let me share it because it is a non-profit organisation that makes big $$s in publishing.
-
Jelte Wicherts
@JelteWicherts
Meta-meta-alert! New article uses Web of Science to check how many articles used Web of Science since 1977 to study articles in different scientific fields. link.springer.com/article/10.1007/s11192-017-2622-5
-
Jelte Wicherts
@JelteWicherts
Review: for healthy older adults, cognitive training improves cognitive performance in the domain trained but not in other domains annals.org/aim/article-abstract/2666420/does-cognitive-tr…
-
Jelte Wicherts reposted
Collabra: Psychology
@CollabraOA
New article "Journal Data Sharing Policies and Statistical Reporting Inconsistencies in Psychology" doi.org/10.1525/collabra.102 @MicheleNuijten J.Borghuis @Coosje_Veldkamp L.Dominguez-Alvarez @MALMvanAssen @JelteWicherts
-
Jelte Wicherts
@JelteWicherts
Eight Rejected Papers That Won the Nobel Prize www.authorea.com/users/8850/articles/117724-nope-8-reject…
-
Jelte Wicherts
@JelteWicherts
Journal Data Sharing Policies and Statistical Reporting Inconsistencies in Psychology: www.collabra.org/article/10.1525/collabra.102
-
Jelte Wicherts
@JelteWicherts
The reliability of several popular cognitive tasks is surprisingly low. link.springer.com/article/10.3758/s13428-017-0935-1
-
Jelte Wicherts
@JelteWicherts
Meta-meta-analysis of 8K psychology studies from 200 meta-analyses shows typical effect sizes between small & medium. Medium power of psyc studies is only 36%
www.deakin.edu.au/__data/assets/pdf_file/0007/1198456/Wha… -
Jelte Wicherts reposted
The Sciku Project
@thescikuproject
Weak spots in science:
Error, bias, misconduct.
Solutions proposed.
@JelteWicherts #sciku #sciencehaiku
thescikuproject.com?p=652 -
Jelte Wicherts
@JelteWicherts
University of Amsterdam report finds peculiar data in yet another article in JEP:G co-authored by Jens Förster @RetractionWatch www.uva.nl/en/content/news/news/2017/12/dissertations-sup…
-
Jelte Wicherts
@JelteWicherts
Mysterious author named Et al published no fewer than 9896 articles in PsycINFO since 1806 www.bmj.com/content/359/bmj.j5706
-
Jelte Wicherts
@JelteWicherts
Most uncited articles appear in little-known journals.
Emil Kirkegaard
@KirkegaardEmil
How many papers really go uncited? www.nature.com/articles/d41586-017-08404-0
-
Jelte Wicherts
@JelteWicherts
Survey show that editors, authors and reviewers value open access, open data, & open peer review
#openscience dx.plos.org/10.1371/journal.pone.0189311 -
Jelte Wicherts
@JelteWicherts
Study of 13 million effect sizes in the biomedical literature shows that effects became smaller but more often statistically significant from 1990 to 2015 academic.oup.com/gigascience/advance-article/doi/10.1093/…
-
Jelte Wicherts
@JelteWicherts
Automatic detection of image manipulation in the life sciences link.springer.com/article/10.1007/s11948-016-9841-7
-
Jelte Wicherts
@JelteWicherts
Playing Super Mario 64 increases hippocampal grey matter in older adults dx.plos.org/10.1371/journal.pone.0187779
-
Jelte Wicherts
@JelteWicherts
Article on bias due to conflicts of interest retracted because of author's failure to disclose conflicts of interest link.springer.com/article/10.1007/s11948-015-9713-6
-
Jelte Wicherts
@JelteWicherts
Fact or fiction: reducing the proportion and impact of false positives www.cambridge.org/core/journals/psychological-medicine/ar…
-
Jelte Wicherts
@JelteWicherts
Survey (N=12K): Honorary authorships and coercive citations are pervasive across the sciences
dx.plos.org/10.1371/journal.pone.0187394 -
Jelte Wicherts
@JelteWicherts
Prior collaborators of misconducting scientists are cited 8 to 9% less after exposure of misconduct.
papers.ssrn.com/sol3/papers.cfm?abstract_id=3072290 -
Jelte Wicherts
@JelteWicherts
Many published psychological studies overestimate the actual effects link.springer.com/article/10.3758/s13428-017-0967-6
-
Jelte Wicherts
@JelteWicherts
The literature on violent video games is filled with false positive results www.sciencedirect.com/science/article/pii/S0160252717300973
-
Jelte Wicherts
@JelteWicherts
‘Are you siding with a personality or the grant proposal?’: observations on how peer review panels function researchintegrityjournal.biomedcentral.com/articles/10.11… #riprjournal
-
Jelte Wicherts
@JelteWicherts
Increasing awareness that Questionable Research Practices (QRPs) negatively affect scientific progress predict reduced acceptability of QRPs in a sample of NIH-funded researchers
journals.sagepub.com/doi/full/10.1177/1556264617743834 -
Jelte Wicherts
@JelteWicherts
Chauvinism in Citations. Authors over-cite articles from their compatriots
link.springer.com/article/10.1007/s11192-017-2490-z -
Jelte Wicherts
@JelteWicherts
Meta-meta-meta study alert: Systematic review of earlier reviews of extraction errors in systematic reviews shows pervasive errors (up to 50% error rate) in the extraction of study results. bmcmedresmethodol.biomedcentral.com/articles/10.1186/s128… #bmcmedresmethodol
-
Jelte Wicherts
@JelteWicherts
Quantifying publication bias in meta-analysis onlinelibrary.wiley.com/doi/10.1111/biom.12817/full/
-
Jelte Wicherts
@JelteWicherts
Controversial software is proving surprisingly accurate at spotting errors in psychology papers www.sciencemag.org/news/2017/11/controversial-software-pr…
-
Jelte Wicherts
@JelteWicherts
Five ways to fix statistics
www.nature.com/articles/d41586-017-07522-z -
Jelte Wicherts reposted
Susanna Louhimies
@SLouhimies
Excellent food for thought on reasons for #researchreproducibility crisis and bias with suggestions for ways forward - including the use of #registeredreports @RegReports , training, reporting guidelines, statistical tools www.mdpi.com/2076-2615/7/12/90/htm
-
Jelte Wicherts
@JelteWicherts
Randomized clinical trials include hundreds of outcomes & results, but most of these outcomes are not reported. Researchers and meta-analysts may cherry-pick results as they see fit
www.sciencedirect.com/science/article/pii/S089543561730121X -
Jelte Wicherts
@JelteWicherts
The Weak Spots in Contemporary Science (and How to Fix Them)
www.mdpi.com/2076-2615/7/12/90 -
Jelte Wicherts
@JelteWicherts
Early-career researchers believe that QRPs are widespread in psychology and feel that open science is necessary to improve research practice
econtent.hogrefe.com/doi/full/10.1027/1864-9335/a000324 -
Jelte Wicherts
@JelteWicherts
Common sample sizes (n = 20–30) display extremely low statistical power, poorly represent the actual effects in the full sample, and show large variation on subsequent replications journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
Scientist puts his dog on the editorial boards of seven predatory journals as proof of their negligence boingboing.net/2017/11/20/predatory-journals.html
-
Jelte Wicherts
@JelteWicherts
Norway’s total scholarly output (2011-2015): 68% of articles are openly available #openaccess
link.springer.com/article/10.1007/s11192-017-2554-0
pre-print: bora.uib.no/bitstream/handle/1956/16779/OA%2bnorwayBORA.p… -
Jelte Wicherts
@JelteWicherts
Imagining the “open” university: Sharing scholarship to improve research and education.
journals.plos.org/plosbiology/article?id=10.1371/journal.… -
Jelte Wicherts
@JelteWicherts
Study of 12K articles: Author order reflects author contributions, but majority of co-authors named in the middle do not qualify for authorship according to ICMJE guidelines
advances.sciencemag.org/content/3/11/e1700404.full -
Jelte Wicherts reposted
Daniël Lakens
@lakens
15-16 February 2018 2-day Reflections on Replications workshop in Utrecht, NL, organized by @ivanflis with @epskamp, @JelteWicherts , Klaus Fielder, me (see all speakers: roar.sites.uu.nl/speakers/) - free registration: roar.sites.uu.nl/registration/
-
Jelte Wicherts
@JelteWicherts
Citation-based metrics and readership counts are significantly more related to peer-rated quality of articles than tweets and the Altmetric Attention Score. arxiv.org/abs/1711.07291
-
Jelte Wicherts
@JelteWicherts
The corpus callosum as anatomical marker of intelligence? A critical examination in a large-scale developmental study
link.springer.com/article/10.1007/s00429-017-1493-0 -
Jelte Wicherts
@JelteWicherts
The Validity of the Tool “statcheck” to Discover Statistical Reporting Inconsistencies
psyarxiv.com/tcxaj -
Jelte Wicherts
@JelteWicherts
League of Legends game performance correlates with fluid intelligence
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Early career researchers want Open Science!
genomebiology.biomedcentral.com/articles/10.1186/s13059-0… -
Jelte Wicherts
@JelteWicherts
Only 25% of SEM syntaxes are shared upon request.
Our study on the poor availability of syntaxes of structural equation modeling now published in Accountability in Research www.tandfonline.com/doi/full/10.1080/08989621.2017.1396214 -
Jelte Wicherts
@JelteWicherts
Copiello & Bonifaci: ResearchGate's RG score is not a reliable indicator of scientific & academic reputation but a tool to implement the entrepreneurial strategy of the RG’s owner company.
link.springer.com/article/10.1007/s11192-017-2582-9 -
Jelte Wicherts
@JelteWicherts
Applied psychologists and management researchers show little awareness of Conflicts of Interest (COIs) www.tandfonline.com/doi/abs/10.1080/10508422.2017.1402683
-
Jelte Wicherts
@JelteWicherts
No fewer than 3 methodologists elected for the prestigious Young Academy!
Congrats to @dora_matzke @DanielOberski @angecramer
De Jonge Akademie
@DeJongeAkademie
Eind maart worden de tien nieuwe leden van De Jonge Akademie geïnstalleerd. Wil je weten wie dat zijn? Kijk op www.dejongeakademie.nl/nieuweleden
-
Jelte Wicherts
@JelteWicherts
The prevalence of marginal significance in psychology over time
psyarxiv.com/4dpq3/ -
Jelte Wicherts
@JelteWicherts
Narrative interviews with 80 scientists highlight tensions between good research practices and career goals muse.jhu.edu/article/677440/summary
-
Jelte Wicherts
@JelteWicherts
The human fallibility of scientists. Dealing with error and bias in academic research. @Coosje_Veldkamp’s thesis online files.osf.io/v1/resources/vc7rj/providers/osfstorage/59e8…
-
Jelte Wicherts
@JelteWicherts
Today @Coosje_Veldkamp will defend her excellent thesis. News item in Dutch. www.volkskrant.nl/wetenschap/hoe-gaan-we-het-beste-om-met…
-
Jelte Wicherts
@JelteWicherts
Women are underrepresented in the group of most productive researchers Study of 47K researchers hints at reasons why
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
From Discovery to Justification: Outline of an Ideal Research Program in Empirical Psychology www.frontiersin.org/articles/10.3389/fpsyg.2017.01847/full
-
Jelte Wicherts
@JelteWicherts
Percentage-based Author Contribution Index: a universal measure of author contribution to scientific articles
researchintegrityjournal.biomedcentral.com/articles/10.11… -
Jelte Wicherts
@JelteWicherts
Only 30% of systematic reviews of biomedical interventions mentioned access to datasets & statistical code
www.sciencedirect.com/science/article/pii/S0895435617305358 -
Jelte Wicherts
@JelteWicherts
Remember that study on race differences in IQ that assumed the earth to be flat & no climate change since last ice age?
now cited >100 times -
Jelte Wicherts reposted
Richard Smith
@Richard56
The exponential growth of preprints, and the explanation for the growth--the time that journals take to publish.
-
Jelte Wicherts
@JelteWicherts
Systematic review of the rigor of mindfulness research (171 studies) shows that methodology remains substandard
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Experiences with transparent review at the European Journal of Neuroscience are positive
onlinelibrary.wiley.com/doi/10.1111/ejn.13762/full -
Jelte Wicherts
@JelteWicherts
Sharing of science is most likely among male scientists
(60%of researchers indicating willingness to share data)
www.nature.com/articles/s41598-017-13491-0
Jelte Wicherts
@JelteWicherts
...but actual data sharing rate is likely much lower.
psycnet.apa.org/record/2006-12925-016
www.collabra.org/articles/10.1525/collabra.13/ -
Jelte Wicherts
@JelteWicherts
Pridemore, @MattMakel, & Plucker (2017) found only 178 actual replications (0.45%) in 39,275 criminology articles
www.annualreviews.org/doi/abs/10.1146/annurev-criminol-03… -
Jelte Wicherts
@JelteWicherts
Survey among psychologists (N=341): perceived benefits, norms of data sharing predict adoption of open data badge onlinelibrary.wiley.com/doi/10.1002/pra2.2017.14505401120…
-
Jelte Wicherts
@JelteWicherts
Statcheck in Canada: What Proportion of CPA Journal Articles Contain Errors in the Reporting of p-Values?
psyarxiv.com/39h47 -
Jelte Wicherts
@JelteWicherts
Survey on methods to reduce publication bias (N=233): researchers (but not editors) favor 2-stage peer review @PLOS journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
To Replicate or Not To Replicate? Exploring Reproducibility in Economics through the Lens of a Model onlinelibrary.wiley.com/doi/10.1111/ecoj.12527/full/
-
Jelte Wicherts
@JelteWicherts
Ioannidis et al. estimate the median statistical power in 6700 economy studies to be below 18% #bias onlinelibrary.wiley.com/doi/10.1111/ecoj.12461/full
-
Jelte Wicherts
@JelteWicherts
In new 2018 data policy, all research data from @TilburgU should be made publicly available (if reasonably possible) #openscience
-
Jelte Wicherts reposted
Chris Chambers
@chrisdc77
V important doctoral thesis by @Coosje_Veldkamp on how preregistration restricts of researcher degrees of freedom psyarxiv.com/g8cjq/
-
Jelte Wicherts
@JelteWicherts
The H-index is strongly related to co-author network centrality.
The H-index apparently stands for Handshake-Index papers.ssrn.com/sol3/papers.cfm?abstract_id=3045172 -
Jelte Wicherts
@JelteWicherts
Beyond questionable research methods: The role of omitted relevant research in the credibility of research. psycnet.apa.org/fulltext/2017-42708-001.html
-
Jelte Wicherts
@JelteWicherts
Survey (N=717): research misconduct more common among researchers at universities compared to industry $$ link.springer.com/article/10.1007/s11948-017-9957-4
-
Jelte Wicherts
@JelteWicherts
Many Published Clinical Trials Inadequately Registered
goo.gl/ytrPYa -
Jelte Wicherts
@JelteWicherts
In this psychology journal every single article gets an Open Data Badge.
Also, @up_jopd is now indexed in PsycINFO.
openpsychologydata.metajnl.com -
Jelte Wicherts
@JelteWicherts
A World Map of Scientific Misconduct
link.springer.com/article/10.1007/s11948-017-9939-6 -
Jelte Wicherts
@JelteWicherts
Millions of US dollars went to stereotype threat research. Yet ST literature filled with studies using overly small samples
This post is unavailable. See it on X. -
Jelte Wicherts
@JelteWicherts
Is Biomedical Research Protected from Predatory Reviewers? link.springer.com/article/10.1007/s11948-017-9964-5
-
Jelte Wicherts
@JelteWicherts
Availability of syntaxes from Structural Equation Modeling articles drops sharply over time. 25% SEM syntaxes shared
osf.io/qns25 -
Jelte Wicherts reposted
PsyArXiv-bot
@PsyArXivBot
Doctoral thesis: The human fallibility of scientists - dealing with error and bias in academic research osf.io/g8cjq/
-
Jelte Wicherts
@JelteWicherts
Tales of Research Misconduct: Reading Diederik Stapel’s Derailment as a Misconduct Novel.
Great OA book by Hub Zwart
link.springer.com/content/pdf/10.1007%2F978-3-319-65554-3… -
Jelte Wicherts
@JelteWicherts
Oops. "We mistakenly reported children ranging from 8 to 11 years old; [but they] were actually 3 to 5 years old" www.buzzfeed.com/stephaniemlee/who-really-ate-the-apples-…
-
Jelte Wicherts
@JelteWicherts
Distribution of P-values in medical research articles suggests selective reporting based on significance
www.jclinepi.com/article/S0895-4356(16)30838-1/fulltext -
Jelte Wicherts
@JelteWicherts
Men ask more questions than women at a scientific conference
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
The declining interest in an academic career
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Review of 35 meta-science studies covering over 3500 studies shows that spin is pervasive in biomedical research
journals.plos.org/plosbiology/article?id=10.1371/journal.… -
Jelte Wicherts reposted
SIPS (Account Archived - See Bio)
@improvingpsych
Join SIPS! Help improve psychological science by becoming an official member!
sips.wildapricot.org/join-sips -
Jelte Wicherts
@JelteWicherts
Biggest threat to quality of the literature is the indifferent acceptance of low-quality manuscripts by reviewers. journals.plos.org/plosone/article?id=10.1371%2Fjournal.po…
-
Jelte Wicherts
@JelteWicherts
Study: 85% of randomized-controlled trials investigating antipsychotic drugs changed pre-specified outcomes in pubs.
www.nature.com/tp/journal/v7/n9/full/tp2017203a.html -
Jelte Wicherts
@JelteWicherts
Many Dutch economists and psychologists recycle their own text across different articles. #self-plagiarism
www.sciencedirect.com/science/article/pii/S0048733317301543 -
Jelte Wicherts
@JelteWicherts
Selective reporting, inappropriate extrapolation & favourable data presentation are common in the biomed. literature
journals.plos.org/plosbiology/article?id=10.1371/journal.… -
Jelte Wicherts
@JelteWicherts
Even unbiased, perfectly randomized, reliably blinded, and faithfully executed clinical trials may be irreproducible bmcmedresmethodol.biomedcentral.com/articles/10.1186/s128…
-
Jelte Wicherts
@JelteWicherts
Meta-analysis: Papers with significant results cited 1.6 times more often than articles with nonsignificant results
www.sciencedirect.com/science/article/pii/S0895435616307508 -
Jelte Wicherts
@JelteWicherts
Great blog on data sharing in psychology by @MicheleNuijten
LSE Impact Blog
@LSEImpactBlog
New: Journal policies that encourage data sharing prove extremely effective, by @MicheleNuijten blogs.lse.ac.uk/impactofsocialsciences/2017/09/05/journal…
-
Jelte Wicherts
@JelteWicherts
Issues in the statistical detection of data fabrication and data errors in the scientific literature
www.biorxiv.org/content/early/2017/08/22/179135 -
Jelte Wicherts
@JelteWicherts
Self-marketing strategies are the rise in cross-cultural psychology journals.sagepub.com/doi/pdf/10.1177/0022022117724902
-
Jelte Wicherts
@JelteWicherts
Effect sizes, sample sizes, and power of psych studies more or less linked to citation rates www.ncbi.nlm.nih.gov/pmc/articles/PMC5504277/
-
Jelte Wicherts reposted
Rens van de Schoot
@RensvdSchoot
How many times are you allowed to re-analyze your data? Join the discussion with @JelteWicherts in #lofs @ECDP2017
@FSW_UU @MS_Utrecht -
Jelte Wicherts
@JelteWicherts
Most tweets about research articles are mechanical (but not this one). journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts reposted
Jop de Vrieze
@Jopinie
Ik sprak met @chartgerink over radicale vernieuwing in de wetenschap. 'Van de gevestigde orde komt het niet' www.groene.nl/artikel/vertrouwen-heeft-geen-plek-in-de-we…
-
Jelte Wicherts
@JelteWicherts
After a decade of not doing anything to promote open science, @APA FINALLY does the right thing by promoting pre-reg open data & pre-prints😀
Jeffrey Spies
@JeffSpies
Official PR: @APA & Center for #openscience partner on open badges, preferred @psyarxiv, & @OSFramework data repo! www.apa.org/news/press/releases/2017/08/open-science.aspx
Jelte Wicherts
@JelteWicherts
good moment to use my first emoji on twitter ever.
-
Jelte Wicherts
@JelteWicherts
So what do you think when you fabricate your psychological research data? These researchers are happy to share their thoughts.
-
Jelte Wicherts reposted
ScienceGuide
@ScienceguideNL
Replicatiestudies zijn belangrijk voor het corrigerend vermogen wetenschap. @NWONieuws www.scienceguide.nl/2017/07/positief-prikkelen/ @JelteWicherts @TilburgU
-
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
Preprint by @MicheleNuijten et al on the effectiveness of open data policies: Req'd, incentivize, none. Guess which? osf.io/preprints/psyarxiv/sgbta
-
Jelte Wicherts
@JelteWicherts
We received a @NWOMaGW grant to conduct a large-scale registered replication of the stereotype threat effect. www.nwo.nl/en/news-and-events/news/2017/social-sciences/r…
Jelte Wicherts
@JelteWicherts
But at <11% funding rate in this replication grant round, it's clear that more funds should be allocated to replication research @NWONieuws
Jelte Wicherts
@JelteWicherts
Also pls contact me if you're interested in joining our meta-research group to conduct this RRR. Mix of social psy & psychometrics
-
Jelte Wicherts
@JelteWicherts
Reanalysis of data from Pietschnig et al. on link between brain size & IQ
If you select & correct, correlation becomes higher.
Gilles Gignac
@GillesEGignac
New meta-anlys: Brain size and IQ cor is moderated by IQ measurement quality:fair r=.23, good r=.32, excellent r=.39 docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbW…
-
Jelte Wicherts reposted
Journal of Open Psychology Data
@up_jopd
Yours for the mining. openpsychologydata.metajnl.com/articles/10.5334/jopd.29
-
Jelte Wicherts reposted
Journal of Open Psychology Data
@up_jopd
Like all our papers, this one on relative meaning frequencies is 100% open access. Take a look! openpsychologydata.metajnl.com/articles/10.5334/jopd.28/
-
Jelte Wicherts
@JelteWicherts
Replication issues: In 1968, Barber criticised Rosenthal's work on experimenter expectancy effects on these grounds
psycnet.apa.org/journals/bul/70/6p2/48/ -
Jelte Wicherts
@JelteWicherts
Still 3 days left to apply for a (4 yr & fully paid) PhD position on meta-research & reproducibility in psyc science
www.academictransfer.com/employer/UVT/vacancy/40820/lang/en/ -
Jelte Wicherts
@JelteWicherts
We are looking for a postdoc to develop differential privacy & related holdout sample methods for psychological data
www.academictransfer.com/employer/UVT/vacancy/40819/lang/en/ -
Jelte Wicherts
@JelteWicherts
PhD students need formal APA approval to use their own work in doctoral dissertation after having published with the APA #openscience #oa
-
Jelte Wicherts reposted
Chris Chambers
@chrisdc77
Actions by @APA to protect scientific integrity:
Sign TOP guidelines❌
Require data sharing❌
Saying no to torture❌
Issuing takedown threats☑️ -
Jelte Wicherts reposted
ScienceGuide
@ScienceguideNL
Hoe maken onderzoekers 'nep-data' en waar zie je dat aan? @chartgerink en @JelteWicherts onderzoeken het: www.scienceguide.nl/2017/06/fraudeurs-vangen-met-wetenschap/ @TilburgU
-
Jelte Wicherts reposted
JEPS - Journal of European Psychology Students
@efpsa_jeps
Very exciting PhD openings to work on reproducibility in psychology with @JelteWicherts career012.successfactors.eu/career?career_ns=job_listing&…
-
Jelte Wicherts reposted
BITSS
@UCBITSS
Announcing Open Enrollment for the BITSS MOOC: Transparent and Open Social Science Research www.bitss.org/2017/06/01/announcing-open-enrollment-for-t…
-
Jelte Wicherts
@JelteWicherts
Come join our meta research group in Tilburg as a PhD student in reproducibility and improve psychological science www.academictransfer.com/employer/UVT/vacancy/40820/lang/en/
-
Jelte Wicherts
@JelteWicherts
Come join our meta research group in Tilburg as a postdoc and improve psychological science www.academictransfer.com/employer/UVT/vacancy/40819/lang/en/
-
Jelte Wicherts
@JelteWicherts
New stat results in Jens Förster case: 500k unpublished studies needed to explain pattern in one paper. It's not the file drawer #wcri2017
-
Jelte Wicherts
@JelteWicherts
Not so open data @bmj_latest: despite guideline, data from 4.5% of 157 BMJ articles readily available #wcri2017 @AnisaFarid
-
Jelte Wicherts reposted
Ash Paul
@pash22
Checklist 2 Avoid p-Hacking in Psych' studies journal.frontiersin.org/article/10.3389/fpsyg.2016.01832/… via @JelteWicherts
-
Jelte Wicherts
@JelteWicherts
Kevin Cohen studied reproducibility for years & then checked his own papers #scientistsrhuman #wcri2017
-
Jelte Wicherts
@JelteWicherts
Scientists Think They're More Rational Than Other People
www.scientificamerican.com/article/scientists-think-theyr… -
Jelte Wicherts
@JelteWicherts
Yes! Journal of Experimental Social Psychology is handing out badges for open data, materials, & pre-registration
www.elsevier.com/journals/journal-of-experimental-social-… -
Jelte Wicherts
@JelteWicherts
Wohooo!!! Journal of Experimental Social Psychology is handing out badges for open data & open materials.
www.sciencedirect.com/science/article/pii/S0022103116306436 -
Jelte Wicherts
@JelteWicherts
Meticulous manuscripts, messy results: Working together for robust science reporting.
onlinelibrary.wiley.com/doi/10.1002/smi.2756/full -
Jelte Wicherts
@JelteWicherts
Latest study on sex differences in IQ & brain size uses completely outdated & substandard methods incl. median split
www.sciencedirect.com/science/article/pii/S0160289616302975
Jelte Wicherts
@JelteWicherts
study shld use MGCFA with mimic model & rigorous test of hypo that differences are on g & due to brain size diffs.
www.tandfonline.com/doi/abs/10.1080/17588928.2011.628383 -
Jelte Wicherts reposted
Michael Markie
@MMMarksman
Interesting read; willingness to share data is related to strength of evidence & quality of statistical reporting: journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
Bayesian evaluation of effect size after replicating an original study journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
PsychOpen uses Statcheck tool for quality check
www.zpid.de/index.php?wahl=news&uwahl=news490&lang=EN -
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
Doubt the value of open data? Two new papers THIS WEEK re-using Reproducibility Project www.collabra.org/articles/10.1525/collabra.71/, scholar.harvard.edu/kasy/publications/identification-and-…
-
Jelte Wicherts reposted
Daniël Lakens
@lakens
Now @JelteWicherts gives 34 ways to p-hack your data* (based on journal.frontiersin.org/article/10.3389/fpsyg.2016.01832/…). *Can also be used to prevent p-hacking #icps17vie
-
Jelte Wicherts
@JelteWicherts
Our session on transparency and preregistration at 2pm in room N1 #icps17vie
-
Jelte Wicherts reposted
Etienne P. LeBel
@eplebel
QRP self-admission rates generalizes to Italians suggest interntl phenomenon tied to systemic features of academia
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts reposted
AcademicTransfer
@AcademicTrnsfr
PhD student on Decoding emotions from the brain, Departments of Cognitive Neuropsychology and Methodolo... www.academictransfer.com/39321/lang/en @TilburgU
-
Jelte Wicherts reposted
Neuroskeptic 🇺🇦
@Neuro_Skeptic
Italian researchers are less likely to condone questionable research practices than Americans, but still use them www.ncbi.nlm.nih.gov/pubmed/28296929?dopt=Abstract
-
Jelte Wicherts
@JelteWicherts
Questionable research practices among italian research psychologists: 88% admitted using 1+ QRP in their research
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts reposted
Retraction Watch
@RetractionWatch
Does the @APA really want to be the publishing equivalent of a shady used car dealer? www.statnews.com/2017/03/10/data-sharing-scientists/
-
Jelte Wicherts reposted
Center for Open Science
@OSFramework
Preregistration: improved rigor, improved workflow - BioMed Central blog - blogs.biomedcentral.com/bmcblog/2016/02/17/preregistratio… @BioMedCentral
-
Jelte Wicherts
@JelteWicherts
Evidence in favor of widespread p-hacking based on p-value dist. not as strong as Head et al. concluded @chartgerink peerj.com/articles/3068/
-
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
ICYMI: Degrees of Freedom in Planning, Running, Analyzing, & Reporting Psych Studies: A Checklist to Avoid p-Hacking journal.frontiersin.org/article/10.3389/fpsyg.2016.01832/…
-
Jelte Wicherts
@JelteWicherts
The @APA once required users of "open data" to apply using this form. Not following up reqs. meant $10K fine www.dropbox.com/s/nvesuir27254ff0/letter_apa_01.pdf?dl=0
-
Jelte Wicherts
@JelteWicherts
Vacancy: Assistant Professor in Methodology and Statistics (Tenure Track, full-time) Tilburg University www.academictransfer.com/employer/UVT/vacancy/38924/lang/en/
-
Jelte Wicherts
@JelteWicherts
Editor asked to resign from @APA_Journals after asking to see data. Yet requirement is in the APA publication manual www.nature.com/news/peer-review-activists-push-psychology…
-
Jelte Wicherts reposted
nature
@Nature
Peer-review activists push psychology journals towards open data after
editor asked to resign from journal: go.nature.com/2m7TES1 -
Jelte Wicherts
@JelteWicherts
The hi-tech war on science fraud. @guardian's long read about @chartgerink's work.
www.theguardian.com/science/2017/feb/01/high-tech-war-on-… -
Jelte Wicherts
@JelteWicherts
Who Believes in the Storybook Image of the Scientist? Scientists and lay people put scientists on a pedestal
www.tandfonline.com/doi/full/10.1080/08989621.2016.1268922 -
Jelte Wicherts reposted
Eelco Heer en MEester - ☮︎☮︎☮︎☮︎ -
@ontwarontwaar
EdgeofHeaven, I gave you my heart, the very next day you gave it away, Father Jesus, wake me up before you gogo, careless whispering freedom
-
Jelte Wicherts reposted
Neuroskeptic 🇺🇦
@Neuro_Skeptic
Senior scientists say that PhD students have more integrity than postdocs blogs.discovermagazine.com/neuroskeptic/2016/12/23/what-s…
-
Jelte Wicherts reposted
nature
@Nature
Swiss survey highlights potential flaws in animal studies go.nature.com/2i5IvQj
-
Jelte Wicherts
@JelteWicherts
Non-registered clinical trials (48%) less likely to be published than registered trials (75%) journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts reposted
Neuroskeptic 🇺🇦
@Neuro_Skeptic
Degrees of Freedom in Psychological Studies: A Checklist to Avoid p-Hacking www.ncbi.nlm.nih.gov/pubmed/27933012?dopt=Abstract from @JelteWicherts et al.
-
Jelte Wicherts reposted
Richard Smith
@Richard56
Peer review post-mortem: how a flawed aging study got published in Nature www.nrc.nl/nieuws/2016/12/08/how-weak-science-slipped-pas… via @nrc
-
Jelte Wicherts
@JelteWicherts
Proud of my PhD student @MicheleNuijten (& kudos to @SachaEpskamp) Great recognition for all the hard work
-
Jelte Wicherts
@JelteWicherts
Honored & energized by obtaining an @ERC_Research Consolidator Grant of €2m to further improve methodological & stat. rigor in psychology!
-
Jelte Wicherts
@JelteWicherts
Scrutiny of papers is to be welcomed. @Nature editorial discusses use of statcheck in post publication review www.nature.com/news/post-publication-criticism-is-crucial…
-
Jelte Wicherts reposted
Mike Tamir, PhD
@MikeTamir
Degrees of freedom: A checklist to avoid p-hacking www.frontiersin.org/journals/psychology/articles/10.3389/… #machinelearning #datascience
-
Jelte Wicherts reposted
nature
@Nature
Stat-checking software stirs up psychology go.nature.com/2gGQfaP
-
Jelte Wicherts
@JelteWicherts
Degrees of Freedom in Planning, Running, Analyzing & Reporting Psychological Studies: A Checklist to Avoid p-Hacking
journal.frontiersin.org/article/10.3389/fpsyg.2016.01832/… -
Jelte Wicherts
@JelteWicherts
Experts: selective reporting, selective citing, flawed quality control & poor mentoring biggest problems in science researchintegrityjournal.biomedcentral.com/articles/10.11…
-
Jelte Wicherts
@JelteWicherts
I published a paper with nonsensical results to show that this trend ain't linear. www.sciencedirect.com/science/article/pii/S0160289616303233
preprint: osf.io/g23ud/ -
Jelte Wicherts
@JelteWicherts
Degrees of freedom in planning, running, analyzing & reporting psychological studies. A checklist to avoid p-hacking
journal.frontiersin.org/article/10.3389/fpsyg.2016.01832/… -
Jelte Wicherts
@JelteWicherts
Positive views on @realDonaldTrump associated with lower cognitive ability (and right-wing authoritarianism).
www.sciencedirect.com/science/article/pii/S0191886916310911 -
Jelte Wicherts
@JelteWicherts
DGPs discussing statcheck, 2 PhD students on @RetractionWatch, & Tilburg meta-research group keeps up the good work retractionwatch.com/2016/10/25/psychological-society-want…
-
Jelte Wicherts
@JelteWicherts
So Fiske made a typo in her APS column: she meant methodological error instead of methodological terror. We all want to minimize errors
-
Jelte Wicherts
@JelteWicherts
Conducting Meta-Analyses Based on p Values: Reservations and Recommendations for Applying p-Uniform and p-Curve
pps.sagepub.com/content/11/5/713.full.pdf+html -
Jelte Wicherts
@JelteWicherts
Personality Traits Are Associated with Research Misbehavior in Dutch Scientists: A Cross-Sectional Study
journals.plos.org/plosone/article?id=10.1371/journal.pone…
Jelte Wicherts
@JelteWicherts
No idea. 1st time I have seen the paper ;-)
No seriously: PLOS asks for author contributions. -
Jelte Wicherts
@JelteWicherts
Statcheck has checked the paper that inspired its development & found it to misreport several statistics. Well Duh!!
pubpeer.com/publications/63CD16D80B6B97C6966645D6AE8D3B
Jelte Wicherts
@JelteWicherts
-
Jelte Wicherts
@JelteWicherts
Power in cognitive neuroscience is even lower than power in psychology: study of 10K papers
biorxiv.org/content/early/2016/08/25/071530 -
Jelte Wicherts
@JelteWicherts
Oops. Excel is screwing up quite a lot of gene names by converting them to dates.
Martin Paul Eve
@martin_eve
20% of Scientific Papers On Genes Contain Conversion Errors Caused By Excel, Says Report slashdot.org/~r/Slashdot/slashdot/~3/Yt7-uoi-MRU/20-of-sc…
-
Jelte Wicherts
@JelteWicherts
After publishing 8 papers with weird data, Jens Förster is not going to get tenure at Ruhr University Bochum www.sciencemag.org/news/2016/07/no-tenure-german-social-p…
-
Jelte Wicherts
@JelteWicherts
Cortical thickness at age 70 can be predicted by IQ at age 11. @LarsPenke #isir16
-
Jelte Wicherts
@JelteWicherts
Myths about genes and education. Yulia Kovas speaks #isir16
-
Jelte Wicherts
@JelteWicherts
Those who want to join our meta-research group or our department of methodology & statistics have 2 days to apply
Jelte Wicherts
@JelteWicherts
Our dept. is looking for 2 assist. professors & 1 postdoc in Methodology & Statistics, Psychometrics or Data Science
www.academictransfer.com/employer/UVT/vacancy/34713/lang/en/ -
Jelte Wicherts
@JelteWicherts
Lit. review: 91% of 61 studies on questionable research practices showed QRPs to be common
link.springer.com/article/10.1007/s10869-016-9456-7 -
Jelte Wicherts
@JelteWicherts
New data paper @up_jopd on the over maintenance of intentions by Hester Ruigendijk & @SLKoole openpsychologydata.metajnl.com/article/10.5334/jopd.22/
-
Jelte Wicherts reposted
Neuroskeptic 🇺🇦
@Neuro_Skeptic
A study of research psychologist's intuitions about statistical power: they systematically overestimate it www.ncbi.nlm.nih.gov/pubmed/27354203?dopt=Abstract Uh-oh
-
Jelte Wicherts reposted
Monya Baker
@Monya_science
Don't use your thumb for a ruler: Psychologists overestimate what sample sizes can detect @JelteWicherts
pss.sagepub.com/content/early/2016/06/28/0956797616647519… -
Jelte Wicherts
@JelteWicherts
Ouch! Validity of 40,000 fMRI studies called into question.
m.pnas.org/content/early/2016/06/27/1602413113.full.pdf -
Jelte Wicherts
@JelteWicherts
Psychological researchers (N=291+214) strongly overestimate power in studying small effects
pss.sagepub.com/content/early/2016/06/28/0956797616647519… -
Jelte Wicherts
@JelteWicherts
Our dept. is looking for 2 assist. professors & 1 postdoc in Methodology & Statistics, Psychometrics or Data Science
www.academictransfer.com/employer/UVT/vacancy/34713/lang/en/ -
Jelte Wicherts reposted
Rebecca Steketee
@rme_steketee
Data sharing is caring - @JelteWicherts Mix & Match meeting 2016 @alzheimernl
-
Jelte Wicherts
@JelteWicherts
Established scientist rate PhD students as being higher in integrity than early career scientists #aps16chi
-
Jelte Wicherts
@JelteWicherts
@chartgerink just exposed 10 fabricated datasets using the Fisher test #aps16chi
-
Jelte Wicherts
@JelteWicherts
Can we still trust psychology? Our session today at 11.30 in room Michigan A #aps16chi
-
Jelte Wicherts
@JelteWicherts
Another session on statistics leading to a sit-inn by students #aps16chi
-
Jelte Wicherts reposted
Gesa van den Broek
@gesavdb
#ord2016 fascinerende Keynote door @jeltewicherts over zwakke plekken in de wetenschap(per).
-
Jelte Wicherts reposted
Nïck Brown🌻
@sTeamTraen
How GRIM are the reporting problems in psychological research? Our new preprint: peerj.com/preprints/2064/ Comments welcome!
-
Jelte Wicherts
@JelteWicherts
Handing out badges for open data is associated with surge in open data. journals.plos.org/plosbiology/article?id=10.1371/journal.…
Jelte Wicherts
@JelteWicherts
I have tried for more than a decade to get psychologists to share data and never imagined that badges (& posit. zeitgeist) would do the job
-
Jelte Wicherts
@JelteWicherts
I guess this means I need to update the DOAJ norms in my peer review transparency paper...journals.plos.org/plosone/article?id=10.1371/journal.pone…
nature
@Nature
#openaccess index @DOAJplus delists thousands of journals after tightening quality criteria www.nature.com/articles/nature.2016.19871
-
Jelte Wicherts
@JelteWicherts
DOAJ does necessary housecleaning of its OA list (after our work showing low transparency among many OA journals) x.com/richvn/status/729742990101581824
-
Jelte Wicherts reposted
Eiko Fried
@EikoFried
"Distributions of p-values smaller than .05 in psychology: what is going on?"
@JelteWicherts @MicheleNuijten -
Jelte Wicherts
@JelteWicherts
The 1st Netherlands Research Integrity Network research conference is held in three weeks in Amsterdam. Nice lineup!
www.nrin.nl/research-conference-2016 -
Jelte Wicherts
@JelteWicherts
Brilliant intelligence researcher Earl "Buz" Hunt passed away at the age of 83. www.youtube.com/watch?v=W2kZAkbbIOw
Jelte Wicherts
@JelteWicherts
Once I had to go before a talk: I explained that I got a call from nature but that it wasn't for a paper. The 1st & loudest laugh was Buz's
-
Jelte Wicherts reposted
Liz Wager
@SideviewLiz
Useful checklist for jnl transparency from @JelteWicherts journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
Article on my peer review article (in Dutch)
Gemma
@GI_duz
Kwaliteit van peer review. In: De Psycholoog, 51(3) ►verwijst naar artikel v. @JelteWicherts dx.doi.org/10.1371/journal.pone.0147913
-
Jelte Wicherts
@JelteWicherts
Study (N=7071): The width of confidence intervals in psychology is embarrassingly large
prx.sagepub.com/content/118/1/154.full.pdf+html -
Jelte Wicherts
@JelteWicherts
Despite guidelines, most NSF funded projects fail to share data & shared data were often of "questionable usability"
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Two more failed replications of Jens Förster's infamous GLOMOsys model.
www.donvanravenzwaaij.com/Papers_files/Field et al, 2016.pdf -
Jelte Wicherts
@JelteWicherts
Of 4347 clinical trials from top medical centers only 66% publishd aftr 2 yrs. What a waste! www.bmj.com/content/352/bmj.i637
-
Jelte Wicherts
@JelteWicherts
Two articles by Jens Förster in JEP:G retracted bc of "low veracity"
psycnet.apa.org/journals/xge/145/3/265/
psycnet.apa.org/journals/xge/145/3/272/ -
Jelte Wicherts
@JelteWicherts
Retired prof starts think tank. Hires student. Reviews his student's paper. Declares no conflict of interest. mmm.
-
Jelte Wicherts
@JelteWicherts
I got a Call for Paper this morning.
Here you go! Paper's on its way. -
Jelte Wicherts reposted
L.J Zigerell
@LJZigerell
Fantastic detective work by @hpashler, @JelteWicherts, and others. www.tandfonline.com/doi/full/10.1080/01973533.2015.1124767 (Via @mavadillo)
-
Jelte Wicherts reposted
John Doove
@JDoove
@JelteWicherts in @PLOSONE: "Transparency of peer-review process can be seen as an indicator of peer-review quality" journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
Assessing transparency of peer review in OA journals
journals.plos.org/plosone/article?id=10.1371/journal.pone…
@OpenAIRE_eu @FWFOpenAccess @Open_access @openscience -
Jelte Wicherts
@JelteWicherts
Interview on my PLOS ONE article on peer review transparency [in Dutch] www.volkskrant.nl/wetenschap/-anoniem-oordeel-schaadt-wet…
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
In Study 2, International Journal of Recent Scientific Research received a rather low score journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
Journals offering low quality peer review often lack transparency
Here's a tool to separate the wheat from the chaff
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Post not available here, view on X
Jelte Wicherts
@JelteWicherts
@hpashler ouch. Has anyone tried to explain the small study effect in substantive terms? Statistically at least it is easy to explain.
-
Jelte Wicherts
@JelteWicherts
Of 268 randomly chosen empirical biomed articles, none provided access to raw data. Only 4 studies were replications journals.plos.org/plosbiology/article?id=10.1371/journal.…
-
Jelte Wicherts
@JelteWicherts
New Research Master Individual Differences & Assessment @TilburgU
Looking forward to teaching those smart students www.tilburguniversity.edu/education/masters-programmes/in… -
Jelte Wicherts
@JelteWicherts
Which part of my profile or my >500 academic connections make @LinkedIn think I'd want to sell jewellery or cookies?
-
Jelte Wicherts
@JelteWicherts
Psychology majors are agreeable & neurotic
Economy majors are extraverted
Arts/Human. majors are open to experience
www.sciencedirect.com/science/article/pii/S0191886915300921 -
Jelte Wicherts
@JelteWicherts
Just 13% of articles in top journals in biology, chemistry, math & physics have open data
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Wiley & Sons. & EJSP respond swiftly to Diederik Stapel's admission of fabricating data. 3 years, seriously!?!
-
Jelte Wicherts
@JelteWicherts
Survey: 20% of Dutch citizens believe that scientists adapt data to obtain desired answers www.rathenau.nl/nl/publicatie/vertrouwen-de-wetenschap-2015
-
Jelte Wicherts
@JelteWicherts
APA explains use of semicolons when presenting non-significant results as being significant. blog.apastyle.org/apastyle/2010/06/formatting-statistics-…
Jelte Wicherts
@JelteWicherts
FYI, @JelteWicherts recomputed p-values are .078, .253, and .137.
-
Jelte Wicherts reposted
Christie Aschwanden
@cragcrest
Herd of p-values spotted approaching significance. @JelteWicherts #metricsconf15
-
Jelte Wicherts
@JelteWicherts
NIH grant success dropped considerably over the last decades. Does this lead to more poor practices? #metricsconf15
-
Jelte Wicherts
@JelteWicherts
Open data badge leads to open data in Psych Scie @BrianNosek #metricsconf15
-
Jelte Wicherts
@JelteWicherts
Two JEP:G articles by Jens Förster to be retracted. Rest of articles are also weird, but app. not studied further
Rolf Degen
@DegenRolf
Embattled psychologists Jens Förster will call in two more retractions, in exchange for termination of proceedings. www.dgps.de/index.php?id=143&tx_ttnews[tt_news]=1653&cHas…
-
Jelte Wicherts
@JelteWicherts
Authors' brave retraction of Psych Scie article following reanalysis shows benefits of open data in cleaning up lit
Ivan Oransky
@ivanoransky
Got the blues? You can still see blue: Popular paper on sadness, color perception retracted retractionwatch.com/2015/11/05/got-the-blues-you-can-stil…
-
Jelte Wicherts
@JelteWicherts
That would be cool indeed! x.com/PubPeer/status/659684966616403968
-
Jelte Wicherts
@JelteWicherts
Volkskrant today: statcheck finds errors in 13% of psychology articles, secretary resigns, King preaches, what now?
-
Jelte Wicherts
@JelteWicherts
Yes @MicheleNuijten and @SachaEpskamp, smart software indeed.
Go Statcheck!
nature
@Nature
Smart software spots statistical errors in psychology papers www.nature.com/articles/nature.2015.18657
-
Jelte Wicherts
@JelteWicherts
Since 1985, the number of p-values per article in JPSP nearly tripled; p<.05.
link.springer.com/article/10.3758/s13428-015-0664-2 -
Jelte Wicherts
@JelteWicherts
About 70% of articles in psychology use NHST
Nearly 50% show errors in reporting of p-values
link.springer.com/article/10.3758/s13428-015-0664-2 -
Jelte Wicherts
@JelteWicherts
German Psychological Society is investigating possible data manipulation in work by Jens Förster @kolfschooten frankvankolfschooten.nl/wordpress/?p=817
-
Jelte Wicherts
@JelteWicherts
Progress! Data sharing in psychology (398 APA articles) now back at level (38%) from 1973! www.collabra.org/articles/10.1525/collabra.13/
-
Jelte Wicherts reposted
Lars Penke
@LarsPenke
Our meta-analysis on brain volume and #iq is now available at Neuroscience & Biobehavioral Reviews www.sciencedirect.com/science/article/pii/S014976341500250X @JelteWicherts
-
Jelte Wicherts
@JelteWicherts
A book about literature review from 1981 by one of my mentors (in Dutch) discussing "the computer"
-
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
How cognitive biases manufacture beautiful results and what to do about it. Feature story in Nature: www.nature.com/news/how-scientists-fool-themselves-and-ho…
-
Jelte Wicherts
@JelteWicherts
Study: 31 emailed requests for data to replicate SEMs yield 4 positive answers (87% non-reps)
www.tandfonline.com/doi/abs/10.1080/15305058.2010.482219 -
Jelte Wicherts
@JelteWicherts
Hi @ElsevierNews I happily do reviews, but you should take steps towards @Open_access in negotiations with @deVSNU
-
Jelte Wicherts
@JelteWicherts
How 3 tweets led to an inquiry, a reanalysis & a correction in JESP @chartgerink @gill1109 @mkeulemans retractionwatch.com/2015/10/01/yes-violent-lyrics-affect-…
-
Jelte Wicherts reposted
NYT Science
@NYTScience
Talk therapy for depression isn't as effective as studies have suggested, new analysis finds www.nytimes.com/2015/10/01/health/study-finds-psychothera…
-
Jelte Wicherts
@JelteWicherts
Pfew! Glad I wasn't elected as Dutch science talent 2015. Winner forced to go to Abu Dhabi. I'll just stay @TilburgU www.volkskrant.nl/wetenschap/wetenschap-vreest-uittocht-t…
-
Jelte Wicherts
@JelteWicherts
Our meta-analysis (n>8000) of correlation bw. brain size & IQ shows decline effect. r=.24
papers.ssrn.com/sol3/papers.cfm?abstract_id=2512128 -
Jelte Wicherts reposted
Elliot Tucker-Drob
@tuckerdrob
John Loehlin's 2015 ISIR Lifetime Achievement Award acceptance poem. www.dropbox.com/scl/fi/o41axgyfvoharyxvxijhp/Loehlin-2015… #isir2015
@timothycbates @eawilloughby -
Jelte Wicherts
@JelteWicherts
Replacing outlying values /w means leads to retraction in Psych Scie retractionwatch.com/2015/09/28/4th-ori-flagged-paper-by-o…
Here's a better method:
www.researchgate.net/profile/Jelte_Wicherts/publication/2… -
Jelte Wicherts
@JelteWicherts
Our department is looking for a postdoc in data science @DataScienceTiU @TilburgU
career012.successfactors.eu/career?_s.crb=aLE1nsdXx5TvDvi… -
Jelte Wicherts
@JelteWicherts
Why a Confirmation Strategy Dominates Psychological Science
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts reposted
Steven Pinker
@sapinker
Speaking today at the Intelligence Society for Intelligence Research, Albuquerque, New Mexico. September 18-20 isironline.org/2014/12/2015-albuquerque-new-mexico-septem…
-
Jelte Wicherts reposted
ROBERTO COLOM
@ROBERTO_COLOM
Jelte #isir2015
-
Jelte Wicherts
@JelteWicherts
Women can accurately predict male IQ from video but aren't attracted by high IQ men for short term relations #isir15
-
Jelte Wicherts
@JelteWicherts
Effectiveness of early interventions on IQ in randomized trials declines over the years. @JProtzko #isir15
-
Jelte Wicherts
@JelteWicherts
There is a relation between IQ and the brain. Well quite a lot of them actually. Keynote by @ROBERTO_COLOM #isir15
-
Jelte Wicherts
@JelteWicherts
American Psychological Association to republish retracted articles in wake of reproducibility project.
pnis.co/scinews/vol2_17.html -
Jelte Wicherts
@JelteWicherts
A game theoretic analysis of research data sharing
Enhancement of the citation benefit increases incentives to share
peerj.com/articles/1242/ -
Jelte Wicherts
@JelteWicherts
This pill wasn't diluted as usual.
Homeopathy conference ends in chaos after delegates take hallucinogenic drug.
www.independent.co.uk/life-style/health-and-families/heal… -
Jelte Wicherts
@JelteWicherts
Critique heard at conference: "One can easily obtain a significant effect by increasing the sample size to infinity"
Jelte Wicherts
@JelteWicherts
@CaAl excactly!
-
Jelte Wicherts
@JelteWicherts
Survey: ...but also an increase in acceptance of and willingness to engage in data sharing in the last few years.
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Survey: older researchers & those in Medicine, Business, Social Sciences & Psychology least willing to share data...
journals.plos.org/plosone/article?id=10.1371/journal.pone… -
Jelte Wicherts
@JelteWicherts
Would love to go to symposium on diversity in academia, but I'm too busy then. With my sons #papadag @DeJongeAkademie www.knaw.nl/nl/actueel/agenda/meer-diversiteit-op-de-acad…
-
Jelte Wicherts reposted
NYT Science
@NYTScience
How psychologists are responding to a damaging blow from a new analysis of their work www.nytimes.com/2015/08/29/science/psychologists-welcome-…
-
Jelte Wicherts
@JelteWicherts
Didn't Prof. Schwarz read the RPP paper?
Replications involved contacting orig researchers & data audit s @BrianNosek
Jelte Wicherts
@JelteWicherts
Schwarz indicates that he has been misquoted by the NYT: docs.google.com/document/d/1ROpVy1R-clQ28otEocTEEpjKYnD39…
-
Jelte Wicherts reposted
Ivan Oransky
@ivanoransky
Yes, many psychology findings may be “too good to be true” – now what? retractionwatch.com/2015/08/27/yes-many-psychology-findin…
-
Jelte Wicherts
@JelteWicherts
Whoomp there it is! Nail on the coffin of “psychology has no replication problem” www.sciencemag.org/content/349/6251/aac4716.full
-
Jelte Wicherts
@JelteWicherts
At almost 39, I am nominated to become Netherlands' research talent 2015. I guess the best is still to come universonline.nl/2015/08/19/tilburgse-wetenschapper-in-de…
-
Jelte Wicherts reposted
Univers magazine
@universmagazine
Tilburgse wetenschapper @JelteWicherts in de race voor Wetenschapstalent 2015 #tilburgu #uvt #tiu
universonline.nl/2015/08/19/tilburgse-wetenschapper-in-de… -
Jelte Wicherts reposted
Tilburg University
@TilburgU
@JelteWicherts gefeliciteerd met jouw nominatie als New Scientist Wetenschapstalent 2015. Stem op Jelte! r.socialstudio.radian6.com/fb36d765-eab7-4868-a322-848fb0… #tilburgu
-
Jelte Wicherts
@JelteWicherts
Let's ruin the surname-order effect in elections by voting the last candidate of @NewScientistNL's talent election!
www.newscientist.nl/talent/
Jelte Wicherts
@JelteWicherts
yes: @NewScientistNL impact of candidate name order on election outcomes:
pprg.stanford.edu/wp-content/uploads/1998-impact-of-candi… -
Jelte Wicherts reposted
Journal of Open Psychology Data
@up_jopd
New article: Selected Personality Data from the SAPA-Project: On the Structure of Phrased Self-Report Items openpsychologydata.metajnl.com/articles/10.5334/jopd.al/
-
Jelte Wicherts
@JelteWicherts
Direct replication (N=36) of Förster & Denzler (2012) fails to show effects
No linearity found
inspective.de/download/Psychologie/ScientificFraudOrNot.pdf -
Jelte Wicherts
@JelteWicherts
Ranjit Chandra fabricated data but his university let him go
A depressing story about (response to) scientific fraud
www.youtube.com/watch?v=gKYr1VerT4A -
Jelte Wicherts
@JelteWicherts
And today's marginal significance award goes to: [RATATA]
THIS ARTICLE ON INTUITIVE THOUGHT! journal.frontiersin.org/article/10.3389/fpsyg.2015.01088/… -
Jelte Wicherts
@JelteWicherts
Effects of Parents’ Math Anxiety on Children’s Math Achievement
Indep reanalyses would be nice
pss.sagepub.com/content/early/2015/08/06/0956797615592630
Jelte Wicherts
@JelteWicherts
...because of many potential issues concerning non-normality, dropout, multicollinearity, etc. And because of this...
-
Jelte Wicherts
@JelteWicherts
Weight priming fails to replicate. With weirdest funnel & forest plots ever #pubbias
@PLOSONE journals.plos.org/plosone/article?id=10.1371/journal.pone…Post not available here, view on X
Jelte Wicherts
@JelteWicherts
These are the published studies. So things certainly look different when one opens the file drawer.
@lakens @PsychFileDrawer -
Jelte Wicherts reposted
Brian Nosek (@briannosek@nerdculture.de)
@BrianNosek
Psych Science introduced open badges osf.io/tvyxz/ on 1/1/2014 and YOU WON'T BELIEVE WHAT HAPPENED NEXT!
-
Jelte Wicherts reposted
Liz Wager
@SideviewLiz
Clever statistics to detect fraudulent data onlinelibrary.wiley.com/doi/10.1111/anae.13126/pdf @Anaes_Journal
-
Jelte Wicherts
@JelteWicherts
Apparently APA stands for Association of Psychological Abusers.
www.nytimes.com/2015/07/11/us/psychologists-shielded-us-t… -
Jelte Wicherts
@JelteWicherts
Extraordinary researcher acquires €5 million of ERC funds, then is found guilty of misconduct retractionwatch.com/2015/07/10/high-profile-biologist-is-… www.ethlife.ethz.ch/archive_articles/130613_roesslerpreis…
-
Jelte Wicherts reposted
kolfschooten
@kolfschooten
Frankfurt School Finance & Management skips invitation Jens Förster for workshop Ethics in Science: www.frankfurt-school.de/content/de/research/aow-workshop/… substitute Kliemt
-
Jelte Wicherts
@JelteWicherts
This Week in Psychological Science & APA monitor can lead readers to overestimate effect sizes
iase-web.org/documents/SERJ/SERJ14(1)_Hogan.pdf -
Jelte Wicherts
@JelteWicherts
Always nice if your PhD student's paper ends up on @RetractionWatch @MicheleNuijten
retractionwatch.com/2015/07/06/the-replication-paradox-sa… -
Jelte Wicherts reposted
Ivan Oransky
@ivanoransky
“The Replication Paradox:” Sans other fixes, replication may cause more harm than good, says new paper retractionwatch.com/2015/07/06/the-replication-paradox-sa…
-
Jelte Wicherts
@JelteWicherts
UvA committee: "consistent element in all publications that show strong evidence for low veracity is Jens Förster" www.uva.nl/en/news-events/news/uva-news/content/news/2015…
-
Jelte Wicherts reposted
Angélique Cramer
@angecramer
Dutch universities contemplating to boycot Elsevier for failure to adopt OA policy without double costs www.nrc.nl/nieuws/2015/07/02/universiteiten-beginnen-boyc…
-
Jelte Wicherts reposted
ScienceInTransition
@SciTransit
Replicatieparadox: hoe replicatiestudies juist leiden tot meer bias p18: mbnuijten.files.wordpress.com/2013/01/psychonoom-29e-2014… Ultieme oplossing: alle studies registreren
-
Jelte Wicherts reposted
Journal of Open Psychology Data
@up_jopd
Data from 617 Healthy Participants Performing the Iowa Gambling Task: A “Many Labs” Collaboration, Steingroever et al openpsychologydata.metajnl.com/articles/10.5334/jopd.ak/
-
Jelte Wicherts reposted
ISPP
@PolPsyISPP
RT @RolfZwaan: “The replication paradox.” Looks interesting. Paper by @JelteWicherts & @MicheleNuijten. psycnet.apa.org/psycinfo/2015-15456-001/
-
Jelte Wicherts
@JelteWicherts
31 academic organizations sign transparency statement
APA doesn't know why it hasn't signed
www.nytimes.com/2015/06/26/science/journal-science-releas… -
Jelte Wicherts
@JelteWicherts
New analysis of linearity in 7 articles by Jens Förster shows strong evidence of weirdness of results in 4 articles
arxiv.org/pdf/1506.07447v1.pdf -
Jelte Wicherts
@JelteWicherts
New: Data from 617 Healthy Participants Performing the Iowa Gambling Task: A Many Labs Collaboration @EJWagenmakers openpsychologydata.metajnl.com/articles/10.5334/jopd.ak/
-
Jelte Wicherts reposted
Rolf Zwaan 🦢
@RolfZwaan
"The replication paradox." Looks interesting. Paper by @JelteWicherts & @MicheleNuijten. psycnet.apa.org/psycinfo/2015-15456-001/
-
Jelte Wicherts
@JelteWicherts
Naughty journals use excessive self-citation or cites from friendly journals to boost impact factor & get caught ipscience-help.thomsonreuters.com/incitesLiveJCR/JCRGroup…
-
Jelte Wicherts
@JelteWicherts
Aggregated impact factor for psychological fields (2003-2014)
Only way is up, expect for....
Freud is getting old! -
Jelte Wicherts
@JelteWicherts
Congratulations editors! Your impact factors have gone up again (due to increasing no. of articles in Web of Science)
-
Jelte Wicherts
@JelteWicherts
Gender & publication pressure are hardly related to scientific misconduct. But transparency might help countering it. journals.plos.org/plosone/article?id=10.1371/journal.pone…
-
Jelte Wicherts
@JelteWicherts
Mouse also likes psychometrics (at IOPS conference in Utrecht)
-
Jelte Wicherts
@JelteWicherts
Förster responds to UvA report. Nearly 3 yrs after 1st report he still lacks an explanation for impossible linearity www.socolab.de/main.php?id=66








































































































































































































































































































































































































































