Etienne P. LeBel, PhD

Independent Meta-Scientist
KU Leuven

I investigate the credibility of scientific research, focusing on the field of psychology. My current efforts are focused on Curate Science, a web platform to curate the transparency, reproducibility, and replicability of published findings. I previously lead PsychDisclosure.org, a grassroots transparency initiative that contributed to raising reporting standards at leading journals in psychology. My background is in social psychology where I examined racial biases/prejudice and methodological issues in psychology research (e.g., metric calibration; measurement issues related to replicability, hypothesis testing, and construct validity).

Papers Under Review
Evaluating replications with nuance
EP LeBel, W Vanpaemel, I Cheung, & L Campbell (2018)
PsyArXiv Preprint
Meta-Psychology (being revised for further consideration)
Published Peer-Reviewed Articles & Chapters (see for full list)
A unified framework to quantify the credibility of scientific findings
EP LeBel, R McCarthy, B Earp, M Elson, & W Vanpaemel (2018)
PsyArXiv Preprint
Advances in Methods and Practices in Psychological Science
Falsifiability is not optional
EP LeBel, D Berger, L Campbell, & TJ Loving (2017)
PsyArXiv Preprint
Journal of Personality and Social Psychology
Public Code
Code link #1
Benefits of open and high-powered research outweigh costs
EP LeBel, L Campbell, & TJ Loving (2017)
Journal of Personality and Social Psychology
SSRN Preprint PsyArXiv Preprint
Complex phenomena require sophisticated designs: Why we shouldn't give up on replicability
M Heino, EI Fried, & EP LeBel (2017)
PsyArXiv Preprint HTML
Frontiers in Psychology
Psychological and institutional obstacles toward more transparent reporting of psychological science
EP LeBel & L John (2017)
Preprint
Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions. S. O. Lilienfeld & I. D. Waldman (Eds.) New York, NY: John Wiley & Sons.
Registered Replication Report of Finkel, Rusbult, Kumashiro, & Hannon's (2002) Study 1
I Cheung, L Campbell, EP LeBel, ... , & JC Yong (2016)
HTML
Perspectives on Psychological Science

Public Study Materials
Materials link #1
Public Data
Data link #1
Pulic Code
Code link #1
Reporting Standards
Study complies with the Basic 4 (at submission) reporting standard:
  1. Excluded data (subjects/observations): Full details reported in article.
  2. Experimental conditions: Full details reported in article.
  3. Outcome measures: Full details reported in article.
  4. Sample size determination: Full details reported in article.
Registered Report
Replications 16
commitment on forgiveness effect
A new replication norm for psychology
EP LeBel (2015)
HTML
Collabra
Estimating the [replicability] of psychological science
AA Aarts, ... , EP LeBel, ... , & BA Nosek (2015)
PsyArXiv Preprint
Science
Public Study Materials
Materials link #1
Public Data
Data link #1
Pulic Code
Code link #1
Reporting Standards
Study complies with the Basic 4 (at submission) reporting standard:
  1. Excluded data (subjects/observations): Full details reported in article.
  2. Experimental conditions: Full details reported in article.
  3. Outcome measures: Full details reported in article.
  4. Sample size determination: Full details reported in article.
Replications 100
100 social/cognitive psychology effects
Replication difficulties of Correll's (2008) modulation of 1/f noise in a racial bias task
C Madurski* & EP LeBel (2015) *Student co-author
SSRN Preprint
Psychonomic Bulletin & Review
Public Study Materials
Materials link #1
Public Data
Data link #1
Pulic Code
Code link #1
Reporting Standards
Study complies with the Basic 4 (at submission) reporting standard:
  1. Excluded data (subjects/observations): Full details reported in article.
  2. Experimental conditions: Full details reported in article.
  3. Outcome measures: Full details reported in article.
  4. Sample size determination: Full details reported in article.
Replications 2
modulation of 1/f noise racial bias emission
Madness in the method: Fatal flaws in triple-blind mediumship research
C Battista, N Gauvrit, & EP LeBel (2015)
The Myth of an Afterlife: The Case Against Life After Death. M. Martin & K. Augustine (Eds.) Lanham, MD: Scarecrow Press.
Enhancing transparency of the research process to increase accuracy of findings: A guide for relationship researchers
L Campbell, TJ Loving, & EP LeBel (2014)
SSRN Preprint
Personal Relationships
Big secrets do not necessarily cause hills to appear steeper
EP LeBel & CJ Wilbur (2014)
Psychonomic Bulletin & Review
Public Study Materials
Materials link #1
Public Data
Data link #1
Pulic Code
Code link #1
Reporting Standards
Study complies with the Basic 4 (at submission) reporting standard:
  1. Excluded data (subjects/observations): Full details reported in article.
  2. Experimental conditions: Full details reported in article.
  3. Outcome measures: Full details reported in article.
  4. Sample size determination: Full details reported in article.
Replications 2
physical burdensomeness of secrets
Heightened sensitivity to temperature cues in highly anxiously attached individuals: Real or elusive phenomenon?
EP LeBel & L Campbell (2013)
Psychological Science
Public Study Materials
Materials link #1
Public Data
Data link #1
Reporting Standards
Studies comply with the Basic 4 (retroactive) reporting standard:
  1. Excluded data (subjects/observations): Full details reported in article.
  2. Experimental conditions: Full details reported in article.
  3. Outcome measures: Full details reported in article.
  4. Sample size determination: Full details reported in preregistered protocol.
Date of retroactive disclosure: October 1, 2013.
Replication 2
physical burdensomeness of secrets
PsychDisclosure.org: Grassroots support for reforming reporting standards in psychology
EP LeBel, D Borsboom, R Giner-Sorolla, F Hasselman, KR Peters, KA Ratliff, & CT Smith (2013)
Perspectives on Psychological Science

†Initiative mentioned in New Yorker piece on cleaning up science.
The interactive role of implicit and explicit partner evaluations on ongoing affective and behavioral romantic realities
EP LeBel & L Campbell (2013)
Social Psychological and Personality Science
Reporting Standards
Study complies with the Basic 7 (retroactive) reporting standard:
  1. Excluded data (subjects/observations): Full details reported in article.
  2. Experimental conditions: Full details reported in article (N/A; no experimental conditions).
  3. Outcome measures: Several other predictor measures of related, but distinct, relationship constructs (IVs) were also assessed; these went unreported because they were unrelated to our research question. For the DV in our second model, several other (daily) positive relationship behaviors were assessed, but these went unreported because we didn't analyze them or because more complex patterns emerged with those (daily) positive behaviors that were not yet fully understood.
  4. Sample size determination: Recruited as many heterosexual couples as possible via advertisements placed in campus newspapers.
  5. Analytic plans: The analytic plans for the predicted interactive effect between implicit partner evaluations and explicit partner perceptions (on both DVs) were made after examining the data.
  6. Unreported related studies: None (full details reported in article).
  7. Other disclosures: None
Date of retroactive disclosure: February 15, 2018.
Original retroactive disclosure statement
An open, large-scale, collaborative effort to estimate the [replicability] of psychological science
AA Aarts, ... , EP LeBel, ... , & BA Nosek (2012)
Perspectives on Psychological Science
Socially desirable responding and its elusive effects on the validity of personality assessments
SV Paunonen & EP LeBel (2012)
Journal of Personality and Social Psychology
Fearing the future of empirical psychology: Bem's (2011) evidence of psi as a case study of deficiencies in modal research practice
EP LeBel & KR Peters (2011)
Review of General Psychology
†Research covered in Time magazine Ideas piece on trust in psychological research.
Sexy but often unreliable: Impact of unreliability on the replicability of experimental findings involving implicit measures
EP LeBel & SV Paunonen (2011)
Personality and Social Psychology Bulletin
Metric calibration of psychological instruments: Utility and feasibility
EP LeBel (2011)
Saarbrucken, Germany: LAP Lambert Academic Publishing.
Attitude accessibility as a moderator of implicit and explicit self-esteem correspondence
EP LeBel (2010)
Self and Identity
Public Study Materials
Materials link #1
Public Data
Data link #1
Pulic Code
Code link #1
Reporting Standards
Study complies with the Basic 7 (retroactive) reporting standard:
  1. Excluded data (subjects/observations): Full details reported in article.
  2. Experimental conditions: Full details reported in article (see FN1 for details regarding 3 experimental factors that were tested but ignored given lack of mean differences across conditions).
  3. Outcome measures: Other measures assessed (e.g., causal attribution measures), but went unreported given they were unrelated to the target research question.
  4. Sample size determination: Data collection stopped after reaching a predetermined sample size in both samples (which were eventually combined due to editorial request during peer review). No analyses were performed (in either samples) before data collection was completed.
  5. Analytic plans: The analytic plans for the predicted interactive effect (implicit self-esteem × time interaction effect on explicit self-esteem) were specified after examining the data.
  6. Unreported related studies: Two additional studies were conducted that tested a related but distinct hypothesis. In both samples, the expected pattern of results (implicit self-esteem × time interaction effect on explicit self-esteem) was not observed for reasons not yet understood. The framing and context of these additional studies were sufficiently dissimilar to the two reported studies to justify omitting such information from the published article, as per standard reporting practices at the time.
  7. Other disclosures: None.
Date of retroactive disclosure: February 15, 2018.
Original retroactive disclosure statement
How to find what's in a name: Scrutinizing the optimality of five scoring algorithms for the name-letter task
EP LeBel & B Gawronski (2009)
European Journal of Personality
Implicit partner affect, relationship satisfaction, and the prediction of romantic breakup
EP LeBel & L Campbell (2009)
Journal of Experimental Social Psychology
Understanding patterns of attitude change: When implicit measures show change, but explicit measures do not
B Gawronski & EP LeBel (2008)
Journal of Experimental Social Psychology
What do implicit measures tell us? Scrutinizing the validity of three common assumptions
B Gawronski, EP LeBel, & KR Peters (2007)
Perspectives on Psychological Science
Working Papers
Bold conjectures meet open science: Accelerating theory development in social psychology by testing riskier predictions via pre-registration
EP LeBel & L Campbell (2015)
Unpublished manuscript, University of Western Ontario.
Overcoming experimental psychology's replicability crisis by studying humans at the intra- rather than inter-individual level
EP LeBel, D Borsboom, F Hasselman, & C Stahl (2014)
Unpublished manuscript, Montclair State University.

Replication difficulties of Payne, Hall, Cameron, and Bishara's (2010) multinomial processing tree model of the affect misattribution procedure
C Tobin* & EP LeBel (2014) *Student co-author
SSRN Preprint
Unpublished manuscript, Montclair State University.
Replications 2
MPT model of affect misattribution procedure (AMP)
Modeling mechanism heterogeneity in the affect misattribution procedure: A hierarchical latent-class multinomial processing tree model approach
EP LeBel & C Stahl (2013)
Unpublished manuscript, Montclair State University.



Research-Related Media Coverage

The Science "Reproducibility Crisis" -- And What Can Be Done About It (The Conversation, March 15, 2017)

How the Reproducibility Crisis in Academia is Affecting Scientific Research (Forbes Magazine, February 9, 2017)

Why Academic Research is So Unpredictable and What We Can Do to Fix It (Huffington Post, February 9, 2017)

Why is so much research dodgy? (The Guardian, October 17, 2016)

Effect of Commitment on Forgiveness Investigated in Large-Scale Replication Project (APS Press Release, September 30, 2016)

The 7 biggest problems facing science, according to 270 scientists (Vox, September 7, 2016)

We need to talk about the bad science being funded (The Conversation, July 18, 2016)

Why so much science research is flawed -- and what to do about it (New Scientist, April 13, 2016)

Sloppy Science: Are Sketchy Practices in the Lab to Blame for the Replication Crisis in Psychology Research? (Slate Magazine, March 21, 2016)

Does social science have a replication crisis? (The Washington Post, March 9, 2016)

The six most interesting psychology papers of 2015 (The New Yorker, December 26, 2015)

Whistle-blower scientist wins $10K prize (London Free Press, December 14, 2015)

Make Science More Reliable, Win Cash Prizes: Honoring young researchers who champion rigorous, transparent research is a small step towards changing the culture of science. (The Atlantic, December 10, 2015)

Taxpayer-funded research agencies 'need to wake up' (London Free Press, September 20, 2015)

London scientist Etienne LeBel has exposed questionable work of senior researchers (London Free Press, Stratford Beacon Herald, St. Thomas Times, September 5, 2015)

'Hobo scientist' presses for truth in journals (Ottawa Citizen, September 5, 2015)

Scientists' claims fail rebel's smell test (Sarnia Observer, September 5, 2015)

We tried to reproduce 100 published psychological studies -- the results were abysmal (National Post, August 28, 2015)

Of 100 Published Psychology Studies, Less Than Half Could Be Reproduced Successfully (Popular Science, August 27, 2015)

Study delivers bleak verdict on validity of psychology experiment results (The Guardian, August 27, 2015)

How Reliable Are Psychology Studies? (The Atlantic, August 27, 2015)

Replication Gone Wrong (The Scientist, May 29, 2014)

A happy marriage? It's all about gut feelings (Skeptical appraisal of) (The Telegraph, November 28, 2013)

Cleaning up science (The New Yorker, December 21, 2012)

Can We Trust Psychological Research? (Time Magazine, July 17, 2012)

Older Essays

EP LeBel (2005). The effect of subliminal self-affirmation on stereotype activation. Unpublished Honors thesis, University of Waterloo. PsyArXiv Preprint

EP LeBel (2004). The vanity construct re-examined: LeBel's vanity scale. Unpublished manuscript, University of Waterloo. PsyArXiv Preprint

EP LeBel (2004). Semantic priming in the dual task paradigm. Unpublished manuscript, University of Waterloo. PsyArXiv Preprint

EP LeBel (2003). Need for cognition and attributions in intimate relationships. Unpublished manuscript, University of Waterloo. PsyArXiv Preprint

EP LeBel (2003). Effects of physical attractiveness on relation initiation. Unpublished manuscript, University of Waterloo. PsyArXiv Preprint

EP LeBel (2003). Human mate poaching and enticement processes revisited. Unpublished manuscript, University of Waterloo. PsyArXiv Preprint

EP LeBel (2003). Prosperous deviance: Drug trafficking. Unpublished manuscript, University of Waterloo. PsyArXiv Preprint

EP LeBel (2002). Creativity and mood disorders: Both deviances? Unpublished manuscript, University of Waterloo. PsyArXiv Preprint




Creative Commons License