Methods of Meta Analysis Hunter Schmidt

What it’s about

Researchers in the social and behavioral sciences are often faced with a bewildering landscape of conflicting findings on any given topic. Traditional narrative reviews and simplistic vote-counting methods fail to resolve these conflicts and often lead to erroneous conclusions, stalling scientific progress. 'Methods of Meta-Analysis' presents a powerful solution: psychometric meta-analysis. This book argues that much of the apparent inconsistency in research literatures is not real, but is instead the result of correctable statistical and measurement artifacts, such as sampling error, measurement error, and range restriction. It provides a rigorous, step-by-step framework for identifying, quantifying, and correcting for these distortions. By applying these methods, researchers can move beyond a superficial summary of flawed studies to estimate the true, construct-level relationships that would be observed under ideal research conditions. This book is the definitive guide for any researcher who wants to build a truly cumulative science by making sense of the vast and often confusing body of accumulated evidence in their field.

The through-line

Who it’s for

Social and behavioral science researchers, academics, and graduate students who are struggling to make sense of the vast and often contradictory body of research in their fields. They want to move beyond simply listing study results to build a cumulative, quantitative science but feel frustrated by the apparent chaos in the literature.

The problem

The research literature on any given topic is filled with conflicting findings—some studies are statistically significant, others are not; effect sizes vary widely—making it impossible to draw clear conclusions using traditional narrative review methods. Researchers feel confused, disheartened, and cynical about the possibility of scientific progress. They question whether their fields can ever achieve the cumulative knowledge seen in the physical sciences and feel their own research efforts are lost in an ocean of inconsistency.

The plan

1. Identify and understand the statistical and measurement artifacts (e.g., sampling error, measurement error) that distort individual study findings.
2. Learn the specific statistical procedures to correct for the biasing effects and spurious variance created by each artifact.
3. Apply these methods to synthesize findings across studies, calculating the mean and standard deviation of the true, corrected effect sizes.
4. Use these corrected estimates to test for the existence of real moderator variables and build cumulative, theory-driven knowledge.

The payoff

Researchers can confidently establish the fundamental facts and relationships in their area of study. · They can distinguish real moderators from artifactual noise, leading to more accurate and parsimonious theories. · Their discipline advances as a cumulative science, with a solid, quantitative knowledge base.

See our guide

• The Four-S Discipline — One System, Four Capabilities →
• Study People And Organizations With Scientific Rigor →
• Where The Evidence Comes From — Meta-Analysis And The Research Substrate →
• Choose And Apply The Right Analytical Method →
• The Behavioral Science Underneath It All →
• Build A People Analytics Function →
• Design The Organization And Change It →
• Do Research That Holds Up →
• Design Surveys People Answer Honestly →
• Understand What Drives Individual Performance →

Related profiles we’ve built

• The basic principle of people analytics learn how to use hr data to drive better outcomes for your business and employees →
• Handbook of Regression Modeling in People Analytics →
• An Everyone Culture: Becoming a Deliberately Developmental Organization →
• Apa Handbook Io V2 →
• Armstrongs Handbook of Strategic Human Resource Management Improve Business Performance Through Strategic People Management →
• Beyond Hr Boudreau Ramstad →
• The Differentiated Workforce →
• Drive Pink →

Additional reading

• Meta-Analysis in Social Research · Glass, McGaw, & Smith (1981)

  This is the foundational text for the Glassian approach to meta-analysis, which the authors frequently contrast with their own psychometric methods. It provides the context for their argument about describing literature vs. estimating true effects.

• Statistical Methods for Meta-Analysis · Hedges & Olkin (1985)

  This book presents the influential homogeneity test-based approach to meta-analysis. The authors critique this approach for its reliance on significance tests and fixed-effects assumptions, making it a key point of comparison.

• The Handbook of Research Synthesis · Cooper & Hedges (Eds.)

  Cited in the book, this handbook covers broader aspects of research synthesis, including topics like literature searching and coding, which complement the statistical focus of the Hunter & Schmidt book.

Featured in these guides

• The Behavioral Science Underneath It All →Cited source
• Build A People Analytics Function →Cited source
• Design The Organization And Change It →Cited source
• Study People And Organizations With Scientific Rigor →Cited source
• Do Research That Holds Up →Cited source
• Where The Evidence Comes From — Meta-Analysis And The Research Substrate →Cited source
• Choose And Apply The Right Analytical Method →Cited source
• Design Surveys People Answer Honestly →Cited source
• Understand What Drives Individual Performance →Cited source