Leading With Data· a Bicycle Guide
Guide highlights

Apparent Height becomes something you produce by design, not by luck.

  • Master fundamental frequency (f0).
  • Master acoustic vocal-tract length (vtl).
  • Master apparent age.

2 disagreements between sources

Book profile

Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R

One book, placed in its field — what Santiago Barreda, Noah Silbert's book gets right, where it goes further than the rest, and what the rest of the field adds.

Edited by Mike West

Not sure where to start? Take the 3-minute self-assessment →

Teaching this to a team? Open it as 11 slides →

Choose a reading path or an exercise

Suggested sections

Choose a starting point below. Each link opens a section of this guide.

Do this now — Fundamental Frequency (f0)

  1. Convert f0 to a perceptually meaningful scale (semitones or log-Hz) before modeling rather than raw Hz.
  2. Center f0 within the analysis so the intercept corresponds to an interpretable reference voice.
  3. Fit f0 as a population-level slope and allow it to vary by listener to capture differential cue weighting.

Then continue in Fundamental Frequency (f0).

Edition 1·Updated 2026-08-05·14 min read

Sources

About this book

An overview of the book, with source information for further reading.

This book offers a hands-on, conceptual introduction to Bayesian multilevel models for analyzing repeated measures data, a common data type in linguistics, psychology, and cognitive science.

More on this book

Starting with simple models and progressing to more complex ones like multinomial regression, the authors use a single, realistic experimental dataset throughout to provide fully worked examples in R using the `brms` package. Instead of getting bogged down in mathematical theory, the book focuses on building intuitive, geometric understanding and practical coding skills, making it accessible for readers with any level of statistical background who want to move beyond traditional methods and harness the flexibility of Bayesian modeling for their own research.

Movement I

Orient

In this part

What this book claims, and who wrote it.

  • — The book's one-line promise
  • — The author and where the book stands

A practical, hands-on introduction to building, fitting, and interpreting Bayesian multilevel models for repeated measures data using the R package brms.

The need-to-know

Bayesian multilevel models are the appropriate and flexible tool for analyzing repeated measures data, which is common in many social and cognitive sciences. Statistical models can be constructed from simple components (intercepts, slopes, interactions, random effects) to answer progressively more complex research questions. The `brms` package in R provides a powerful and user-friendly interface to the Stan programming language for fitting a wide variety of Bayesian models.

About this guide

The guide describes these challenges, steps and possible outcomes.

Who it is for

You are building a real capability: Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R.

Challenges

  • In practice · Apparent Height erodes when it is left to instinct instead of method.
  • For the reader · You were taught the moves piecemeal, never the whole model.

Steps to consider

  1. 1Master fundamental frequency (f0).
  2. 2Master acoustic vocal-tract length (vtl).
  3. 3Master apparent age.

Risks

You stay dependent on instinct, and it fails you when the stakes are highest.

Intended result

Apparent Height becomes something you produce by design, not by luck.

Set the record straight

What this book sets straight

The common beliefs this book pushes back on.

The myth

You must learn traditional, simpler statistics (like t-tests or ANOVA) before you can tackle the complex models needed for repeated measures data.

The reality

You can and should start directly with multilevel models, which are the appropriate tool for repeated measures data, building complexity from a realistic starting point rather than learning models you'll rarely use.

The myth

Bayesian statistics is a philosophical choice and is too complex mathematically for beginners and applied researchers.

The reality

Bayesian modeling is a practical tool that offers flexibility and richer information than traditional methods. It can be learned procedurally through examples, and packages like `brms` make it accessible without a deep dive into mathematical theory.

The myth

Learning statistics is about innate 'math ability' and understanding abstract concepts on the first pass.

The reality

Learning statistics is a procedural skill, like learning a language or an instrument. It requires practice, repetition, and 'getting used to things' rather than immediate abstract comprehension.

Movement II

Map

The book's main ideas and how they connect.

In this part

Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R's own model — and how it sits inside its field.

  • — 7 constructs the book works with
  • — Where it agrees with the field, exceeds it, or fills a gap
The Conditions4· the context you inherit
Fundamental Frequency (f0)Acoustic Vocal-Tract Length (VTL)Listener VariationSpeaker Variation
What It Produces2· the states it creates
Apparent AgeApparent Gender

The constructs

Fundamental Frequency (f0)

The rate of vibration of a speaker's vocal folds, measured in Hertz (Hz). It is the primary acoustic correlate of perceived voice pitch and serves as a cue for speaker size, age, and gender.

Acoustic Vocal-Tract Length (VTL)

The effective acoustic length of a speaker's vocal tract, estimated in centimeters from the resonant frequencies (formants) of the speech signal. It is a primary acoustic correlate of perceived speaker size and body length.

Apparent Age

The listener's categorical judgment of whether a speaker is a child or an adult. This perceptual categorization acts as a moderator, changing how acoustic cues are interpreted to judge height.

Apparent Gender

The listener's categorical judgment of whether a speaker is male or female. This perceptual categorization also acts as a moderator for how acoustic cues are used.

Apparent Heightthe outcome

The listener's estimate of a speaker's physical height, in centimeters. This is the primary outcome variable, influenced by acoustic cues and the listener's perceptual categorizations.

Listener Variation

Systematic, idiosyncratic differences between individual listeners in their average judgments (intercepts) and their use of acoustic and categorical cues (slopes). This is a key source of non-independence in repeated measures data.

Speaker Variation

Systematic, idiosyncratic differences between individual speakers' voices that influence listener perceptions but are not captured by f0 and VTL alone. This is another source of non-independence.

How they connect (7)
  • Fundamental Frequency (f0) → predicts → Apparent Height
  • Acoustic Vocal-Tract Length (VTL) → predicts → Apparent Height
  • Apparent Age → predicts → Apparent Height
  • Apparent Gender → predicts → Apparent Height
  • Apparent Age → moderates → Acoustic Vocal-Tract Length (VTL)
  • Listener Variation → moderates → Fundamental Frequency (f0)
  • Speaker Variation → moderates → Apparent Height

Where this book diverges from the corpus

  • fills gap The field's reconciled model contains no acoustic-phonetic construct for vocal-fold vibration rate as a perceptual cue, so this is entirely outside its coverage.
  • fills gap Formant-based estimation of vocal-tract length as a size cue has no counterpart in the field's organizational/behavioral construct set.
  • fills gap Perceptual categorization of speaker age as a moderator of acoustic-cue interpretation is a psychoacoustic construct absent from the reconciled model.
  • fills gap Listener categorization of speaker gender as a cue-moderator is not represented among the field's constructs.
  • fills gap Perceptual estimation of physical height from voice is a specific perceptual outcome variable the field does not cover.
  • exceeds Both address nested non-independence via random intercepts and slopes, but the book operationalizes this concretely for listener-level dependency in a way that sharpens the field's general framing.

Movement III

Master

Explore the book's ideas, examples and practical tools.

In this part

How the author makes the case — section by section, with the book's own tools.

  • — 7 sections, in the book's order
  • — The book's frameworks, checklists, and worked cases
Listener Variation
strong · 1 source
  • Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R
In this section

This section shows how to capture systematic differences between listeners with random intercepts and random slopes. You learn why individual cue-weighting differences are structure to model, not noise to average away.

Listener Variation

Systematic, idiosyncratic differences between individual listeners in their average judgments (intercepts) and their use of acoustic and categorical cues (slopes). This is a key source of non-independence in repeated measures data.

Why it matters. Omitting random slopes for listeners is the single most common cause of anticonservative significance in repeated-measures perception studies.

Myth

That a random intercept per listener is enough to handle individual differences.

Reality

Listeners differ not only in their baseline height guesses but in how strongly they weight f0 and VTL; without random slopes those differences leak into the fixed-effect standard errors.

Tools for this
The least you need to know
  • Include random slopes, not just intercepts, for listener-level cue weighting.
  • Model intercept-slope correlations in the listener random effects.
  • Partial pooling protects estimates for listeners with sparse data.
Master this◆ Paid

The deep drill-down: 7 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “By-Listener Random-Effects Specification Worksheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 3 how-to steps · 2 pitfalls to watch for · 2 tools for this section. Included when you buy this guide.

Grounded in: Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R

Speaker Variation
strong · 1 source
  • Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R
In this section

This section adds speaker-level random effects to absorb voice-specific influences that f0 and VTL do not capture. You learn to treat speaker as a second, crossed grouping factor alongside listener.

Speaker Variation

Systematic, idiosyncratic differences between individual speakers' voices that influence listener perceptions but are not captured by f0 and VTL alone. This is another source of non-independence.

Why it matters. Because a handful of speakers are judged repeatedly across all listeners, ignoring speaker variation generalizes findings to only the specific voices tested rather than to speakers at large.

Myth

That once you include f0 and VTL, speaker identity adds no further information worth modeling.

Reality

Voices differ in breathiness, roughness, and idiosyncratic timbre that shift height judgments beyond f0 and VTL, so speaker random effects are needed to generalize the acoustic conclusions.

The least you need to know
  • Speaker enters as a crossed random effect, not nested under listener.
  • Voice-specific qualities beyond f0 and VTL justify a speaker variance component.
  • Modeling speaker variation is what lets conclusions generalize past the sampled voices.
Master this◆ Paid

The deep drill-down: 7 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Speaker-Variation Modeling Checklist” tool. Included when you buy this guide.

The rest of this section

the full written section · 3 how-to steps · 2 pitfalls to watch for. Included when you buy this guide.

Grounded in: Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R

Fundamental Frequency (f0)
strong · 1 source
  • Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R
In this section

This section shows how to bring vocal-fold vibration rate into a multilevel model as a continuous predictor of listener judgments. You learn to treat f0 as a measured acoustic cue, not a fixed property of the speaker.

Fundamental Frequency (f0)

The rate of vibration of a speaker's vocal folds, measured in Hertz (Hz). It is the primary acoustic correlate of perceived voice pitch and serves as a cue for speaker size, age, and gender.

Why it matters. Mis-scaling or mis-centering f0 distorts every slope estimate tied to it and can make a genuine pitch effect look absent because listeners weight extreme pitches nonlinearly.

Myth

That f0 and vocal-tract length carry the same information about speaker size, so including one makes the other redundant.

Reality

f0 reflects vocal-fold mass and tension while VTL reflects cavity resonance; the two dissociate (e.g. a small woman can have low f0), and models need both because listeners use them for partly different inferences.

The least you need to know
  • Model f0 on a log or semitone scale to match how pitch is actually perceived.
  • Keep f0 and VTL as separate predictors; they encode dissociable acoustic information.
  • Let the f0 slope vary across listeners because pitch weighting is not uniform.
Master this◆ Paid

The deep drill-down: 7 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “f0 Cue Measurement & Inference Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 3 how-to steps · 2 pitfalls to watch for. Included when you buy this guide.

Grounded in: Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R

Acoustic Vocal-Tract Length (VTL)
strong · 1 source
  • Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R
In this section

Here you learn to enter estimated vocal-tract length — derived from formant spacing — as the acoustic size cue in the height model. The focus is on VTL as a continuous predictor whose influence shifts with the perceived age of the speaker.

Acoustic Vocal-Tract Length (VTL)

The effective acoustic length of a speaker's vocal tract, estimated in centimeters from the resonant frequencies (formants) of the speech signal. It is a primary acoustic correlate of perceived speaker size and body length.

Why it matters. VTL is the strongest single acoustic correlate of body size, so getting its estimation and interaction structure right largely determines whether your height predictions track reality.

Myth

That VTL is a raw measured quantity you can read directly off the spectrogram like f0.

Reality

VTL is inferred from the pattern of formant frequencies via a resonance model, so it is an estimate carrying its own uncertainty and depends on the estimation method you choose.

The least you need to know
  • Treat VTL as an estimated formant-derived quantity, not a direct observation.
  • Always model VTL in interaction with Apparent Age, since the cue is read differently for children and adults.
  • VTL typically dominates height judgments, so its specification deserves the most scrutiny.
Master this◆ Paid

The deep drill-down: 7 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “VTL Estimation & Size-Perception Worksheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 3 how-to steps · 2 pitfalls to watch for. Included when you buy this guide.

Grounded in: Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R

Apparent Age
strong · 1 source
  • Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R
In this section

This section treats the listener's child-versus-adult categorization as a moderator variable in the model. You learn to code it as a grouping factor that reshapes how acoustic cues translate into height.

Apparent Age

The listener's categorical judgment of whether a speaker is a child or an adult. This perceptual categorization acts as a moderator, changing how acoustic cues are interpreted to judge height.

Why it matters. If you enter age as a simple additive term rather than a moderator, you fit the wrong functional form and misestimate how VTL and f0 drive height for children versus adults.

Myth

That apparent age just shifts predicted height up or down by a constant amount.

Reality

Apparent age changes the slopes, not only the intercept: the same VTL implies a different height depending on whether a voice is heard as a child's or an adult's.

Tools for this
The least you need to know
  • Code apparent age as a moderator via interactions, not as a standalone additive offset.
  • Use perceived age as judged by the listener, distinct from ground-truth age.
  • Expect cue slopes for VTL and f0 to differ between the child and adult categories.
Master this◆ Paid

The deep drill-down: 7 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Apparent-Age Moderation Analysis Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 3 how-to steps · 2 pitfalls to watch for · 1 tool for this section. Included when you buy this guide.

Grounded in: Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R

Apparent Gender
strong · 1 source
  • Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R
In this section

This section adds the male-versus-female perceptual categorization as a second moderating factor for height judgments. You learn to model it as a categorical predictor that can both shift and reshape cue use.

Apparent Gender

The listener's categorical judgment of whether a speaker is male or female. This perceptual categorization also acts as a moderator for how acoustic cues are used.

Why it matters. Because men are on average taller than women, failing to model apparent gender confounds a real size difference with the acoustic cues that signal it, biasing the f0 and VTL effects.

Myth

That once f0 and VTL are in the model, apparent gender adds nothing because gender is already encoded in those acoustics.

Reality

Apparent gender carries residual, categorical expectations about typical body size that operate beyond the graded acoustic cues, so it contributes over and above f0 and VTL.

The least you need to know
  • Apparent gender adds categorical size expectations beyond what f0 and VTL supply.
  • Check for gender-by-cue interactions, not just an additive gender effect.
  • Use the perceptual judgment of gender as the moderator variable.
Master this◆ Paid

The deep drill-down: 7 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Apparent Gender Analysis Setup Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 3 how-to steps · 2 pitfalls to watch for. Included when you buy this guide.

Grounded in: Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R

Apparent Height
strong · 1 source
  • Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R
In this section

This section defines the outcome — the listener's centimeter estimate of speaker height — and how to model it under repeated measures. Everything else in the model exists to explain variation in this response.

Apparent Height

The listener's estimate of a speaker's physical height, in centimeters. This is the primary outcome variable, influenced by acoustic cues and the listener's perceptual categorizations.

Why it matters. Choosing the wrong distributional or link assumption for this outcome undermines every inference downstream, no matter how carefully the predictors are specified.

Myth

That because each listener judges many speakers, you can pool all height judgments as independent observations.

Reality

Repeated judgments by the same listener and about the same speaker are correlated; ignoring that non-independence shrinks standard errors and inflates false confidence.

The least you need to know
  • Apparent height is the response the whole model is built to explain.
  • Use crossed random effects to respect both listener and speaker dependence.
  • Verify the outcome's scale and residual behavior before trusting fixed-effect estimates.
Master this◆ Paid

The deep drill-down: 7 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Apparent-Height Model Specification Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 3 how-to steps · 2 pitfalls to watch for. Included when you buy this guide.

Grounded in: Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R

The playbook — the whole process

Beneath the model sits the practical spine — the end-to-end process the source books lay out. Here it is, in sequence, each broken into the steps you actually run.

The sequence — high level first

1Progressive Bayesian Multilevel Modeling Workflow

Illumination of the parts

1

Process 1 · named in the source

Progressive Bayesian Multilevel Modeling Workflow

To systematically build, evaluate, and interpret a statistical model that accurately captures data structure and answers research questions.

  1. 1

    Inspect the data visually and numerically to understand its structure, distributions, and relationships between variables.

  2. 2

    Start with a simple model (e.g., intercept-only) to establish a baseline.

  3. 3

    Incrementally add complexity by incorporating grouping factors as random intercepts to account for repeated measures.

  4. 4

    Introduce fixed-effect predictors (categorical or quantitative) to model systematic variation.

  5. 5

    Add interactions between predictors to model conditional effects.

  6. 6

    Incorporate random slopes to allow the effects of predictors to vary across grouping factors (e.g., by participant).

  7. 7

    Consider distributional models (e.g., modeling variance) or alternative error distributions (e.g., Student's t) to improve model fit.

  8. 8

    Use model comparison tools (LOO, WAIC) and posterior predictive checks at each stage to justify added complexity and ensure model adequacy.

  9. 9

    Interpret the final model's parameters in the context of the research questions.

What's underneath

What the field takes for granted

Every field runs on assumptions it rarely says out loud — the beliefs its advice quietly depends on. We surface the load-bearing ones, where they hide, and when they break. Most guides never tell you this.

Assumption 1

“The reader is a motivated self-learner who can find and understand prerequisite information (like basic R syntax) independently.”

Where it hides

The preface explicitly states that the book omits a basic introduction to R and some foundational statistical concepts, trusting the reader can find this elsewhere.

When it breaks

This assumption allows the book to maintain a narrow focus on its core topic of Bayesian multilevel models, avoiding introductory material and moving quickly to complex, practical examples.

Assumption 2

“The primary goal of statistical modeling in the context of this book is scientific inference within an empirical framework.”

Where it hides

Chapter 1 frames experiments and statistical analysis as components of the scientific method, aimed at answering research questions about the world.

When it breaks

This assumption provides the underlying justification for the entire enterprise of modeling, casting the techniques taught as tools for knowledge discovery.

Assumption 3

“Linear models (and their generalizations) are a sufficiently powerful and appropriate tool for a wide range of research questions in fields like linguistics and psychology.”

Where it hides

The entire book is focused on linear and generalized linear models. The preface notes the omission of non-linear modeling.

When it breaks

This focuses the book's scope on a versatile and foundational set of techniques, but it implicitly positions non-linear approaches as secondary or 'more complicated' topics for later study.

Placing the idea

How it compares — and where else it applies

We don't just explain the idea in isolation. We place it: against the alternative it replaces, and beyond the domain it was born in. That's the difference between knowing a method and knowing when to reach for it.

How it compares

vs Frequentist multilevel models, specifically the `lmer` function in R's `lme4` package.

What they share

Both approaches use a similar formula syntax to specify models. For many common models, they produce very similar point estimates for 'fixed effects' and variance components. Both are designed to handle repeated measures data by incorporating group-level ('random') effects.

Where they differ

`brms` is Bayesian, yielding full posterior distributions for all parameters, while `lmer` is frequentist, yielding point estimates and standard errors. `brms` requires specifying priors. `brms` provides credible intervals for all parameters, including random effects, whereas `lmer` does not easily provide confidence intervals for all model components. `brms` is more flexible, supporting a wider range of distributions and non-linear models.

What makes this distinctive

The book argues that the Bayesian approach is more flexible ('build the furniture you want'), provides richer output (full posteriors allowing direct probability statements), and offers a more principled way to handle complex models through regularization via priors and adaptive pooling.

Where else it applies

The model, taken beyond its home domain

Psychology and Cognitive Science

Experiments in these fields almost always involve repeated measures, such as multiple trials per participant or responses to multiple stimuli. The multilevel models taught in the book are essential for correctly analyzing this data by simultaneously modeling by-participant and by-item variability.

Education Research

Student performance data is often nested within classes, schools, and districts. Multilevel models can analyze student outcomes while accounting for the hierarchical structure of the data, modeling variation at the student, class, and school levels.

Economics (Panel Data)

Panel data, which follows multiple entities (e.g., countries, firms) over time, is a form of repeated measures. The models in this book can be adapted to analyze such data, modeling time trends while accounting for entity-specific effects.

Movement III · The run-it-now depth

The Playbook

Practical tools and examples from this guide.

Frameworks

Framework◆ Paid

Progressive Model Building Framework

A bottom-up framework for constructing a Bayesian multilevel model by starting with a simple foundation and adding components incrementally.

Start hereAn intercept-only model, which serves as a baseline for understanding the overall mean and total variance.

◆ The full 5-step framework — included with this guide purchase

Case studies — including what didn't work

Case study◆ Paid

When the Ear Believes What It Expects: Modeling Apparent Speaker Characteristics from a Single Vowel

Fifteen listeners judged the height, age, and gender of 139 speakers from the word 'heed', and a sequence of Bayesian multilevel models revealed that perception is governed less by acoustics alone than by what listeners assume about who is speaking.

Listeners cannot know a speaker's true age, gender, or height; they infer them from acoustic cues like fundamental frequency (f0) and vocal-tract length (VTL). The open question was whether those cues are used in a fixed, 'optimal' way, or whether listeners' own categorical assumptions reshape how the acoustics are read — a question simple statistical models could not answer.

◆ The full case — situation, decision, outcome, and the lesson — included with this guide purchase

Templates

Templatefree

`brms` Model Formula Template

Specify a Bayesian multilevel model formula for the brm function to fit repeated measures data.

How to useFill in each field to build the model formula in the form y ~ fixed_effects + (random_slopes | grouping_factor), then pass it to the brm function in R.

Dependent variable (y)
The response/outcome you measured (e.g. reaction time, duration).
Fixed effects
The population-level predictors of interest (e.g. a factor A or several predictors).
Random slopes
Effects allowed to vary by group; place before the | (e.g. A). Use 1 for intercept-only.
Grouping factor 1
The repeated-measures unit these slopes vary across (e.g. listener L).
Second grouping factor (optional)
An additional level of variation, if any (e.g. item, speaker); leave blank if none.
Random effects for second grouping factor (optional)
Intercepts/slopes that vary by the second grouping factor; leave blank if unused.
Assembled model formula
Combine the above as y ~ fixed_effects + (random_slopes | grouping_factor), e.g. response ~ A + (A|L).

How to read itPass the assembled formula to brm; fixed effects estimate population-level trends while the terms in parentheses model how those effects vary within each grouping factor (level of variation).

Template◆ Paid

Pooling Strategy Decision Tree

Decide how to estimate a factor with many levels (e.g., listeners or items) — complete pooling, no pooling, or partial pooling.

◆ The fillable template — included with this guide purchase

Items marked Paid are included when you buy this guide.

Reading well

How the author makes the case

Reading well means seeing how an argument is built, not just what it claims. Here are the moves this author uses to persuade you — the technique, where it shows up, and what it's doing to you. See the machinery, and you read everything more sharply.

metaphor

In the book

The author compares traditional statistics books to Spider-Man movies that always retell the origin story, arguing this book skips the 'getting bit' part to get straight to 'swinging between buildings at high velocity'.

What it does to you

To justify the book's focused, action-oriented approach and its omission of basic introductory material, framing it as a benefit that lets the reader get to the interesting parts faster.

analogy

In the book

The book repeatedly compares learning statistics to learning a musical instrument or a foreign language, emphasizing that practice and repetition are key, not innate 'brain power'.

What it does to you

To manage reader expectations about the learning process, encouraging perseverance and reframing difficulty as a normal part of acquiring a procedural skill.

simplification_of_complexity

In the book

The book explains complex statistical concepts using simple geometric and physical analogies, such as describing normal distribution parameters as 'sliding' and 'stretching' a bell curve, or regression as separating a variable into 'systematic' and 'random' components.

What it does to you

To build an intuitive, conceptual understanding of the models, making them more accessible to readers without a strong mathematical background.

Movement IV

Reflect

Consider the book's evidence, limitations and how it compares with other sources.

In this part

How good is it — where the book stands against the field, what it leaves open, and when to trust it.

  • — Its positioning, its critique, its blind spots
  • — When to apply it — and when not
  • — The evidence behind the advice

Book profile · in the corpus

This book’s model, against the corpus

2 of 7 constructs align with the field · 5 the book adds · 2 where it diverges · the field spans 66 constructs across 111 books

shared with the corpusthis book's own emphasisthe corpus adds (other sources)where it diverges

Shared with the corpus — corroborated by other sources

Listener VariationSpeaker Variation

This book's own emphasis — where it's the authority

Fundamental Frequency (f0)Acoustic Vocal-Tract Length (VTL)Apparent AgeApparent GenderApparent Height

Where it diverges — the book and the field pull apart

Listener VariationSpeaker Variation

The corpus adds — from 110 other sources this book doesn't cover

The full field guide folds in ideas this book doesn’t reach — drawn from 110 further sources and cited in the full model.

This book’s place in the corpus

1 of 111
sources in this corpus
7
constructs contributed
2
corroborated by others
5
unique to this book

Why the corpus guide, not just this book

This book stands on the field's multilevel-modeling shoulders for handling listener and speaker non-independence, where it sharpens the general framework into a concrete crossed-random-effects application. It is the standalone authority on voice-based size perception (f0, VTL, apparent age/gender/height), which the reconciled organizational-behavioral field simply does not cover; the field-guide still adds broader methodological scaffolding on validity, reliability, and generalizability that contextualizes the book's inferential claims.

This guide stands on the shoulders of this book and 110 other sources — every claim cited, the disagreements named.

Read the reconciled Organizational Science guide →

Read it closely

The book, examined

Not a summary — a close analytical reading: how the book is built, what it leaves open, and where it falls short.

How it’s built — the argument in order

  1. 01
    Ch. 1 — Introduction: Experiments and variables — Introduces the running experimental dataset (apparent age, gender, height judgments from f0 and VTL), and sets up the concepts of variables and experimental data that recur throughout.
  2. 02
    Ch. 2 — Probabilities, likelihood, and inference — Builds foundational concepts: sample spaces, empirical probabilities, the normal distribution, sample statistics vs. population parameters, and how likelihood connects data to credible parameter estimates.
  3. 03
    Middle chapters — Building models from components — Progresses from simple regression to models with intercepts, slopes, interactions, and random effects, introducing partial pooling, shrinkage, priors, and posterior distributions using brms.
  4. 04
    Ch. 5 and beyond — Alternative error distributions and complex outcomes — Extends models to t-distributed errors (Ch. 5), then binary/logistic (Ch. 10) and multinomial/ordinal outcomes, showing how the same principles adapt to different data types.
  5. 05
    Model evaluation and reporting — Covers posterior predictive checks, model comparison via WAIC/LOO, and how to write up and report Bayesian multilevel analyses for real research.

What it leaves unsolved

What are the true, fixed parameters of real populations, and can they even be said to exist?

The authors admit that many real-life populations are 'practically infinite and constantly changing,' so even if 'true' fixed parameters exist we can't be certain of them — this metaphysical limit is flagged but left unresolved.

How should priors be chosen in practice for a given research problem?

The takeaways list priors as a key concept, but the passages emphasize hands-on intuition over principled guidance, leaving open how a reader decides what prior is appropriate for their own data.

Is an observed effect (e.g. that male speakers are judged taller) a real perceptual fact or a social stereotype?

The text notes such effects 'may very well be real and may reflect stereotypes' — it raises the interpretive ambiguity but does not offer a method to disentangle genuine acoustic cues from listener bias.

How far can the single running dataset generalize to other fields' data structures?

The book grounds everything in one phonetics dataset; whether the modeling workflow transfers cleanly to very different repeated-measures designs is assumed rather than demonstrated.

Where it falls short — a fair critique

incomplete

The authors openly present only 'a teeny tiny slice of statistical inference' based on normally distributed errors, deferring other distributions to later chapters. Foundational probability and philosophy of probability are explicitly acknowledged as 'vastly oversimplified,' so the conceptual grounding is thin by design.

uninformed

By deliberately avoiding mathematical theory in favor of 'geometric' and 'intuitive' understanding, the book leaves readers without the tools to evaluate when the intuitions break down — the mathematical justification for why partial pooling, shrinkage, or MCMC estimation work is largely absent.

illogical

The pedagogical advice to 'read this chapter three times' and expect confusion signals that the conceptual scaffolding is not fully self-contained; understanding is deferred to later practical experience, which somewhat undercuts the claim that the material is 'accessible for readers with any level of statistical background.'

incomplete

Reliance on a single experimental dataset throughout, while pedagogically clean, limits demonstration of how choices (model structure, priors, evaluation) vary across genuinely different research contexts, leaving generalization to the reader without worked contrast cases.

Before you apply it

Using it well

Where the method fits, who it’s for, and the honest case for and against — so you apply it where it works.

Is this book for you?

For you if

  • You collect repeated measures in cognitive or social science
  • You know traditional models and want to translate to Bayesian
  • You want hands-on R coding over theory

Skip it if

  • You need formal mathematical statistical derivations
  • Your data are not repeated measures or hierarchical
  • You work outside R and won't adopt brms

Need first

  • Basic R familiarity
  • Comfort reading data and running scripts
  • Willingness to reread conceptual chapters multiple times

When it applies — and when it doesn’t

Use it
  • Analyzing repeated measures data in linguistics or psychology — exactly the design and fields the book targets
  • Fitting multilevel models with participant and item variation — core use of adaptive partial pooling and random effects
  • Quantifying uncertainty via credible intervals for all parameters — Bayesian posterior distributions deliver this directly
  • Logistic, multinomial, or ordinal outcome modeling — book progresses to these more complex model types
  • Learning R and brms/Stan workflow from scratch — fully worked code examples throughout with one dataset
Adapt it
  • Needing rigorous mathematical foundations of Bayesian theory — book deliberately favors intuition over mathematical depth
  • Choosing priors for high-stakes or contentious analyses — conceptual intro; sensitivity analysis needs deeper study
Not here
  • Non-hierarchical single-level or purely descriptive analysis — multilevel repeated-measures focus is overkill here
  • Production-scale pipelines outside R — tied to R and the brms interface

The honest case

Strongest case for

  • Repeated measures data dominate these fields and demand multilevel handling
  • Partial pooling and shrinkage yield better estimates than naive aggregation
  • Full posteriors give richer, direct uncertainty quantification
  • brms lowers the barrier to Stan for non-specialists

Strongest objection

  • Skipping mathematical theory may leave users unable to diagnose model failures
  • Prior choice and its influence get lighter treatment than warranted
  • Single dataset examples may not transfer to readers' varied designs

Tensions — choices to make, not settled answers

Reconciled seam

Model Complexity vs. Model Simplicity (Bias-Variance Tradeoff)

More complex models can capture more nuances in the data, potentially providing a better fit to the in-sample data. ↔ Simpler models are easier to interpret, less prone to overfitting, and often generalize better to out-of-sample data.

How they reconcileThe book directly addresses this tension by introducing formal model comparison methods like WAIC and leave-one-out cross-validation (LOO) to evaluate out-of-sample predictive accuracy, providing a principled way to justify model complexity. It also advocates for an incremental approach to building complexity.

Reconciled seam

Subjectivity of Bayesian Priors vs. Objectivity of Data

A common critique of Bayesian methods is that the requirement of specifying prior probabilities introduces a subjective element into what should be an objective analysis. ↔ The Bayesian perspective holds that all modeling involves subjective choices, and making priors explicit is more transparent than hiding assumptions.

How they reconcileThe book handles this by taking a pragmatic stance, arguing that with sufficient data, weakly informative priors have little effect on the posterior. It also demonstrates the utility of priors for regularization and stabilizing complex models, framing them as a practical tool rather than a philosophical liability.

Source notes

The model's constructs are drawn from the source element(s); load-bearing constructs are corroborated across the shelf, emerging ones are flagged.

Ideas covered by the source notes

  • Fundamental Frequency (f0)
  • Acoustic Vocal-Tract Length (VTL)
  • Apparent Age
  • Apparent Gender
  • Apparent Height
  • Listener Variation

Movement IV · Measure · The evidence

The evidence behind the advice

We don’t just assert — we show the research the ideas rest on: the study, its key finding, what it means for you, and the citation to chase it yourself. Then a curated path to go deeper. Grounded, not hand-waved.

The studies

The empirical backing, with findings and citations — trace any claim to its source.

Acoustic analysis of vowels spoken by a diverse group of speakers.

Acoustic characteristics of American english vowels

Key finding

The study produced a widely used public dataset of vowel acoustics from a large and varied set of speakers.

What it means for you

The dataset provides a valuable resource for research in phonetics, speech perception, and speaker recognition.

Why it’s here

This study is the source of the stimuli for the book's central case study, making it fundamental to all analyses presented.

Hillenbrand, J., Getty, L. A., Clark, M. J., & Wheeler, K. (1995).

Go deeper

A curated reading ladder — not a dump. Each with why it’s worth your time.

  • Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan · John Kruschke

    Recommended for reading 'During this book' to get additional information and a different perspective on Bayesian statistics and modeling.

  • Regression and Other Stories · Andrew Gelman, Jennifer Hill, & Aki Vehtari

    Recommended for reading 'During this book' as a supplementary text for a broader understanding of regression and Bayesian modeling.

  • Statistical Rethinking: A Bayesian Course with Examples in R and Stan · Richard McElreath

    Recommended for reading 'After this book' as a next step for readers who have mastered the concepts and wish to deepen their understanding of Bayesian modeling.

  • Statistics for Linguists: An Introduction Using R · Bodo Winter

    Recommended for reading 'Before this book' to get a foundation in more traditional (non-Bayesian) statistical methods and basic R.

  • Data Analysis Using Regression and Multilevel/Hierarchical Models · Andrew Gelman & Jennifer Hill

    Recommended for reading 'During this book' as a foundational text on multilevel models.

Movement V

Measure

Use available assessments to reflect on what you have learned.

In this part

A way to gauge yourself against the book's model, and the instruments it gives you.

  • — A self-check built from the book
  • — Instruments and what you'd measure next

Learning curriculum

After this book, you can…

The book's learning objectives, classified by Bloom's taxonomy and ordered so each builds on the ones before it.

01Foundational — know & understand
  1. describe
    After this book you can describe the structure of repeated measures data and identify the variables and sources of variation (listeners, speakers) in a typical experimental dataset.
    Check: Given a described experiment, learners identify outcome variables, predictors, and repeated-measures grouping factors and explain why observations are non-independent.
  2. explain
    After this book you can explain core probability and statistical inference concepts including sample space, probability, likelihood, and the role of distributions in making inferences.
    Check: Short-answer questions defining sample space, empirical probability, and likelihood; explain how observed samples inform inferences about unobserved cases.
  3. articulate
    After this book you can articulate what Bayesian multilevel models are and why they are appropriate for repeated measures data, contrasting them conceptually with traditional methods.
    Check: Written explanation of the Bayesian multilevel approach, its advantages, and when it is preferable to traditional tests for repeated measures.
  4. appreciate
    After this book you can adopt an iterative, practice-based learning stance toward statistical modeling, valuing conceptual/geometric intuition over mathematical derivation.
    Check: Reflective response describing how modifying working code and re-reading builds cumulative understanding of modeling concepts.
  5. interpret
    After this book you can interpret prior and posterior distributions and quantify uncertainty using credible intervals for model parameters.
    Check: Given posterior output, learners report and interpret credible intervals and explain the probabilistic meaning of parameter estimates.
02Working — apply
  1. fit
    After this book you can specify and fit a simple Bayesian model (intercept-only) in R using the brms package.
    Check: Lab task: write and run brms code for an intercept-only model on the provided dataset and report the results.
  2. construct
    After this book you can build models with slopes and interactions to compare groups and model categorical moderators such as apparent age and apparent gender.
    Check: Coding exercise: add categorical predictors and interaction terms in brms and interpret how moderators change acoustic-cue effects.
  3. model
    After this book you can model quantitative acoustic predictors such as fundamental frequency (f0) and vocal-tract length (VTL) as continuous predictors of apparent height.
    Check: Fit a brms model using f0 and VTL as continuous predictors and interpret the estimated slopes on apparent height.
  4. specify
    After this book you can specify random effects to model listener and speaker variation using the principle of adaptive partial pooling and shrinkage.
    Check: Add random intercepts and slopes for listeners and speakers in brms; explain how partial pooling and shrinkage affect estimates.
  5. extend
    After this book you can extend models to non-normal outcomes including logistic, multinomial, and ordinal regression for categorical perceptual judgments.
    Check: Fit a logistic or multinomial brms model for apparent gender/age judgments and interpret the outcome on the appropriate scale.
03Advanced — analyze & judge
  1. analyze
    After this book you can analyze how perceptual moderators (apparent age, apparent gender) change the relationship between acoustic cues and apparent height.
    Check: Given a fitted interaction model, learners decompose and interpret conditional effects of f0 and VTL across moderator levels.
04Mastery — synthesize & create
  1. evaluate
    After this book you can evaluate model fit using posterior predictive checks and compare models with information criteria (WAIC, LOO).
    Check: Perform posterior predictive checks and compute WAIC/LOO to compare competing models, justifying a model choice.
  2. design
    After this book you can design and build a progressively complex modeling workflow for your own repeated measures research question.
    Check: Project: propose a research question, build a sequence of brms models of increasing complexity, and justify each modeling decision.
  3. compose
    After this book you can write up and report the results of a Bayesian multilevel analysis in a clear, reproducible manner.
    Check: Draft a results section reporting posterior estimates, credible intervals, and model comparisons following conventions demonstrated in the book.

How to measure it

Turning each idea into a measure

For each construct: how to operationalize it, the observable signals to look for, and how well it holds up.

Fundamental Frequency (f0)

Measured in Hertz (Hz) from the speech waveform using acoustic analysis software. In the book's models, it is centered and scaled by 100 to represent units of hectohertz around the sample mean.

Observable signals
  • Periodicity in the speech signal's time-domain waveform.
  • Harmonic structure in the speech signal's frequency-domain spectrum.
Scale

Ratio scale (Hz).

Acoustic Vocal-Tract Length (VTL)

Estimated in centimeters by finding the geometric mean of vocal-tract resonances (formant frequencies) for a given vowel sound and comparing it to a reference speaker. In the book's models, this value is mean-centered.

Observable signals
  • The frequencies of formants (resonant peaks) in the speech spectrum.
  • Overall spectral tilt or scaling.
Scale

Ratio scale (cm).

Holds up?

This is an acoustic estimate, not a direct anatomical measurement, but it captures the perceptually relevant information.

Apparent Age

The listener's response in a forced-choice task, selecting either 'child (10-12 years old)' or 'adult (18+ years old)'. Coded as a two-level factor in the statistical model.

Observable signals
  • Listener selection of a category button in the experimental interface.
Scale

Nominal scale.

Apparent Gender

The listener's response in a forced-choice task, selecting either 'male' or 'female' (derived from the 'boy'/'man' and 'girl'/'woman' options). Coded as a two-level factor in the statistical model.

Observable signals
  • Listener selection of a category button in the experimental interface.
Scale

Nominal scale.

Apparent Height

The value in centimeters selected by the listener on a slider ranging from 4'0" to 6'6". This is treated as a continuous quantitative variable in the analysis.

Observable signals
  • The final position of the slider control in the experimental interface.
Scale

Ratio scale (cm).

Listener Variation

A set of 'random effects' in a multilevel model, representing the deviation of each listener's parameters (e.g., intercept, slopes for f0, VTL, etc.) from the population average. The magnitude is quantified by the standard deviation of these effects.

Observable signals
  • Consistent differences in average height ratings between listeners.
  • Different patterns of height ratings in response to the same acoustic cues across different listeners.
Scale

Not directly measured; inferred by the model.

Speaker Variation

A set of 'random effects' in a multilevel model, representing the deviation of each speaker's average perceived height from the value predicted by the fixed effects. The magnitude is quantified by the standard deviation of these effects.

Observable signals
  • A speaker is consistently rated taller or shorter than expected across multiple listeners.
Scale

Not directly measured; inferred by the model.

Self-assessment

Where would you like to improve?

This is a structured self-diagnostic built from the model — a mirror for reflection, not a validated psychometric scale. For validated measurement, see the instruments below.

1 = Strongly Disagree · 7 = Strongly Agree

Alignmentthe outcomes you steer toward
  • When I judge how tall a speaker is from their voice alone, I can point to the specific acoustic cues that led to my estimate.
Motivationthe states you cultivate in others
  • Before I interpret other cues in a voice, I first decide whether the speaker sounds like a child or an adult.
  • Before I interpret other cues in a voice, I first decide whether the speaker sounds male or female.
Supportthe conditions you shape
  • I routinely measure or note the fundamental frequency (pitch) of a voice when analyzing how listeners perceive it.
  • I draw conclusions about a speaker's vocal-tract length from formant frequencies without checking that estimate against known reference values.
  • I take into account that different listeners may rate the same voice differently before I finalize my interpretation of a judgment.
  • I consider that a speaker's individual vocal qualities, beyond pitch and vocal-tract length, may be shaping how listeners perceive them.
0 of 7 answered

Proposed measures — starter instruments where no validated one was found

Fundamental Frequency Measurement Fidelity Index

proposed · not validated

Rate each observable statement on the scale below.

  1. The pitch-extraction pipeline documents its algorithm, frequency search range, and sampling parameters before any analysis run begins.
  2. Every extracted f0 track undergoes an automated octave-error and voicing-decision check against a reference or manual trace.
  3. The process logs and reports extraction settings and confidence scores alongside each f0 value in the output dataset.

Scale: 1–7 (Strongly Disagree → Strongly Agree). Average the item ratings. This proposed index has no validated cutoff.

Acoustic VTL Estimation Quality Index

proposed · not validated

Rate each observable statement on the scale below.

  1. The formant-extraction procedure specifies LPC order, window length, and number of formants used for each recording before estimation.
  2. Each VTL estimate is cross-checked against at least one alternative formant-scaling or resonance model to confirm consistency.
  3. The process flags and excludes recordings falling below a defined signal-to-noise threshold prior to VTL calculation.

Scale: 1–7 (Strongly Disagree → Strongly Agree). Average the item ratings. This proposed index has no validated cutoff.

Listener Apparent-Age Judgment Protocol Index

proposed · not validated

Rate each observable statement on the scale below.

  1. The rating protocol presents voice stimuli to listeners in randomized, counterbalanced order across sessions.
  2. The system computes and reports inter-rater reliability statistics for every batch of apparent-age judgments collected.
  3. Listener instructions define the child-versus-adult categorization criteria explicitly before data collection starts.

Scale: 1–7 (Strongly Disagree → Strongly Agree). Average the item ratings. This proposed index has no validated cutoff.

The cheat sheet

Everything, on one page

One key takeaway from each section, with links to read more.

Publication details

Consult the sources listed in this guide for further reading. Edition 1 · Updated 2026-08-05.

Take it with you

The main guide above is free to read. This purchase includes 3 additional tools and examples — 1 framework, 1 case study and 1 template — plus the full sections and the ebook itself: an epub and a PDF covering all 7 sections. Every format, yours to keep — permanently, including every future update. When this guide is deepened, you get the new edition at no cost.

One payment. The main guide stays free to read.

Get the first two lessons of Bayesian Multilevel Models for Repeated Measures dаta A Conceptual and Practical Introduction in R free by email.

Two lessons now, then one letter a month from Leading With Data. Your address is used for these emails only. Unsubscribe any time.