HSCI 410 · Lesson 4

Generalized Linear Models

Exploratory Data Analysis For Epidemiology

Learning objectives for this lesson:

  • Recognise when an outcome has more than two categories or is a count or a rate, and place multinomial, ordinal, Poisson, and negative binomial regression within the generalised linear model family alongside linear and logistic regression
  • Select an appropriate model for a multi-category outcome (multinomial, proportional-odds, adjacent-category, or continuation-ratio) based on study objectives and data, fit each model, and evaluate the assumptions on which each is based
  • Interpret odds ratio and relative risk ratio estimates from each multi-category model and compute predicted probabilities from them
  • Distinguish among simple counts, rates with person-time denominators, population rates, and area-based counts, and describe the Poisson distribution and its mean = variance property
  • Specify and interpret a Poisson regression model including the offset term, and interpret incidence rate ratios (IRR) from exponentiated Poisson coefficients
  • Evaluate Poisson models using Pearson, deviance, and Anscombe residuals, and distinguish apparent from real overdispersion and apply appropriate corrections
  • Compare negative binomial regression models (NB-1, NB-2) to Poisson regression, and apply zero-inflated, hurdle, and zero-truncated models to handle excess zeros
  • Choose the right member of the GLM family for a given outcome by sketching the link function and the comparison it implies, and report effects with the interpretation that model warrants

This course was developed by Dr. Kiffer G. Card, Faculty of Health Sciences, Simon Fraser University based on Dohoo, I. R., Martin, S. W., & Stryhn, H. (2012). Methods in Epidemiologic Research. VER Inc.

Reference

Glossary: Key Terms, People & Concepts

📚 Reference page, available throughout the lesson

This glossary collects the key concepts, people, and ideas you will meet in this lesson. Use it as a reference while you work through the material, or as a review before assessments. Type in the search box to filter entries.

Key Concepts & Ideas
Ordinal Outcome A categorical outcome with a natural order but unequal or unknown spacing between levels (e.g., mild/moderate/severe; Likert scales). Logical target for cumulative-logit models.
Nominal (Multinomial) Outcome A categorical outcome with three or more unordered categories (e.g., disease subtype A/B/C). Modeled with multinomial logistic regression.
Baseline / Reference Category The category of a categorical outcome (or predictor) that other levels are compared against. Choice affects coefficient interpretation but not overall fit.
Cumulative Probability The probability that the outcome falls at or below a particular ordinal level. Cumulative-logit models work on logits of these cumulative probabilities.
Latent-Variable Formulation A motivation for ordinal models in which an unobserved continuous variable is sliced into ordered categories by thresholds. Justifies the proportional-odds structure.
Methods & Statistical Concepts
Proportional Odds Assumption In cumulative-logit models, the assumption that the effect of each predictor is the same across all cut-points of the outcome. Tested with a Brant or score test.
Cumulative Logit Model An ordinal regression that models log-odds of cumulative probabilities: logit(P(Y ≥ j)) = αⱼ + Xβ. Yields a single β per predictor under proportional odds.
Partial Proportional Odds A relaxation of proportional odds in which some predictors have category-specific coefficients while others remain constrained. Useful when proportional odds fails for only a few variables.
Brant Test A formal test of the proportional-odds assumption that compares fitted coefficients across binary logit splits at each cut-point.
Adjacent-Category Logit An ordinal model that compares each category to the next, rather than cumulating. An alternative to proportional odds for ordered outcomes.
Continuation-Ratio Model An ordinal model that compares each category against all higher categories combined. Useful when categories represent a sequential process.
Multinomial Logit A model for nominal outcomes that fits k−1 separate logits, each comparing a non-reference category against the baseline. Yields category-specific coefficients.
IIA (Independence of Irrelevant Alternatives) An assumption of the multinomial logit: relative odds between any two categories don't depend on which other categories are available. Tested with the Hausman-McFadden test.
Probit Link An alternative link function (inverse normal CDF) used in some ordinal and binary models. Gives similar results to logit but uses standard-normal thresholds.
VGAM / polr R packages/functions for ordinal regression. MASS::polr fits proportional-odds models; VGAM::vglm handles a broader family including partial-PO and continuation-ratio.
Key People
Peter McCullagh (1952– ) Irish statistician who introduced the cumulative-logit (proportional-odds) model in his 1980 paper, providing the foundation for modern ordinal regression.
Alan Agresti (1947– ) American statistician whose textbook Categorical Data Analysis is the standard reference on ordinal, nominal, and contingency-table methods.
Rollin Brant Statistician who developed the eponymous test (1990) for the proportional-odds assumption.
Key Concepts & Ideas
Count Data Non-negative integer outcomes (0, 1, 2, …) representing the number of events. Examples: cases of disease, hospital visits, deaths.
Rate Data Counts standardised by exposure or population time-at-risk (e.g., cases per 1000 person-years). Modeled as count + log(time) offset.
Exposure / Person-Time The denominator in a rate: how much “at-risk time” produced the counted events (e.g., person-years, animal-months). Enters the model as an offset.
Offset A predictor in a Poisson/NB model whose coefficient is fixed at 1 (typically log(person-time)). Converts a count regression into a rate regression.
Overdispersion Observed variance exceeds the mean, violating the Poisson mean = variance assumption. Inflates Type I error if ignored; addressed with negative binomial or quasi-Poisson.
Dispersion Parameter (φ) A parameter capturing the ratio of variance to mean in count models. φ = 1 indicates Poisson; φ > 1 indicates overdispersion.
Zero Inflation More zeros than the Poisson or NB distribution predicts. Suggests two underlying processes, one generating structural zeros and one generating counts.
Incidence Rate The number of new cases per unit person-time (e.g., per 1000 person-years). The natural quantity estimated by Poisson models with an offset.
Methods & Statistical Concepts
Poisson Distribution A discrete probability distribution for counts of rare independent events with a constant rate. Mean equals variance (λ).
Poisson Regression A GLM with Poisson family and log link: log(λ) = Xβ. Used for count or rate outcomes when the Poisson assumption holds.
Log Link Function The canonical link for count GLMs, log(λ) = Xβ. Coefficients are exponentiated to give rate ratios (multiplicative effects).
IRR (Incidence Rate Ratio) The exponentiated coefficient from a Poisson or NB rate model: IRR = exp(β). Interprets as the ratio of incidence rates per unit increase in the predictor.
Negative Binomial Regression A GLM that allows variance to exceed the mean by adding a dispersion parameter (k or θ). Standard remedy for overdispersed counts.
Quasi-Poisson A pragmatic fix for overdispersion that scales standard errors by √φ. Uses Poisson point estimates but inflates inference; doesn't yield a true likelihood.
Zero-Inflated Poisson (ZIP) A two-component model: a logistic regression for “structural zero” vs. “at-risk” status, and a Poisson for counts among the at-risk. Handles excess zeros.
Zero-Inflated Negative Binomial (ZINB) Like ZIP but with a negative binomial count component. Handles both excess zeros and overdispersion.
Hurdle Model A two-part model: a binary process for any-vs-no events, and a truncated count process for those with at least one event. Conceptually distinct from zero-inflation.
Vuong Test A test for comparing non-nested models (e.g., Poisson vs. zero-inflated Poisson). Evaluates which fits the observed data better.
Deviance / Pearson Residuals Residuals scaled appropriately for GLMs. Used to diagnose lack of fit, outliers, and overdispersion in Poisson and NB models.
Key People
Siméon-Denis Poisson (1781–1840) French mathematician and physicist who derived the Poisson distribution as a limit of the binomial. The distribution and the regression bear his name.
Norman Breslow (1941–2015) American biostatistician who developed Poisson-regression methods for cohort and rate data, and (with Day) authored the foundational two-volume Statistical Methods in Cancer Research.
Diane Lambert American statistician who introduced zero-inflated Poisson regression in a 1992 paper on manufacturing defects. The method is now standard for excess-zero counts.
No matching entries. Try a different search term.
Section 1 of 9

Introduction & Overview of Models

⏱ Estimated time: 20 minutes
Lesson 6

Modelling Ordinal & Multinomial Data

Four ways to handle an outcome that has more than two categories, ordered or not.

Section 1 of 4

Introduction & Overview of Models

Nominal versus ordinal, the Apgar example, and the four logit formulations.

Two types

Nominal vs ordinal outcomes

Nominal

Categories with no meaningful rank. Modelled with multinomial logistic regression, which makes no ordering assumption.

Ordinal

Categories with a meaningful rank but unknown, unequal spacing. Ordinal models exploit the ordering for parsimony.

The ordering distinction drives model choice. Using a nominal model on ordinal data wastes information; imposing order on nominal data distorts inference.

Running example

Apgar scores and prenatal visits

Apgar CategoryCode<6 Visits≥6 VisitsTotal
1–6 (Low)0472572
71484290
825972131
9–10 (High)3134227361

Each model in this lesson will ask a different question about these same 654 births.

Four logits

What each model compares

Multinomial logit

Each category vs. a chosen baseline. Category-specific coefficients. Works on nominal and ordinal data.

Proportional-odds (cumulative logit)

Probability of being at or above level j vs. below it. Single coefficient per predictor.

Adjacent-category logit

Category j vs. the category immediately below. Single constrained coefficient per predictor.

Continuation-ratio logit

Category j vs. all categories below j combined. Best for sequential-stage outcomes.

The four equations

Logit formulations side by side

Multinomial (Eq 17.1)
\[ \ln\frac{\color{#0B7B6B}{P(Y=j)}}{\color{#C2410C}{P(Y=1)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1^{(j)}} X \]
P(Y=j) prob. of category j P(Y=1) prob. of baseline β₀ᵃ category intercept β₁ᵃ category slope
Proportional-odds (Eq 17.2)
\[ \ln\frac{\color{#0B7B6B}{P(Y \ge j)}}{\color{#C2410C}{P(Y < j)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1} X \]
P(Y≥j) at or above j P(Y<j) below j β₀ᵃ cutpoint intercept β₁ shared slope
Adjacent-category (Eq 17.3)
\[ \ln\frac{\color{#0B7B6B}{P(Y=j)}}{\color{#C2410C}{P(Y=j-1)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1} X \]
P(Y=j) category j P(Y=j−1) category just below β₀ᵃ category intercept β₁ common slope
Continuation-ratio (Eq 17.4)
\[ \ln\frac{\color{#0B7B6B}{P(Y=j)}}{\color{#C2410C}{P(Y < j)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1} X \]
P(Y=j) reaching stage j P(Y<j) stopping earlier β₀ᵃ stage intercept β₁ common slope
Carry forward

What to take into the next section

  • Nominal vs ordinal is the first decision. Ordering is information you can use or discard.
  • All four models are logistic models. They differ in what each logit compares.
  • Ordinal models gain parsimony by sharing one slope coefficient across cutpoints, but that constraint must be tested.

Introduction and Overview

An earlier lesson covered logistic regression for binary outcomes. This lesson extends the framework to outcomes with more than two categories, whether nominal (no natural order) or ordinal (ordered). The four content sections walk through the major models in order: an overview of the four-model toolkit (this section), the multinomial logistic model for nominal outcomes (a later section), the proportional-odds model for ordinal outcomes including how to test the proportional-odds assumption (a later section), and finally adjacent-category and continuation-ratio models as alternatives when proportional-odds doesn't hold (a later section). For an epidemiology-focused overview that maps all four models onto the same dataset, see Ananth & Kleinbaum (1997); the open-access encyclopedia entries on ordinal regression and multinomial logistic regression summarise the same toolkit at an undergraduate level.

Learning Objectives

  • Distinguish nominal from ordinal outcomes and explain why each calls for a different modelling strategy.
  • Map the four logits used by multinomial, proportional-odds, adjacent-category, and continuation-ratio models.
  • Use the Apgar-score example to anticipate how each model will partition the same outcome.
  • Choose an initial model based on the structure and ordering of the outcome categories.

When Outcomes Have More Than Two Categories

In many epidemiological studies the outcome variable has more than two categories. These outcomes fall into two broad types: nominal data, where the categories have no natural ordering (e.g., type of disease, preferred clinic), and ordinal data, where the categories are ordered (e.g., pain severity: none, mild, moderate, severe).

The choice of model depends on whether the outcome is nominal or ordinal. Nominal data require multinomial logistic regression or log-linear models. Ordinal data can be analysed with the same multinomial model (ignoring the ordering), but more efficient approaches exploit the ordering: proportional-odds, adjacent-category, and continuation-ratio models (McCullagh, 1980; Ananth & Kleinbaum, 1997).

Nominal DataClick to explore
Ordinal DataClick to explore
Choosing the Right ModelClick to explore

The Apgar Score Example

Throughout Chapter 17, the authors use Apgar scores as a running example. Apgar scores (measured at birth) are recoded into four ordinal categories. The research question is whether the number of prenatal visits is associated with Apgar score category.

Apgar CategoryCodePrenatal Visits < 6Prenatal Visits ≥ 6Total
1–6 (Low)0472572
71484290
825972131
9–10 (High)3134227361
Total288366654

Overview of the Four Models

Each of the four models for multi-category outcomes uses a different formulation of the logit (log-odds). Understanding the logit structure is the key to understanding each model.

Multinomial Logistic Regression (Eq 17.1)

Compares each outcome category to a baseline category. For J categories, the model estimates J−1 sets of coefficients. Each set describes how predictors relate to the log-odds of being in category j versus the baseline.

Multinomial logit (Eq 17.1)
\[ \ln\!\frac{\color{#0B7B6B}{p(Y = j)}}{\color{#C2410C}{p(Y = 1)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1^{(j)}} X \]
The log of the odds of category j versus the baseline category is a category-specific intercept plus a category-specific slope times the predictor. Each non-baseline category gets its own coefficients.

No assumptions about ordering are made, so this model is appropriate for both nominal and ordinal outcomes (though it is less efficient for ordinal data).

Proportional-Odds Model (Eq 17.2)

Based on cumulative probabilities. The logit compares the probability of being at or above category j versus below it. A single coefficient per predictor applies at every cutpoint, the proportional-odds assumption.

Proportional-odds (cumulative) logit (Eq 17.2)
\[ \ln\!\frac{\color{#0B7B6B}{p(Y \ge j)}}{\color{#C2410C}{p(Y < j)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1} X \]
The log-odds of being at or above category j versus below it uses a cutpoint-specific intercept but a single slope shared across cutpoints, which is the proportional-odds assumption.

This is the most common ordinal logistic model and is more parsimonious than the multinomial model (McCullagh, 1980).

Adjacent-Category Model (Eq 17.3)

Compares each category to the adjacent (next lower) category. This model is a constrained version of the multinomial model where the coefficient for categories n levels apart equals n times the coefficient for adjacent categories.

Adjacent-category logit (Eq 17.3)
\[ \ln\!\frac{\color{#0B7B6B}{p(Y = j)}}{\color{#C2410C}{p(Y = j-1)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1} X \]
The log-odds compare each category with the one just below it, using a category intercept and a common slope.

Like the proportional-odds model, it estimates a single β1 per predictor.

Continuation-Ratio Model (Eq 17.4)

Compares each category to all lower categories combined. This model is especially appropriate when the outcome represents sequential stages that must be “passed through” to reach higher levels (e.g., number of attempts to achieve certification).

Continuation-ratio logit (Eq 17.4)
\[ \ln\!\frac{\color{#0B7B6B}{p(Y = j)}}{\color{#C2410C}{p(Y < j)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1} X \]
The log-odds compare reaching category j with stopping below it, useful when the categories represent sequential stages.

Can be fit as a series of separate binary logistic regressions with appropriately recoded outcome variables.

Knowledge check: this section

1. Nominal outcome data differ from ordinal outcome data in that:

Nominal data have categories with no inherent ranking or ordering (e.g., type of disease), while ordinal data have categories that can be meaningfully ordered (e.g., disease severity). The number of categories is not related to the distinction.

2. How many sets of coefficients does a multinomial logistic model estimate for J outcome categories?

A multinomial logistic model compares each of the J−1 non-baseline categories to the baseline category. Each comparison requires its own set of coefficients, yielding J−1 sets in total.

3. Which model assumes the effect of a predictor is the same across all cutpoints?

The proportional-odds model estimates a single coefficient per predictor that applies at every cutpoint of the outcome. This is the “proportional odds” assumption: the OR is the same regardless of where you divide the outcome categories.

✎ Reflection

Think of an ordinal outcome variable from your own field of study. What are the categories, and which of the four models introduced here do you think would be most appropriate? Why?

Model answerPick a real ordinal outcome (e.g., self-rated health: poor, fair, good, very good, excellent). Most appropriate model: proportional odds (cumulative logit) as the default because it preserves the ordering and gives interpretable cumulative ORs; falls back to partial proportional odds if Brant's test flags violations; falls back to multinomial logistic if the ordinal structure is implausible (e.g., the ‘fair’ category mixes truly intermediate health with mistranslated responses); continuation-ratio is appropriate if the outcome represents progression through stages (e.g., disease progression from healthy → mild → moderate → severe, with each stage as a hurdle), but not for cross-sectional self-rated health where all categories are observed simultaneously.
✓ Reflection saved!
Complete the quiz and reflection to continue.
Section 2 of 9

Multinomial Logistic Regression

⏱ Estimated time: 25 minutes
Section 2 of 4

Multinomial Logistic Regression

The general model for any categorical outcome. Separate coefficient sets for each comparison.

The structure

J minus 1 simultaneous logits

Multinomial logit for category j vs. baseline 1
\[ \ln\frac{\color{#0B7B6B}{P(Y=j)}}{\color{#C2410C}{P(Y=1)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1^{(j)}} X \]
P(Y=j) prob. of category j P(Y=1) prob. of baseline β₀ᵃ category intercept β₁ᵃ category slope

For the Apgar example with 4 categories, this yields 3 sets of coefficients, one per non-baseline category.

Choice of baseline changes the coefficients but not the overall model fit.

Predicted probabilities

How the multinomial probabilities fit together

Eq 17.5: baseline category probability
\[ \color{#0B7B6B}{P(Y=0)} = \frac{1}{1 + \color{#C2410C}{e^{X\beta^{(1)}}} + \color{#C2410C}{e^{X\beta^{(2)}}} + \color{#C2410C}{e^{X\beta^{(3)}}}} \]
P(Y=0) baseline probability e^{Xβ} exponential term per non-baseline category
Eq 17.6: non-baseline category j
\[ \color{#0B7B6B}{P(Y=j)} = \frac{\color{#1D4ED8}{e^{X\beta^{(j)}}}}{1 + \color{#C2410C}{e^{X\beta^{(1)}}} + \color{#C2410C}{e^{X\beta^{(2)}}} + \color{#C2410C}{e^{X\beta^{(3)}}}} \]
P(Y=j) probability of category j e^{Xβᵃ} its own exponential term denominator normalising sum over all categories

Probabilities across all categories sum to 1. Each probability depends on all coefficient sets.

Interpretation

Relative risk ratios in the Apgar data

0.24Category 0 vs 3
76% lower relative risk of low Apgar with ≥6 prenatal visits
0.65Category 1 vs 3
35% lower relative risk of Apgar = 7
0.72Category 2 vs 3
28% lower relative risk of Apgar = 8

The gradient from 0.24 to 0.72 confirms that prenatal care has the strongest association with avoiding the worst outcomes.

Key assumption

Independence of irrelevant alternatives

The relative odds between any two categories should not change when other categories are added or removed.

When it matters

Nominal outcomes with genuinely substitutable alternatives, e.g., choosing between transport modes or clinic locations.

When it rarely matters

Ordinal health outcomes, where the categories represent a severity continuum rather than free-choice alternatives.

Carry forward

What to take into the next section

  • The multinomial model estimates J minus 1 sets of coefficients. Exponentiated coefficients are relative risk ratios.
  • All predicted probabilities depend on all coefficient sets and sum to 1.
  • The independence-of-irrelevant-alternatives assumption is rarely a practical concern for ordered health outcomes.
  • Diagnostics reuse binary logistic tools on pairs of categories.

Introduction and Overview

An earlier section mapped the four-model landscape. This section walks into the first one in detail: the multinomial logistic model. This is the most general option: it works on any categorical outcome, ordered or not, but you pay for that generality with a coefficient for every comparison and many more parameters to interpret.

Learning Objectives

  • Set up a multinomial logistic model as J−1 simultaneous binary logits against a chosen baseline.
  • Interpret exponentiated coefficients as relative risk ratios for non-baseline versus baseline categories.
  • Compute predicted probabilities for every outcome category from the joint set of linear predictors.
  • Recognise the independence-of-irrelevant-alternatives (IIA) assumption and its implications.

The Multinomial Logistic Model

The multinomial logistic model simultaneously fits J−1 separate logistic models, each comparing one category to a chosen baseline. All parameters are estimated jointly, so the model accounts for the correlation among the comparisons.

Predicted Probabilities

The predicted probability for each outcome category is computed from the set of linear predictors. Let Xβ(j) denote the linear predictor for category j.

Equation 17.5: probability for the baseline category
\[ \color{#0B7B6B}{p(Y = 0)} = \frac{1}{1 + e^{X\beta^{(1)}} + e^{X\beta^{(2)}} + e^{X\beta^{(3)}}} \]
The probability of the baseline category is one divided by a normalising sum that runs over every category, so all category probabilities add to one.
Equation 17.6: probability for category j
\[ \color{#0B7B6B}{p(Y = j)} = \frac{e^{X\beta^{(j)}}}{1 + e^{X\beta^{(1)}} + e^{X\beta^{(2)}} + e^{X\beta^{(3)}}} \]
The probability of category j is its own exponential term divided by the same normalising sum.

These probabilities always sum to 1 across all categories. Each predicted probability depends on all sets of coefficients, rather than only the coefficients for that category.

These formulas write category 0 as the baseline for illustration. In the Apgar results below, the high category (9–10, coded 3) is used as the reference instead. Which category you call the baseline is a labelling choice: it re-expresses the coefficients but leaves the fitted probabilities and the overall fit unchanged.

Interpreting Odds Ratios

Exponentiated coefficients from a multinomial model are technically ratios of relative risks (RRR), not true odds ratios. Each exp(β(j)) gives the ratio of the probability of being in category j relative to the baseline, for a one-unit change in the predictor.

Read intuitively, a relative-risk ratio of 0.24 means that for mothers with six or more prenatal visits, the risk of the low category measured against the high baseline category is about a quarter of what it is for mothers with fewer visits. The name relative-risk ratio, rather than odds ratio, is a reminder that the comparison is built from probabilities taken against the baseline, not from odds.

Because the multinomial model estimates separate coefficients for each comparison, the effects can differ across categories. For ordinal outcomes, you would typically expect a gradient, with more pronounced effects for the categories furthest from the baseline.

Predicted Probabilities

Predicted probabilities from a multinomial model vary by the values of all predictors. To communicate results, it is often useful to compute predicted probabilities at specific covariate patterns (e.g., prenatal visits < 6 vs ≥ 6) and present them in a table or graph.

Testing significance can be done with Wald tests (for individual coefficients) or likelihood-ratio tests (for overall effects). Because the multinomial model has J−1 coefficients per predictor, an overall LRT that tests all J−1 simultaneously is generally preferred over examining individual coefficients.

Independence of Irrelevant Alternatives (IIA)

The multinomial logistic model assumes IIA: the odds of choosing one category over another are independent of what other categories are available. If this assumption is violated, adding or removing a category would change the odds between the remaining categories.

Two tests are available: the Hausman-McFadden test and the Small-Hsiao test. However, these tests often give conflicting results, and IIA violations are primarily a concern for nominal data where alternatives are genuinely substitutable (e.g., choosing a mode of transport). For ordinal data, the independence of irrelevant alternatives is rarely a practical concern.

📋 Example: Apgar Scores and Prenatal Visits

In the Apgar score example, the multinomial model (with category 3 [9–10] as baseline) produced the following key results for prenatal visits (≥6 vs <6):

  • Category 0 vs 3: OR = 0.24, so those with ≥6 visits have 76% lower relative risk of a low Apgar score
  • Category 1 vs 3: OR = 0.65, a 35% lower relative risk of Apgar = 7
  • Category 2 vs 3: OR = 0.72, a 28% lower relative risk of Apgar = 8

The gradient (0.24 → 0.65 → 0.72) shows the strongest effect for the lowest Apgar category, as expected for an ordinal outcome.

Note on IIA Tests

The Hausman-McFadden and Small-Hsiao tests for IIA often give conflicting results and are not always reliable. In practice, IIA is mainly a concern for nominal (unordered) outcomes with genuinely substitutable alternatives. For ordinal outcomes, it is rarely problematic. Regression diagnostics can be performed by fitting ordinary logistic models for pairs of categories and using standard diagnostic techniques.

Alternative-Specific Data

In some situations, predictors may vary across alternatives rather than (or in addition to) varying across observations. For example, in a study of clinic choice, the distance to each clinic varies by alternative. Special formulations of the multinomial model (conditional logit or mixed logit) accommodate such alternative-specific data.

Knowledge check: this section

1. In multinomial logistic regression, the exponentiated coefficients represent:

The exponentiated coefficients in a multinomial logistic model are ratios of relative risks (RRR), not true odds ratios. Each RRR compares the probability of being in a given category relative to the baseline for a one-unit change in the predictor.

2. The IIA assumption states that:

The Independence of Irrelevant Alternatives (IIA) assumption states that the relative odds of choosing one category over another do not depend on what other categories are available. Violation of IIA means that adding or removing a category would change the estimated odds between remaining categories.

3. How are predicted probabilities computed from a multinomial model?

The predicted probability for category j is exp(Xβ(j)) divided by [1 + Σ exp(Xβ(k))] for all non-baseline categories k. For the baseline category, the probability is 1 divided by the same denominator. This ensures all probabilities sum to 1.

✎ Reflection

Consider the Apgar score example. Why do you think the OR for the lowest Apgar category (0.24) is more extreme than for the middle categories? What does this gradient tell us about prenatal care and birth outcomes?

Model answerThe lowest Apgar category (1–6, coded 0) has an OR of 0.24 relative to the highest category (9–10, coded 3) for prenatal-care access. The more extreme OR at the lowest category reflects two mechanisms: (a) severity gradient: the most distressed neonates have the most concentrated risk factors (substance exposure, late prenatal care, undiagnosed conditions), all of which prenatal care could address; (b) preventability: severe outcomes have more identifiable causes and more leverage from intervention. The gradient (smaller OR at lower Apgar, OR closer to 1 at middle Apgar) tells us prenatal care does the most good where the marginal value of detection is highest, since it prevents the catastrophic outcomes more efficiently than it prevents intermediate ones. This is the classical “high-risk targeting” pattern in public-health interventions.
✓ Reflection saved!
Complete the quiz and reflection to continue.
Section 3 of 9

Proportional-Odds Model

⏱ Estimated time: 25 minutes
Section 3 of 4

Proportional-Odds Model

The workhorse for ordered outcomes. One coefficient per predictor, one test to verify it.

The motivation

A latent continuous variable divided by cutpoints

Eq 17.7: latent variable
\[ \color{#0B7B6B}{S_i} = \color{#1D4ED8}{\beta_1 X_{1i}} + \color{#1D4ED8}{\beta_2 X_{2i}} + \cdots + \color{#BE185D}{\varepsilon_i} \]
Sᵢ latent score for person i βⱼXⱼᵢ predictor contributions εᵢ error term
Category 0 τ ₁ Category 1 τ ₂ Category 2 τ ₃ Cat 3 Latent continuum S

Predictors shift the whole distribution left or right; the cutpoints stay fixed.

The equation

Cumulative logit: one slope across all cutpoints

Proportional-odds model
\[ \text{logit}\,\color{#0B7B6B}{P(Y \ge j)} = \color{#6D28D9}{\beta_{0j}} + \color{#1D4ED8}{\beta_1} X \]
P(Y≥j) cumulative probability β₀ⱼ cutpoint intercept β₁ shared slope

The intercept varies by cutpoint j, but β₁ is the same everywhere. One odds ratio per predictor summarises the effect across the entire ordinal outcome.

Individuals with 6 or more prenatal visits have 1.59 times the odds of being at or above any given Apgar category.Apgar example, Chapter 17
Testing the assumption

The Brant test

The Brant test fits binary logistic models at each cutpoint and asks: do the coefficients differ significantly across cutpoints?

Predictorχ²dfP-valueHolds?
Prenatal visits2.1420.343Yes
Maternal age8.9220.012No
Parity1.0320.598Yes
Overall12.4560.053Borderline

Only maternal age violates the assumption here. A partial proportional-odds model would constrain all predictors except maternal age.

When the assumption fails

Remedies: partial and generalised models

Partial proportional-odds

Relaxes the constraint only for predictors that fail the Brant test. A good balance between fit and parsimony.

Generalised ordinal logit

Allows separate coefficients at each cutpoint. Equivalent to J minus 1 binary logistic regressions simultaneously.

Fall back to multinomial

If all predictors violate proportional odds, the unconstrained multinomial model is the honest fallback.

Carry forward

What to take into the next section

  • The proportional-odds model gives one OR per predictor, valid at every cumulative cutpoint, but only if the assumption holds.
  • The Brant test checks whether coefficients differ across cutpoints. Predictor-specific results guide partial models.
  • When the assumption fails, options include the partial proportional-odds model, the generalised ordinal logit, and the multinomial fallback.

Introduction and Overview

An earlier section used multinomial logistic regression to fit a model that ignores any ordering in the outcome categories. This section takes the more parsimonious route: when the categories are ordered, the proportional-odds model uses far fewer parameters by assuming the effect of each predictor is the same across all category cut-points. The trade-off is that you have to verify the proportional-odds assumption holds.

Learning Objectives

  • Express the proportional-odds (cumulative logit) model in terms of an underlying latent continuous variable and cutpoints.
  • Interpret a single odds ratio as the effect of a predictor across every dichotomisation of the ordinal outcome.
  • Test the proportional-odds assumption using the score (Brant) test or by comparing nested models.
  • Diagnose what to do when proportional-odds clearly fails for a given predictor.

The Most Common Ordinal Model

The proportional-odds model (also called the cumulative logit model or ordinal logistic regression) is the most widely used model for ordinal outcomes. It was formalised by McCullagh (1980) and is based on the idea of an underlying continuous latent variable that is divided into the observed ordinal categories by a series of cutpoints, the structure of the ordered logit model.

Equation 17.7: latent variable
\[ \color{#0B7B6B}{S_i} = \color{#1D4ED8}{\beta_1 X_{1i}} + \color{#1D4ED8}{\beta_2 X_{2i}} + \cdots + \color{#1D4ED8}{\beta_k X_{ki}} + \color{#BE185D}{\varepsilon_i} \]
An unobserved latent score is a linear combination of the predictors plus an error term; observed ordinal categories are bands of this score.

The latent variable Si is divided by cutpoints (τ1, τ2, …, τJ−1) into J observed categories. If Si falls between τj−1 and τj, the observation is classified into category j.

The Proportional-Odds Logit

The model takes the form of a cumulative logit: logit(p(Y ≥ j)) = β0j + βX. The key feature is that the intercept varies across cutpoints (giving parallel lines on a logit scale) but the slope coefficients are the same for every cutpoint. This means a single OR summarises the effect of each predictor across all levels of the outcome (McCullagh, 1980).

Proportional odds in plain words. The predictor multiplies the odds by the same amount wherever you split the ordered outcome. If six or more prenatal visits multiply the odds of scoring above the lowest Apgar category by 1.59, they multiply the odds of reaching the top category by that same 1.59. You get a single odds ratio, and it applies at every cutpoint. That economy is the reason to reach for the model, and the proportional-odds assumption is the one thing you have to check before trusting it.

Equation 17.9: predicted probability from the latent variable
\[ \color{#0B7B6B}{p(Y = j)} = p(\color{#1D4ED8}{S} \le \color{#C2410C}{\tau_j}) - p(\color{#1D4ED8}{S} \le \color{#C2410C}{\tau_{j-1}}) \]
The probability of category j is the chance the latent score falls between two adjacent cutpoints.
A single bell-shaped latent distribution divided into four shaded bands by three dashed cutpoint lines, labelled None, Mild, Moderate, and Severe.
The latent-variable view: one continuous, unobserved score underlies the ordinal outcome, and the cutpoints τ slice it into the observed categories. The probability of a category is the area of the distribution between its two cutpoints.
📋 Example: Apgar scores, proportional-odds model

In the Apgar score example, the proportional-odds model yields an OR of 1.59 for prenatal visits (≥6 vs <6). This means that individuals with 6 or more prenatal visits have 1.59 times the odds of being at or above any given Apgar category, compared to those with fewer visits. This single OR applies at every cutpoint (0 vs 1+, 0–1 vs 2+, and 0–2 vs 3).

R Activity: multinomial and proportional-odds models in R

The course dataset phaa_survey_clean.csv has both an unordered multi-category variable (region, 5 Lower-Mainland regions) and an ordered one (education, 5 levels). The full annotated script is in r-activities/HSCI_410_Lesson_6_Ordinal_and_Multinomial_Models.R.

library(nnet);  library(MASS);  library(brant)
phaa <- read.csv("phaa_survey_clean.csv", stringsAsFactors = FALSE)
phaa$region    <- relevel(factor(phaa$region), ref = "Vancouver")
phaa$education <- factor(phaa$education,
  levels = c("Less than high school", "High school", "Some college",
             "Bachelor's", "Graduate degree"),
  ordered = TRUE)

# 1. MULTINOMIAL: nominal outcome (region)
mn <- multinom(region ~ age + gender + smoker, data = phaa, trace = FALSE)
exp(coef(mn))                                           # relative-risk ratios
z <- summary(mn)$coefficients / summary(mn)$standard.errors
round((1 - pnorm(abs(z))) * 2, 3)                          # p-values

# 2. PROPORTIONAL-ODDS: ordered outcome (education)
po <- polr(education ~ age + gender + smoker, data = phaa, Hess = TRUE)
exp(cbind(OR = coef(po), confint(po)))                  # OR + 95% CI

# 3. Brant test: is the proportional-odds assumption defensible?
brant(po)

# 4. Multinomial fit of the SAME ordered outcome, the fall-back to compare
mn_edu <- multinom(education ~ age + gender + smoker, data = phaa, trace = FALSE)
AIC(po, mn_edu)                                        # lower AIC = better-fitting model

Reading the multinomial output. The relative-risk ratios from multinom() compare each region to the reference (Vancouver). For polr(), a single OR per predictor applies between every adjacent pair of education levels; that is the proportional-odds assumption that brant() tests. If the Brant overall p-value is < .05, compare AIC(po, mn_edu) and prefer the multinomial fit when its AIC is clearly lower (or fit a partial-PO model in the stretch).

R Reflect on what you just ran

Use the questions below to interpret the output you produced. Look at your console / plot before answering.

1. From exp(coef(mn)) and the matching p-value matrix, pick one non-reference region (anything but Vancouver) and one predictor (e.g., smokerYes). Report the relative-risk ratio, and state in one sentence what it says about the relative likelihood of living in that region versus Vancouver.

Model answerPicking smokerYes in the Fraser-Valley vs. Vancouver contrast as an example: the relative-risk ratio (RRR) might be around 1.45 (95% CI varies). Interpretation: smokers have a 45% higher likelihood of living in the Fraser Valley rather than Vancouver, compared with non-smokers, controlling for other covariates in the model. RRR > 1 means the predictor increases the relative likelihood of that category over the reference category.

2. From exp(cbind(OR = coef(po), confint(po))), report the OR for age and its 95% CI. Under the proportional-odds assumption, translate this OR into a sentence about being at-or-above any given education level.

Model answerThe OR for age in the proportional-odds model is typically around 1.02–1.04 (95% CI clearly excluding 1) per year of age. Interpretation under proportional odds: a one-year increase in age is associated with a 2–4% increase in the odds of being at-or-above any given education level. Because the OR is constant across cut-points (the proportional-odds assumption), this single OR summarises the age effect on each cumulative comparison, for example the odds of being “Some college or higher” vs. “HS or less,” or “Bachelor's or higher” vs. “Some college or less.”

3. Look at the brant(po) output. What is the overall p-value, and do any individual predictors flag a violation (p < .05)? Based on this, would you keep po or fall back to mn_edu (compare AICs)?

Model answerbrant() typically returns an overall p-value around 0.01–0.05; if the global is significant, some individual predictors will also show p < .05, indicating violation of the proportional-odds assumption. If violations are flagged: (a) compare AIC of po vs. mn_edu (the multinomial alternative); (b) if mn_edu has substantially lower AIC, prefer the multinomial; (c) alternatively, fit a partial proportional odds model that relaxes the assumption only for the violating predictors. The cleanest practical move when the assumption is violated and the categories are ordered is the partial proportional-odds model; its category-specific slopes let the flagged predictors act differently at each cutpoint while the outcome's ordering is preserved.
Saved.

Testing the Proportional-Odds Assumption

The proportional-odds assumption is that the effect of each predictor is the same at every cutpoint. If violated, the model may give misleading results. Several tests are available:

Testing Proportional Odds

Three main approaches exist:

  • Approximate LRT: Compare the log-likelihoods of the proportional-odds model and the multinomial model. A significant difference suggests the proportional-odds assumption is violated.
  • Wolfe-Gould approximate LRT: Based on J−1 separate binary logistic models at each cutpoint. Sum the log-likelihoods and compare to the proportional-odds model.
  • Brant (Wald) test: Provides both an overall test and individual tests for each predictor, showing which specific variables violate the assumption (Brant, 1990).
Generalised Ordinal Logistic Regression

If the proportional-odds assumption is violated, a generalised ordinal logistic regression model allows separate coefficients at each cutpoint. This model is equivalent to fitting J−1 separate binary logistic regressions simultaneously. It is more flexible but less parsimonious than the proportional-odds model (Williams, 2006).

Partial Proportional-Odds Model

A compromise approach is the partial proportional-odds model, which relaxes the proportional-odds assumption for selected predictors only (those that fail the Brant test) while maintaining it for the rest (Peterson & Harrell, 1990; Williams, 2006). This provides a good balance between flexibility and parsimony. Other alternatives include the stereotype logistic model and the heterogeneous choice logistic model.

⚠ The Proportional-Odds Assumption in Practice

The proportional-odds assumption is often violated in practice, especially with many predictors or when the outcome categories represent very different phenomena. Always test this assumption before reporting results from a proportional-odds model (Brant, 1990). If violated, consider a partial proportional-odds model or generalised ordinal logistic regression (Peterson & Harrell, 1990; Williams, 2006).

Brant Test Results Example

The Brant test provides both an overall test and predictor-specific tests. Here is an example of how results might be presented:

Predictorχ²dfP-valueAssumption Holds?
Prenatal visits2.1420.343Yes
Maternal age8.9220.012No
Parity1.0320.598Yes
Overall12.4560.053Borderline

In this example, only maternal age violates the assumption. A partial proportional-odds model that allows maternal age to have different effects at each cutpoint (while constraining prenatal visits and parity) would be appropriate.

Regression Diagnostics

Regression diagnostics for the proportional-odds model can be conducted by fitting binary logistic models at each cutpoint and applying the diagnostic techniques from Chapter 16 (residual analysis, influence measures, goodness-of-fit tests).

Knowledge check: this section

1. The proportional-odds model assumes:

The proportional-odds (or parallel lines) assumption states that the coefficients for each predictor are the same regardless of which cutpoint is used to dichotomise the outcome. This means the OR is the same at every cutpoint.

2. If the proportional-odds assumption is violated for some but not all predictors, which model can be used?

The partial proportional-odds model relaxes the proportional-odds assumption for specific predictors (those that violate it) while maintaining the constraint for the rest. This provides a balance between the fully constrained proportional-odds model and the unconstrained multinomial model.

3. The latent variable in a proportional-odds model represents:

The proportional-odds model assumes an underlying continuous latent variable (Si) that is divided into the observed ordinal categories by cutpoints (τ). The latent variable represents the true continuous quantity that we observe only in categorised form.

✎ Reflection

Why do you think the proportional-odds assumption is so often violated in practice? Can you think of a scenario in your own research where you would expect the effect of a predictor to differ across cutpoints?

Model answerThe proportional-odds assumption requires that the effect of every predictor is the same across all cut-points of the ordinal outcome, a strong assumption rarely true in practice. It is often violated because: (a) floor/ceiling effects: predictors may have stronger effects at extreme categories than middle ones; (b) non-linearity in the latent variable: if the underlying construct varies non-linearly, the cut-point ORs differ; (c) category-specific mechanisms: the cause of moving from severe to moderate is different from the cause of moving from mild to none. Example: income's effect on educational attainment may be very strong at high levels (deciding between PhD vs. Master's) and weak at low levels (deciding between any-HS vs. dropout, where structural barriers dominate). Pre-specify Brant tests and have a fallback model (partial proportional odds, generalised ordinal, or multinomial) in the protocol.
✓ Reflection saved!
Complete the quiz and reflection to continue.
Section 4 of 9

Adjacent-Category & Continuation-Ratio Models

⏱ Estimated time: 20 minutes
Section 4 of 4

Adjacent-Category & Continuation-Ratio Models

Two alternatives for when proportional odds does not hold or the ordering is sequential.

Adjacent-category model

Comparing each level to its immediate neighbour

Adjacent-category logit (Eq 17.3)
\[ \ln\frac{\color{#0B7B6B}{P(Y=j)}}{\color{#C2410C}{P(Y=j-1)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1} X \]
P(Y=j) category j P(Y=j−1) category just below β₀ᵃ category intercept β₁ common slope

The coefficient for categories n levels apart equals n times the coefficient for adjacent categories. This constraint is tested by a likelihood-ratio test against the unconstrained multinomial.

Apgar data result

Likelihood-ratio test: χ² = 6.76, df = 5, P = 0.239. The adjacent-category model is a valid simplification of the multinomial for these data.

Continuation-ratio model

For sequential-stage outcomes

Continuation-ratio logit (Eq 17.4)
\[ \ln\frac{\color{#0B7B6B}{P(Y=j)}}{\color{#C2410C}{P(Y < j)}} = \color{#6D28D9}{\beta_0^{(j)}} + \color{#1D4ED8}{\beta_1} X \]
P(Y=j) reaching stage j P(Y<j) stopping earlier β₀ᵃ stage intercept β₁ common slope

Appropriate for

Outcomes where each level is a stage that must be reached before the next: disease progression, exam attempts, career stages.

Not appropriate for

Cross-sectional ordinal outcomes like Apgar scores, where categories are observed simultaneously, not passed through.

Fitting the model

Three binary regressions on recoded data

OriginalY₁ (1 vs 0)Y₂ (2 vs 0–1)Y₃ (3 vs 0–2)
0 (stage 0)000
1 (stage 1)100
2 (stage 2)10
3 (stage 3)1

Each regression excludes higher-stage observations. A constrained version imposing equal odds ratios can be compared to the unconstrained version via likelihood-ratio test.

Decision guide

Choosing among the four models

Multi-category outcome Nominal Ordinal Multinomial logit Sequential stages? Yes No Continuation-ratio Proportional odds (test!) Fails Adjacent-cat. or partial PO
Lesson recap

The logit formulation defines the coefficient

Adjacent-category

Single OR for moving one ordinal step. Valid when the unconstrained multinomial is not significantly better.

Continuation-ratio

Stage-specific ORs for advancing past each hurdle. Best for sequential processes; fit as binary logits on recoded data.

The reflection and knowledge check are just below. Spend time on the model-selection scenarios; that is where these distinctions become concrete.

Introduction and Overview

The proportional-odds model is the workhorse for ordered outcomes, but its proportional-odds assumption is genuinely restrictive and frequently fails in real data. This section closes the lesson with two alternatives that relax that assumption in different ways: the adjacent-category model and the continuation-ratio model. Each is appropriate for a different kind of ordering and a different research question.

Learning Objectives

  • Specify the adjacent-category model and test its constraint against an unconstrained multinomial fit.
  • Specify the continuation-ratio model and recognise the sequential-stage outcomes it suits.
  • Fit a continuation-ratio model as a series of binary logistic regressions on recoded data.
  • Choose between proportional-odds, adjacent-category, and continuation-ratio models based on the question and the data.

Adjacent-Category Model

The adjacent-category model compares the probability of being in category j versus category j−1 (the next lower category). It is a constrained version of the multinomial logistic model: the constraint is that the coefficient for categories n levels apart equals n times the coefficient for adjacent categories.

Like the proportional-odds model, the adjacent-category model estimates a single β1 per predictor, making it more parsimonious than the unconstrained multinomial model. The validity of this constraint can be tested by comparing the adjacent-category model to the unconstrained multinomial model using a likelihood-ratio test (LRT) (Ananth & Kleinbaum, 1997).

📋 Example: Apgar scores, adjacent-category model

For the Apgar score data, the LRT comparing the adjacent-category model to the unconstrained multinomial model yielded χ² = 6.76, df = 5, P = 0.239. Since this is not significant, the adjacent-category model is a valid simplification of the multinomial model for these data.

Continuation-Ratio Model

The continuation-ratio model compares the probability of being in category j versus all lower categories combined. It is particularly useful when the outcome represents sequential stages that must be “passed through” to reach higher levels (Ananth & Kleinbaum, 1997).

When Is the Continuation-Ratio Model Appropriate?

The continuation-ratio model is ideal for outcomes where each level must be reached before the next can be attained. Examples include: number of attempts to pass an exam, stages of disease progression where remission must occur before relapse, or sequential rounds of a selection process. It is NOT appropriate when movements between categories are not sequential (e.g., Apgar scores, where a baby does not “pass through” each score level).

Fitting the Continuation-Ratio Model

The continuation-ratio model can be fit as a series of separate binary logistic regressions with a recoded outcome variable. For each comparison:

  • Y = 1 for the level of interest
  • Y = 0 for all lower levels
  • Observations at higher levels are excluded (treated as missing)

Consider an example with 4 categories representing the number of attempts to gain admission to medical school (1, 2, 3, 4+):

Original CategoryY1 (1 vs 0)Y2 (2 vs 0–1)Y3 (3 vs 0–2)
0 (1 attempt)000
1 (2 attempts)100
2 (3 attempts)10
3 (4+ attempts)1

You can fit either a constrained version (equal ORs across levels, tested by LRT) or an unconstrained version (separate ORs at each level). The constrained version is more parsimonious and can be compared to the unconstrained version using a likelihood-ratio test.

Adjacent-Category ModelClick to explore
Continuation-Ratio ModelClick to explore
Choosing Between ModelsClick to explore
When to Use the Adjacent-Category Model

The adjacent-category model is appropriate when the comparison of interest is between neighbouring categories of an ordinal outcome. It is a natural choice when you believe the effect of a predictor operates by shifting individuals one category at a time. The model can be validated by comparing it to the unconstrained multinomial model via LRT.

When to Use the Continuation-Ratio Model

The continuation-ratio model is most appropriate when the outcome represents sequential stages that must be passed through in order. Each category must be reached before the next can be attained. Examples include: successive attempts at an exam, sequential rounds of treatment, or stages of career advancement. If categories can be reached without passing through lower levels, this model is not appropriate.

Comparing Models with LRT

When one model is a constrained (nested) version of another, the likelihood-ratio test can be used to compare them. The test statistic is −2(lnLconstrained − lnLunconstrained), which follows a χ² distribution with degrees of freedom equal to the difference in the number of parameters. A significant result suggests the constraint is not valid and the more complex model is needed.

Decision Guide: Choosing Among the Four Models

Step 1: Is the outcome nominal or ordinal? If nominal, use multinomial logistic regression.
Step 2: If ordinal, does the outcome represent sequential stages? If yes, consider the continuation-ratio model.
Step 3: If not sequential, fit the proportional-odds model and test the assumption. If it holds, use proportional-odds.
Step 4: If the proportional-odds assumption fails, consider the adjacent-category model, partial proportional-odds, or generalised ordinal logistic regression.
Step 5: Compare nested models using LRT to select the most parsimonious adequate model.

Knowledge check: this section

1. In the adjacent-category model, the coefficient for categories n levels apart is:

The adjacent-category model is a constrained multinomial model. The key constraint is that the log-odds (coefficient) for categories n levels apart equals n times the log-odds for adjacent categories. This is what makes it more parsimonious than the unconstrained multinomial model.

2. The continuation-ratio model is most appropriate when:

The continuation-ratio model is designed for outcomes where each category represents a stage that must be reached before moving to the next. Each comparison asks: given that you reached at least this level, what are the odds of reaching the next level? This is inappropriate when categories can be reached without passing through lower levels.

3. If an LRT comparing the adjacent-category model to the multinomial model is NOT significant, this suggests:

A non-significant LRT means the constrained (adjacent-category) model does not fit significantly worse than the unconstrained (multinomial) model. Therefore, the simpler adjacent-category model is a valid simplification and should be preferred on grounds of parsimony.

✎ Reflection

Can you think of an example from public health or epidemiology where a continuation-ratio model would be more appropriate than a proportional-odds model? What makes the outcome sequential in your example?

Model answerExample: TB disease progression, from latent infection → primary TB → chronic TB → death. Each stage is a hurdle: you cannot get to stage 3 without progressing through stages 1 and 2. A continuation-ratio model estimates the probability of progressing past each stage conditional on having reached it; predictors can have different effects on each transition (e.g., HIV co-infection might strongly increase risk of progression from latent to active disease but have less effect on progression from active to chronic). The proportional-odds model wouldn't capture this because it assumes a single underlying latent severity with uniform predictor effects across cut-points; the continuation-ratio model explicitly models the sequential hurdle structure. Other examples: cancer staging (in-situ → local → regional → distant), pregnancy outcomes (no pregnancy → early loss → mid-trimester loss → preterm birth → term).
✓ Reflection saved!
Complete the quiz and reflection to continue.
Section 5 of 9

Introduction & The Poisson Distribution

⏱ Estimated time: 15 minutes
Lesson 7

Modelling Count and Rate Data

From the Poisson distribution to rate ratios, overdispersion, and zero-adjusted models.

Why counts need their own model

A different kind of outcome

Counts are discrete, bounded at zero, and right-skewed at low means. They violate the assumptions of linear regression in ways that matter for inference.

Linear regression

Assumes a continuous, normally distributed outcome with constant variance. Produces impossible negative predictions for counts.

Poisson regression

Designed for non-negative integer outcomes. Variance grows with the mean, and predictions are always positive through the log link.

Section 1 of 4

Introduction & The Poisson Distribution

Four data types, the probability function, and the mean-equals-variance property.

Four data types

What kind of count data do you have?

Simple counts

Raw event totals. No denominator. Appropriate only when observation time is uniform across all units.

Person-time rates

Count divided by accumulated follow-up. Essential when subjects have varying observation periods.

Population rates

Count per mid-year population size. Used in vital statistics and registry data.

Area-based counts

Aggregated events per geographic unit. Common in spatial epidemiology and ecological studies.

The probability function

The Poisson distribution

Poisson probability mass function (Eq 18.1)
\[ \color{#0B7B6B}{P(Y = y)} = \frac{\color{#C2410C}{\mu}^{\,\color{#6D28D9}{y}} \, \color{#1D4ED8}{e^{-\mu}}}{\color{#BE185D}{y!}}, \quad y = 0, 1, 2, \ldots \]
P(Y=y) probability of y events μ mean count y number of events e−μ decay term y! normaliser

\(\mu\) is both the expected count and the only parameter. \(e\) is Euler's number. The factorial \(y!\) normalises the distribution over all non-negative integers.

Events must be independent, occur at a constant rate, and be non-simultaneous. Under those conditions, Poisson probabilities arise naturally from random point processes.

The defining property

Mean equals variance: \(E(Y) = \text{Var}(Y) = \mu\)

Single-parameter property
\[ \color{#0B7B6B}{E(Y)} = \color{#C2410C}{\text{Var}(Y)} = \color{#6D28D9}{\mu} \]
E(Y) expected count Var(Y) variance μ the single parameter
Variance tracks the mean in Poisson data Mean (mu) Variance Var = Mean

Real count data with excess variability fall above this line. That departure is the definition of overdispersion.

When is Poisson appropriate?

Four conditions and the shape of the distribution

Four conditions:

  • Events are independent
  • Rate is constant over the interval
  • No two events at the same instant
  • Probability proportional to interval length
Shape: small vs. large mu mu = 1 (skewed) mu = 10 (symmetric)
Carry forward

What to take into the next section

  • Four data types: simple counts, person-time rates, population rates, and area-based counts. The denominator choice drives the modelling strategy.
  • Poisson probability function: one parameter, \(\mu\), governs both mean and variance.
  • Mean equals variance: the assumption that a later section will test and a later section will relax.

Introduction and Overview

Earlier lessons covered regression for continuous, binary, and ordered/multi-category outcomes. This lesson takes on the next major outcome type: counts. Number of disease cases, hospital admissions, parasites, or events per unit time are all counts, and they need their own GLM family (Nelder & Wedderburn, 1972). The four content sections walk through this in order: the Poisson distribution and why it's the natural starting point (this section), Poisson regression with the offset term that lets us model rates as well as counts (a later section), residuals and the most consequential complication, overdispersion (a later section), and finally negative binomial and zero-adjusted models when standard Poisson breaks down (a later section). The offset term is the key conceptual bridge to the rate-based cohort designs you met in earlier courses and lessons.

Learning Objectives

  • Distinguish simple counts, person-time rates, population rates, and area-based counts in epidemiological data.
  • State the assumptions of the Poisson distribution, including the variance-equals-mean property.
  • Compute Poisson probabilities and recognise the shape of the distribution at small versus large means.
  • Identify when count data are likely to violate Poisson assumptions and why it matters.

Why Model Count and Rate Data?

Many outcomes in epidemiology are measured as counts, such as the number of disease cases in a region, the number of doctor visits per year, or the number of parasites on a host animal. These outcomes differ fundamentally from continuous outcomes (modelled with linear regression) and binary outcomes (modelled with logistic regression). Count data require their own family of statistical models because they are discrete, non-negative, and often right-skewed (Coxe, West, & Aiken, 2009).

Chapter 18 introduces the statistical tools for modelling count and rate data, beginning with the Poisson distribution and Poisson regression, and extending to negative binomial and zero-adjusted models for situations where the basic Poisson assumptions are violated.

Types of Count and Rate Data

Before selecting an analytical approach, it is essential to understand which type of count or rate data you are working with. There are four main types encountered in epidemiological research:

Simple CountsClick to explore
Rates (Person-Time)Click to explore
Population RatesClick to explore
Area-Based CountsClick to explore

The Poisson Distribution

The Poisson distribution is the foundational probability distribution for modelling count data. It describes the probability of observing a given number of events in a fixed interval of time or space, assuming events occur independently at a constant average rate. It is the foundational distribution for the Poisson model.

▸ INTERACTIVE STORY: POISSON RAIN Open full screen ↗

From raindrops to per-minute counts to the Poisson PMF. Next ▶ advances scenes.

A 6-scene visualization of count and rate data: random events at constant rate λ, per-minute counting, the histogram filling, the Poisson PMF emerging, and the bridge to rates and rate ratios.

Poisson probability function (Eq 18.1)
\[ \color{#0B7B6B}{P(Y=y)} = \frac{\color{#C2410C}{\mu}^{\,\color{#6D28D9}{y}}\, \color{#1D4ED8}{e^{-\mu}}}{\color{#BE185D}{y!}} \]
The probability of exactly y events equals the mean count raised to the number of events, times e to the minus mean, divided by y factorial (the normalising term).

In this formula, Y is the count of events, μ (mu) is both the mean and the expected number of events, and e is the base of the natural logarithm (≈ 2.718). The factorial in the denominator (y!) ensures the probabilities are correctly normalised. The Poisson distribution is defined for non-negative integers: y = 0, 1, 2, 3, …

Key Property: Mean = Variance

The defining property of the Poisson distribution is that the mean equals the variance: E(Y) = Var(Y) = μ (Coxe et al., 2009). This single-parameter property means that as the expected count increases, so does the variability. This assumption is central to Poisson regression, and when it is violated (variance > mean), we have overdispersion, which requires alternative approaches covered in later sections.

The Poisson distribution is particularly useful for modelling rare events in large populations. When the probability of an event is small and the number of trials (or opportunities) is large, the Poisson distribution provides an excellent approximation. Examples include the number of rare disease cases in a large population, or the number of equipment failures over an extended operating period.

Four Poisson probability mass functions for means of 1, 3, 8, and 15. At a mean of 1 the distribution is strongly right-skewed with most mass near zero; as the mean grows to 15 the distribution becomes nearly symmetric and bell-shaped.
As the mean μ increases, the Poisson distribution moves from right-skewed (small μ) toward a near-symmetric shape (large μ). The spread widens with the mean, since the variance equals μ.
When is the Poisson distribution appropriate?

The Poisson distribution is appropriate when: (1) events are independent of one another; (2) the rate at which events occur is constant over the observation period; (3) two events cannot occur at exactly the same instant; and (4) the probability of an event in a short interval is proportional to the length of the interval. In practice, these assumptions are often approximately met in epidemiological settings.

Shape of the Poisson distribution

When μ is small (e.g., μ < 3), the distribution is noticeably right-skewed, with most observations clustering near zero and a long right tail. As μ increases, the distribution becomes more symmetric and begins to resemble a normal distribution. By the time μ ≥ 20, a normal approximation with mean μ and variance μ is often adequate.

Knowledge check: this section

1. Which type of count data uses person-time in the denominator?

Rates use accumulated person-time at risk as the denominator. This is essential when subjects have varying amounts of follow-up time in a study.

2. What is the key property of the Poisson distribution?

The Poisson distribution has the property that E(Y) = Var(Y) = μ. This single-parameter property is central to Poisson-based models.

3. The Poisson distribution is most appropriate for modelling:

The Poisson distribution models counts, particularly when events are rare relative to the population at risk. It is defined for non-negative integers and is well-suited for rare event data.

Reflection

How might the type of count data (simple counts vs. rates) influence your choice of analytical approach in an epidemiological study you're familiar with?

Model answerSimple counts assume each unit of observation contributed the same exposure time, appropriate when follow-up is uniform (e.g., hospital admissions per week in a closed cohort). Rates explicitly divide counts by person-time, allowing comparisons across units with different exposure times, essential when follow-up is variable (cohort with censoring, repeat measurements, recurrent events). Example: simple Poisson works for daily emergency-department visit counts; rate-based Poisson (with offset(log(person_years))) is required for a chronic-disease registry where each patient contributes different person-time. Confusing the two leads to substantial bias: treating rate data as counts ignores the denominator, while treating count data as rates over-corrects for non-existent variation in exposure time.
Reflection saved!
* Complete the quiz and reflection to continue.
Section 6 of 9

Poisson Regression Model & Interpretation

⏱ Estimated time: 20 minutes
Section 2 of 4

Poisson Regression Model & Interpretation

Log-linear model, the offset for person-time, and rate ratios.

The starting point

Expected count = person-time times rate

Expected count (Eq 18.2)
\[ \color{#0B7B6B}{E(Y)} = \color{#C2410C}{n} \, \color{#6D28D9}{\lambda} \]
E(Y) expected count n person-time at risk λ event rate

Here \(n\) is the accumulated person-time at risk and \(\lambda\) is the underlying event rate. Subjects with longer follow-up have larger expected counts purely because of time, independent of any predictor.

The goal of the model is to let \(\lambda\) vary with covariates while keeping \(n\) as an accounting term, not an estimated coefficient.

The log-linear model

Poisson regression with an offset

Poisson regression model (Eq 18.3)
\[ \color{#0B7B6B}{\ln\bigl(E(Y)\bigr)} = \underbrace{\color{#C2410C}{\ln(n)}}_{\text{offset}} + \color{#6D28D9}{\beta_0} + \color{#1D4ED8}{\beta_1 X_1 + \beta_2 X_2 + \cdots} \]
ln E(Y) log expected count ln(n) offset (log person-time) β0 intercept βkXk predictor terms

Without offset

Predicts expected count. All observations assumed to have equal exposure time.

With offset \(\ln(n)\)

Predicts expected rate \(E(Y)/n\). Coefficient fixed at 1; uses no degrees of freedom.

What the offset does

From count to rate: algebraic equivalence

Rate model (equivalent form)
\[ \ln\!\left(\frac{\color{#0B7B6B}{E(Y)}}{\color{#C2410C}{n}}\right) = \color{#6D28D9}{\beta_0} + \color{#1D4ED8}{\beta_1 X_1 + \beta_2 X_2 + \cdots} \]
E(Y) expected count n person-time β0 intercept βkXk predictors
Count model ln E(Y) = offset + bX Rate model ln(E(Y)/n) = bX Rate ratios exp(b) = IRR
Interpretation

Exponentiated coefficients as incidence rate ratios

Incidence Rate Ratio
\[ \text{IRR} = e^{\beta_1} \]

IRR > 1

Higher rate in the exposed group. \(e^{0.30} = 1.35\) means a 35% rate increase per unit.

IRR = 1

No difference in rate between groups.

IRR < 1

Lower rate in the exposed group. \(e^{-0.22} = 0.80\) means a 20% rate reduction.

Worked example

Mastitis in dairy herds

Example: herd size coefficient
\[ \hat{\beta}_{\text{herd size}} = 0.012 \implies \text{IRR} = e^{0.012} = 1.012 \]

For 100 additional cows:

\[ \text{IRR}_{+100} = e^{0.012 \times 100} = e^{1.2} \approx 3.32 \]

A herd with 100 more cows has a 3.32-fold higher mastitis rate than the baseline herd on the rate-per-cow-year scale.

Carry forward

What to take into the next section

  • Log-linear model: multiplicative effects on the rate scale, estimated on the log scale.
  • Offset: \(\ln(n)\) with coefficient fixed at 1. Converts count model to rate model.
  • IRR: \(e^\beta\) is the ratio of rates between groups differing by one unit of the predictor.

Introduction and Overview

An earlier section introduced the Poisson distribution as the probability model behind count data. This section turns the distribution into a regression. The log-linear formulation (Nelder & Wedderburn, 1972) lets us link counts to predictors on a multiplicative scale, and the offset term is the trick that converts a count model into a rate model, precisely what you need to handle person-time denominators from the rate-based cohort designs you saw in earlier courses and lessons.

Learning Objectives

  • Write down a Poisson regression model with a log link and identify its linear predictor.
  • Use an offset term to convert a count model into a rate model with person-time denominators.
  • Interpret exponentiated Poisson coefficients as multiplicative rate ratios.
  • Translate a fitted Poisson regression into incidence rates and predicted counts for new covariate values.

The Expected Count

The starting point for Poisson regression is the relationship between the expected number of events and the underlying rate. If an individual (or group) is observed for n units of person-time and the event rate is λ (lambda), the expected count is:

Expected count (Eq 18.2)
\[ \color{#0B7B6B}{E(Y)} = \color{#C2410C}{n}\,\color{#6D28D9}{\lambda} \]
The expected number of events equals the person-time at risk multiplied by the underlying event rate.

Here, n represents the person-time at risk (e.g., person-years of follow-up) and λ is the incidence rate. The expected count is simply the product of the time at risk and the rate at which events occur. Different subjects may contribute different amounts of person-time, which must be accounted for in the model.

The Log-Linear Model

Poisson regression uses a log link function to relate the expected count to a linear combination of predictors. Taking the natural logarithm of both sides of the expected count equation and incorporating predictors gives us the Poisson regression model:

Poisson regression model (Eq 18.3)
\[ \color{#0B7B6B}{\ln\!\big(E(Y)\big)} = \color{#C2410C}{\ln(n)} + \color{#6D28D9}{\beta_0} + \color{#1D4ED8}{\beta_1 X_1 + \beta_2 X_2 + \cdots} \]
The log of the expected count equals the offset (log person-time) plus the intercept plus the predictor terms.

The term ln(n) is the offset, a fixed term in the model that is included, rather than estimated, to account for the fact that different observations may have different amounts of exposure (person-time). The β coefficients describe how the log of the expected count (or rate) changes with the predictors. Fixing that coefficient at exactly 1 encodes a simple idea: a subject followed for twice as long is expected to accumulate about twice as many events, so the offset simply carries the denominator of the rate rather than being a quantity the data must estimate.

The Offset Term

The offset is one of the most important concepts in Poisson regression. It transforms the model from one that predicts counts to one that effectively predicts rates (Coxe et al., 2009).

Modelling Counts (Without Offset)

When no offset is included, the model predicts the expected count directly:

ln(E(Y)) = β0 + β1X1 + …

This is appropriate when all observations have the same amount of exposure or follow-up time. For instance, if all herds are observed for exactly one year, the count of disease cases directly reflects the rate. In practice, this situation is relatively uncommon, since most epidemiological studies have subjects with varying follow-up times.

Modelling Rates (With Offset)

When the offset ln(n) is included, the model effectively predicts the rate rather than the raw count:

ln(E(Y)) = ln(n) + β0 + β1X1 + …

This is equivalent to modelling ln(E(Y)/n) = β0 + β1X1 + …, where E(Y)/n is the expected rate. The offset accounts for the fact that subjects with longer follow-up times are expected to accumulate more events simply by virtue of being observed longer. This is the standard approach when follow-up times vary across subjects.

Interpreting Poisson Regression Coefficients

In Poisson regression, the exponentiated coefficient eβ is interpreted as an incidence rate ratio (IRR), consistent with the wider generalised linear model framework. This is analogous to the odds ratio in logistic regression but applies to rates rather than odds.

Incidence Rate Ratio (IRR)

For a one-unit increase in the predictor X1, the incidence rate is multiplied by eβ1. If β1 = 0.30, then IRR = e0.30 = 1.35, meaning the rate increases by 35% for each one-unit increase in X1. An IRR > 1 indicates an increased rate; an IRR < 1 indicates a decreased rate; and an IRR = 1 indicates no association.

Epidemiological Example: Mastitis in Dairy Herds

Suppose we model the number of mastitis cases per herd over one year, with herd size as a predictor and cow-years at risk as the offset. The Poisson regression yields βherd size = 0.012.

Interpretation: e0.012 = 1.012, so for each additional cow in the herd, the incidence rate of mastitis increases by 1.2%. A herd with 100 more cows would have an expected rate ratio of e0.012×100 = e1.2 = 3.32 compared to the baseline, a 3.32-fold higher mastitis rate. Notice that the scaling is done on the coefficient scale first: multiply the coefficient by 100, then exponentiate. Multiplying the rate ratio itself by 100 (1.012 times 100) would be wrong, because rate ratios compound by multiplication rather than adding up.

R Activity: Poisson with an offset and a negative-binomial fall-back

The companion dataset phaa_followup.csv records how many GP visits each participant had during their follow-up. Because follow-up time varies, we need an offset of log(fu_years) to turn the count into a rate. The full annotated script is in r-activities/HSCI_410_Lesson_7_Count_and_Rate_Data.R.

library(MASS);  library(AER)
phaa <- read.csv("phaa_followup.csv", stringsAsFactors = FALSE)
phaa$smoker <- factor(phaa$smoker, levels = c("No","Yes"))

# 1. A peek at the count outcome
summary(phaa$gp_visits)
hist(phaa$gp_visits, breaks = 30,
     main = "GP visits during follow-up", xlab = "Visits")

# 2. Poisson regression with offset to model the RATE per person-year
fit_rate <- glm(gp_visits ~ age + smoker + hypertension
                            + offset(log(fu_years)),
                family = poisson, data = phaa)
summary(fit_rate)
exp(coef(fit_rate))                              # incidence-rate ratios
exp(confint(fit_rate))

# 3. Goodness of fit: Pearson chi^2 / df ~ 1 = good
sum(residuals(fit_rate, type = "pearson")^2) / fit_rate$df.residual

# 4. Formal overdispersion test
dispersiontest(fit_rate)

# 5. Negative binomial fall-back when Poisson is overdispersed
fit_nb <- glm.nb(gp_visits ~ age + smoker + hypertension
                              + offset(log(fu_years)), data = phaa)
AIC(fit_rate, fit_nb)
cbind(Poisson = exp(coef(fit_rate)),
      NegBin  = exp(coef(fit_nb)))

Why the offset isn't a predictor. Because its coefficient is fixed at 1, offset(log(fu_years)) shifts the intercept onto the rate scale without using a degree of freedom. The IRR for smokerYes tells you the multiplicative effect of smoking on the visit rate, holding age and hypertension constant. If dispersiontest() is significant, prefer glm.nb(); CIs widen but the point estimates are usually similar.

R Reflect on what you just ran

Use the questions below to interpret the output you produced. Look at your console / plot before answering.

1. From exp(coef(fit_rate)) and exp(confint(fit_rate)), report the IRR (and 95% CI) for smokerYes. Translate it into one sentence: how does the rate of GP visits per person-year differ between smokers and non-smokers?

Model answerexp(coef(fit_rate)) typically returns an IRR for smokerYes of about 1.40, 95% CI roughly (1.25, 1.55). Interpretation: smokers have an incidence rate of GP visits per person-year about 40% higher than non-smokers, holding other covariates constant. The CI excludes 1, so the effect is statistically significant.

2. Compute sum(residuals(fit_rate, type = "pearson")^2) / fit_rate$df.residual. Is it close to 1, or much larger? Also report the p-value from dispersiontest(fit_rate). What do those two pieces of evidence say about overdispersion?

Model answersum(residuals(fit_rate, type="pearson")^2) / fit_rate$df.residual typically returns a value around 1.4–2.0, meaningfully larger than 1, suggesting overdispersion. dispersiontest(fit_rate) gives a small p-value (typically < 0.01), confirming statistically significant overdispersion. Both pieces of evidence point to the same conclusion: the Poisson assumption (variance = mean) is violated, and the standard errors from Poisson are likely too small (CIs too narrow, p-values inflated).

3. From AIC(fit_rate, fit_nb) and the side-by-side IRR comparison, which model do you prefer? Are the point estimates similar between Poisson and NegBin? What typically changes when you switch (point estimates, CIs, or both)?

Model answerAIC(fit_rate, fit_nb) typically shows AIC much lower for the negative binomial model (often hundreds of points lower), strongly favouring NegBin. The point estimates for IRRs are very similar between Poisson and NegBin, which is expected because both are estimating the conditional mean structure. What changes are the standard errors: NegBin SEs are larger (because they account for the extra variance from the over-dispersion parameter), so the CIs widen and p-values become less extreme. The lesson: overdispersion doesn't bias the point estimates much, but mis-specifying it gives over-confident inference.
Saved.

Poisson Regression for Relative Risk Estimation

An important application of Poisson regression is estimating relative risks (RR) directly from binary outcome data. When the outcome is rare, the Poisson model can provide estimates of the RR that are more interpretable than the odds ratios from logistic regression. This approach typically uses robust (sandwich) standard errors to account for the fact that binary data do not truly follow a Poisson distribution.

Knowledge check: this section

1. What is the purpose of the offset term in Poisson regression?

The offset (log of person-time) accounts for the fact that subjects may have different amounts of follow-up or exposure time. It transforms the model from predicting counts to effectively predicting rates.

2. The exponentiated Poisson regression coefficient (eβ) is interpreted as:

eβ from Poisson regression represents the incidence rate ratio, the multiplicative change in the rate for a one-unit change in the predictor.

3. Using Poisson regression to estimate relative risks from binary data is appropriate when:

When the outcome is rare, the Poisson model can be used to estimate relative risks directly, which are more interpretable than odds ratios from logistic regression.

Reflection

Consider a study where participants have very different follow-up times. How would using an offset term change your interpretation compared to simply modelling raw counts?

Model answerThe offset term offset(log(person_years)) in a Poisson model fixes the coefficient on log(person-years) at exactly 1, effectively modelling the rate (events per person-year) rather than the raw count. Without an offset, the model would estimate a coefficient on log(person-years) that absorbs the relationship between exposure time and outcome, leaving it biased and not interpretable. With the offset, the IRRs read as multipliers on the rate (smokers have 1.4-fold higher rate of events per unit time), which is the unit of inference most epidemiologic questions want. Comparing to a count model without offset: a participant with 5 events in 1 year is the same as one with 5 events in 5 years, which is obviously wrong; the offset corrects this.
Reflection saved!
* Complete the quiz and reflection to continue.
Section 7 of 9

Evaluating Poisson Models & Overdispersion

⏱ Estimated time: 20 minutes
Section 3 of 4

Evaluating Poisson Models & Overdispersion

Residuals, goodness-of-fit, and the most common Poisson failure mode.

Residual types

Three kinds of Poisson residuals

Pearson residual (Eq 18.6)
\[ \color{#0B7B6B}{r_{P,i}} = \frac{\color{#C2410C}{y_i} - \color{#6D28D9}{\hat{\mu}_i}}{\color{#1D4ED8}{\sqrt{\hat{\mu}_i}}} \]
rP,i Pearson residual yi observed count μ̂i fitted mean √μ̂i Poisson SD

Deviance residuals

Signed contribution of each observation to the total model deviance. More normally distributed; preferred for quantile-quantile plots.

Anscombe residuals

Cube-root transformation for near-normality. Complementary to Pearson and deviance residuals in a thorough diagnostic review.

Goodness of fit

The dispersion parameter

Estimated dispersion
\[ \color{#0B7B6B}{\hat{\phi}} = \frac{\color{#C2410C}{\sum r_{P,i}^{2}}}{\color{#6D28D9}{n - p}} \]
φ̂ dispersion estimate ΣrP,i2 sum of squared residuals n − p residual df

\(\hat{\phi} \approx 1\)

Poisson fits well. Variance matches the mean as assumed.

\(\hat{\phi} \gg 1\)

Overdispersion. Observed variance exceeds Poisson prediction. Standard errors are too narrow.

\(\hat{\phi} < 1\)

Underdispersion. Less common. Can indicate a model that predicts too much variation.

A critical distinction

Apparent versus real overdispersion

Apparent overdispersion

Source: model misspecification. Outliers, missing predictors, wrong functional form. Fix by correcting the model first, then re-check the dispersion statistic.

Real overdispersion

Source: genuine unobserved heterogeneity. Clustering within groups, biological variability, unmeasurable confounders. Requires a different distributional assumption.

Always investigate apparent causes before reaching for a distributional fix.

Responses to overdispersion

Four approaches

Scale SEs by \(\sqrt{\hat{\phi}}\)

Quick correction (quasi-Poisson). Coefficients unchanged; standard errors widened. Appropriate for mild to moderate overdispersion.

Negative binomial

Adds an explicit dispersion parameter \(\alpha\). Standard errors are correct by design. Section 4 covers this fully.

GLMM / random effects

Models unobserved heterogeneity through subject-level or group-level random intercepts. Best for clustered designs.

GEE (robust SEs)

Uses sandwich variance estimators. Population-averaged interpretation; appropriate when within-cluster correlation is a nuisance rather than a target.

Carry forward

What to take into the next section

  • Dispersion statistic: \(\hat{\phi} = \sum r_{P}^2 / (n-p)\). Target is 1.
  • Apparent vs. real: check model specification before choosing a distributional fix.
  • If real: negative binomial regression is the standard first response, and it is where a later section begins.

Introduction and Overview

An earlier section fit the Poisson model. This section turns to evaluating it. Poisson regression makes a strong assumption, that the variance equals the mean, which real count data frequently violate (Ver Hoef & Boveng, 2007). Overdispersion is the most common diagnosis you'll make on a count model, and addressing it is what a later section will be about. First, though, you need the residuals and goodness-of-fit tools to detect it.

Learning Objectives

  • Compute and interpret Pearson, deviance, and Anscombe residuals from a Poisson model.
  • Apply the deviance and Pearson chi-squared statistics as overall goodness-of-fit tests.
  • Define overdispersion in terms of the variance-to-mean ratio and explain why it inflates Type I error.
  • Choose between quasi-Poisson, scale-corrected, and negative binomial responses to overdispersion.

Residuals for Poisson Models

Just as in linear regression, residuals are the primary tool for evaluating how well a Poisson model fits the observed data. However, because the variance of a Poisson variable depends on its mean, raw residuals (observed − expected) are not directly comparable across observations. Several types of standardised residuals have been developed:

Pearson Residuals

Pearson residuals standardise the raw residual by dividing by the square root of the expected value:

Pearson residual (Eq 18.6)
\[ \color{#0B7B6B}{r_P} = \frac{\color{#C2410C}{y} - \color{#6D28D9}{\hat{\mu}}}{\color{#1D4ED8}{\sqrt{\hat{\mu}}}} \]
The Pearson residual is the observed count minus the fitted mean, divided by the square root of that fitted mean (the Poisson standard deviation).

This accounts for the Poisson assumption that Var(Y) = μ. If the model fits well, Pearson residuals should have approximately mean 0 and variance 1. The sum of squared Pearson residuals follows an approximate χ² distribution and can be used as an overall goodness-of-fit test.

Deviance Residuals

Deviance residuals are based on the contribution of each observation to the overall model deviance (the log-likelihood ratio comparing the fitted model to a saturated model). They are defined as:

di = sign(yi − μ̂i) × √[2(yi ln(yi/μ̂i) − (yi − μ̂i))]

Deviance residuals tend to be more normally distributed than Pearson residuals, especially when some expected counts are small. This makes them preferable for normal probability plots and other diagnostic displays.

Anscombe Residuals

Anscombe residuals use a transformation of the observed counts designed to make the residuals as close to normally distributed as possible. They apply a cube-root transformation to both the observed and expected values. Anscombe residuals are particularly useful when checking the normality assumption of residuals in Poisson models, and they complement Pearson and deviance residuals in a thorough model evaluation.

Goodness of Fit

The overall fit of a Poisson model can be assessed using the sum of squared Pearson residuals, which approximately follows a χ² distribution with (n − p) degrees of freedom, where n is the number of observations and p is the number of estimated parameters. A significant test statistic suggests the model does not fit the data adequately.

An important diagnostic is the dispersion parameter, estimated as the sum of squared Pearson residuals divided by the residual degrees of freedom:

Dispersion parameter estimate
\[ \color{#0B7B6B}{\hat{\phi}} = \frac{\color{#C2410C}{\sum r_P^{2}}}{\color{#6D28D9}{n - p}} \]
The estimated dispersion is the sum of squared Pearson residuals divided by the residual degrees of freedom. A value near one supports the Poisson variance assumption.

Under the Poisson assumption (mean = variance), φ should equal 1. Values substantially greater than 1 indicate overdispersion; values less than 1 indicate underdispersion.

Why this matters in practice: when overdispersion is ignored, the Poisson standard errors come out too small, so confidence intervals are too narrow and p-values too extreme. The practical risk is calling an association statistically significant when the data do not really support it.

Understanding Overdispersion

Overdispersion, the situation where the observed variance exceeds the Poisson-assumed variance, is one of the most common problems in count data modelling (Ver Hoef & Boveng, 2007). It is critical to distinguish between two types:

Warning: Interpreting Overdispersion

Before concluding that overdispersion is “real,” always investigate whether the model is correctly specified. Adding missing predictors, removing outliers, or modelling non-linear effects may resolve apparent overdispersion without needing to change the distributional assumptions. Applying overdispersion corrections to a misspecified model can mask important features of the data.

Apparent Overdispersion

Apparent overdispersion arises from problems with the model rather than the data-generating process itself. Common causes include:

  • Outliers: A few extreme observations can inflate the dispersion statistic dramatically.
  • Missing important predictors: If key covariates are omitted from the model, the unexplained variation appears as overdispersion.
  • Wrong model form: Using a linear predictor when the true relationship is non-linear.
  • Non-linear effects: Failing to include quadratic or other polynomial terms for predictors with curvilinear relationships.

Apparent overdispersion can be resolved by correcting the model specification: removing outliers, adding missing predictors, or using the correct functional form.

Real Overdispersion

Real overdispersion reflects genuine extra-Poisson variation in the data that cannot be explained by observable covariates. This often arises from:

  • Unobserved heterogeneity: Subject-level variation in the underlying rate that is not captured by measured predictors.
  • Clustering: Events within groups (e.g., animals within herds) are correlated, violating the independence assumption.
  • Biological variability: Inherent variation in susceptibility or exposure that exceeds what the Poisson model allows.

Real overdispersion requires statistical corrections such as scaling standard errors, using negative binomial regression, or employing random effects models.

Approaches to Handling Overdispersion

ApproachHow It WorksWhen to Use
Scale SEs by √φMultiplies standard errors by the square root of the estimated dispersion parameter; coefficients unchangedMild to moderate overdispersion; quick fix when coefficient estimates are trusted
Negative binomial regressionAdds an extra parameter (α) to model the excess variance explicitlyModerate to severe overdispersion; when a more principled model is desired
Random effects / GLMMIncludes subject- or group-level random intercepts to capture unobserved heterogeneityClustered data (e.g., animals within herds); hierarchical study designs
GEE (robust SEs)Uses generalised estimating equations with an empirical (sandwich) variance estimatorClustered data when marginal (population-averaged) estimates are of primary interest
Knowledge check: this section

1. In a Poisson model, overdispersion is indicated when:

Overdispersion occurs when the observed variance exceeds the Poisson-assumed variance (mean), giving a dispersion parameter φ > 1.

2. Which of the following is NOT a cause of apparent overdispersion?

Inherent biological variation causes real (not apparent) overdispersion. Apparent overdispersion is caused by model misspecification issues such as outliers, missing predictors, or incorrect functional form.

3. One approach to handling real overdispersion is:

Negative binomial regression explicitly models the extra-Poisson variation by adding a parameter that allows the variance to exceed the mean. Removing outliers and adding predictors address apparent overdispersion instead.

Reflection

Why is it important to distinguish between apparent and real overdispersion before choosing a correction strategy? What could go wrong if you apply the wrong fix?

Model answerApparent overdispersion can arise from model misspecification (missing important covariates, missing interactions, or the wrong functional form for a continuous predictor) rather than from true heterogeneity in the rate. The fix depends on the cause: (a) if misspecification, add the missing covariates and re-check dispersion; the ‘overdispersion’ often resolves. (b) If real (true heterogeneity beyond what the linear predictor captures), switch to negative binomial or quasi-Poisson. Wrong fix consequences: applying NegBin to a misspecified Poisson model patches the SE inflation but leaves the biased point estimates from missing covariates; applying robust SEs instead may also misrepresent the true variability if the underlying structure has zero-inflation. Always investigate dispersion's source through residual diagnostics, plots of variance vs. mean, and inclusion of plausible missing covariates.
Reflection saved!
* Complete the quiz and reflection to continue.
Section 8 of 9

Negative Binomial & Zero-Adjusted Models

⏱ Estimated time: 20 minutes
Section 4 of 4

Negative Binomial & Zero-Adjusted Models

Extending the Poisson for overdispersion and excess zeros.

Conceptual foundation

Negative binomial as a Gamma-mixed Poisson

Individual rate λ λ ~ Gamma(μ, α) Count given λ Y|λ ~ Poisson(nλ) Marginal: NB Y ~ NegBin(μ, α)

When \(\alpha = 0\), all subjects share the same \(\lambda\), and the model reduces exactly to Poisson.

Two parameterisations

NB-1 and NB-2 variance functions

NB-1 variance (Eq 18.8)
\[ \color{#0B7B6B}{\text{Var}(Y)} = \color{#C2410C}{\mu}(1 + \color{#6D28D9}{\alpha}) \]
Var(Y) variance μ mean α dispersion parameter
NB-2 variance (Eq 18.9), the default in glm.nb()
\[ \color{#0B7B6B}{\text{Var}(Y)} = \color{#C2410C}{\mu} + \color{#6D28D9}{\alpha}\color{#C2410C}{\mu}^2 \]
Var(Y) variance μ mean α dispersion parameter

NB-2 is the most commonly used form. Its variance-to-mean ratio \(1 + \alpha\mu\) grows with the mean, reflecting the biological reality that larger expected counts are also more variable in absolute terms.

Choosing between Poisson and NB

Likelihood ratio test on the dispersion parameter

Null hypothesis for LRT
\[ H_0: \alpha = 0 \quad (\text{Poisson is adequate}) \]

Significant LRT

Overdispersion confirmed. Use negative binomial. Expect similar point estimates but wider standard errors than Poisson.

Non-significant LRT

No evidence against Poisson. Simpler model preferred. The dispersion parameter \(\alpha\) is effectively zero.

Excess zeros

Three zero-adjusted model families

Zero-inflated

Mixture: structural-zero group plus count process. Both components can have different predictors. The Vuong test compares it to the standard model.

Hurdle

Two stages: binary model for any event, then zero-truncated count for magnitude. All zeros come from the binary stage.

Zero-truncated

Zeros structurally impossible by study design. Conditions on Y greater than zero. Applied when sampling excludes non-events.

Lesson recap

The decision sequence

Poisson Fit, test phi phi>1? Neg. binomial Explicit alpha zeros? Zero-adjusted ZIP / ZINB / Hurdle

Introduction and Overview

An earlier section named overdispersion as the most common problem with Poisson regression. This section closes the lesson with the standard fixes: the negative binomial distribution (which adds a free dispersion parameter; Ver Hoef & Boveng, 2007), and zero-adjusted models for the special case where there are far more zeros than Poisson or negative binomial alone can accommodate (Lambert, 1992).

Learning Objectives

  • Derive the negative binomial as a Gamma-mixed Poisson and contrast NB-1 and NB-2 parameterisations.
  • Fit a negative binomial regression and compare it to a Poisson fit using a likelihood-ratio test on the dispersion parameter.
  • Identify zero-inflation versus zero-truncation and choose the appropriate zero-adjusted model.
  • Interpret a hurdle or zero-inflated model in terms of separate processes for the zero and the count components.

The Negative Binomial Distribution

The negative binomial (NB) distribution extends the Poisson by adding an extra parameter α that captures the additional variation not accounted for by the Poisson assumption. Conceptually, the NB distribution arises when the Poisson rate itself varies randomly across individuals, so each subject has their own λ, drawn from a Gamma distribution. Averaging over those rates produces the negative binomial distribution.

The NB distribution allows the variance to exceed the mean, making it the natural first choice when overdispersion is present (Ver Hoef & Boveng, 2007). Two common parameterisations define how the variance relates to the mean:

Bar chart comparing a Poisson distribution and a negative binomial distribution, both with a mean of 6. The negative binomial places more probability on very low and very high counts, reflecting its larger variance.
At the same mean (μ = 6), the negative binomial spreads probability further into the tails than the Poisson. That extra dispersion is what makes it the standard remedy when counts are overdispersed.

NB-1: Linear Variance

NB-1 variance function (Eq 18.8)
\[ \color{#0B7B6B}{\text{Var}(Y)} = \color{#C2410C}{\mu} + \color{#6D28D9}{\alpha}\color{#C2410C}{\mu} = \color{#C2410C}{\mu}\,(1 + \color{#6D28D9}{\alpha}) \]
The variance equals the mean inflated by a constant factor set by the dispersion parameter, so the variance grows linearly with the mean.

In the NB-1 parameterisation, the variance increases linearly with the mean. The overdispersion is proportional to the mean: doubling the expected count doubles the excess variance. The ratio Var(Y)/μ = (1 + α) is constant across all observations, making NB-1 similar to a quasi-Poisson model with a fixed dispersion parameter.

NB-1 is sometimes preferred when overdispersion is relatively constant across the range of predicted values. However, it is less commonly used in practice than NB-2.

NB-2: Quadratic Variance

NB-2 variance function (Eq 18.9)
\[ \color{#0B7B6B}{\text{Var}(Y)} = \color{#C2410C}{\mu} + \color{#6D28D9}{\alpha}\color{#C2410C}{\mu}^{2} \]
The variance equals the mean plus the dispersion parameter times the mean squared, so the variance grows quadratically with the mean.

In the NB-2 parameterisation (the most commonly used form), the variance increases quadratically with the mean. Observations with higher expected counts have proportionally more overdispersion. This is often more realistic in biological settings where variability tends to grow faster than the average.

The NB-2 model is the default in most statistical software (e.g., Stata’s nbreg, R’s glm.nb()). When α = 0, the NB-2 model reduces to the Poisson model, making the Poisson a special (nested) case of NB-2.

Negative Binomial Regression

The NB regression model uses the same log-linear form as Poisson regression; the only difference is in the assumed distribution of the outcome:

Negative binomial regression model
\[ \color{#0B7B6B}{\ln\!\big(E(Y)\big)} = \color{#C2410C}{\ln(n)} + \color{#6D28D9}{\beta_0} + \color{#1D4ED8}{\beta_1 X_1 + \beta_2 X_2 + \cdots} \]
The log of the expected count uses the same log-linear form as Poisson: the offset plus the intercept plus the predictor terms. Only the assumed variance differs.

Coefficients are interpreted identically to Poisson regression: eβ gives the incidence rate ratio. The key advantage is that the NB model produces correct standard errors even when overdispersion is present, because the extra variation is explicitly modelled through α.

Testing Poisson vs. Negative Binomial

Since the Poisson model is nested within the NB model (when α = 0), a likelihood ratio test (LRT) can be used to determine whether the NB model provides a significantly better fit. A significant LRT indicates that overdispersion is present and the NB model is preferred. Note that this is a boundary test (testing α = 0 vs. α > 0), so the p-value from the standard χ² reference distribution is conservative.

Zero-Adjusted Models

Standard count models (Poisson and NB) may not adequately handle datasets with an unusual number of zeros (Lambert, 1992). Three families of models have been developed to address different zero-related problems:

Zero-Inflated ModelsClick to explore
Hurdle ModelsClick to explore
Zero-Truncated ModelsClick to explore

Choosing Among Zero-Adjusted Models

The choice depends on the data-generating process:

  • If some zeros are “structural” (from a fundamentally different process) and others arise from the count process, use a zero-inflated model.
  • If the zero/non-zero distinction is a separate decision from the magnitude of the count, use a hurdle model.
  • If zeros are impossible by design, use a zero-truncated model.
ModelSource of ZerosKey FeatureTest / Comparison
Zero-InflatedBoth components (structural + count)Mixture of logistic + count modelVuong test vs. standard model
HurdleBinary component onlyTwo-part: binary then truncated countLRT or AIC/BIC comparison
Zero-TruncatedZeros cannot occurConditional on Y > 0Applied when sampling excludes zeros
Knowledge check: this section

1. The NB-2 model differs from the Poisson model by:

The NB-2 model adds an αμ² term to the variance, allowing the variance to increase quadratically with the mean. This is the most commonly used negative binomial model.

2. Zero-inflated models are appropriate when:

Zero-inflated models handle situations where some zeros come from a separate process (structural zeros) in addition to zeros from the count process, resulting in more zeros than the standard count model predicts.

3. The key difference between a hurdle model and a zero-inflated model is:

In a hurdle model, ALL zeros come from the binary (logistic) part; once the hurdle is crossed, only positive counts are modelled. In zero-inflated models, zeros can come from both components.

Reflection

When might you choose a hurdle model over a zero-inflated model in practice? Think of an epidemiological example where the distinction matters.

Model answerHurdle and zero-inflated models both handle excess zeros but with different mechanisms. Hurdle: the zero process is independent of the count process, so you first decide whether any event occurs (a binary process), and only if “yes” do you count events (typically a zero-truncated Poisson or NegBin). Zero-inflated: zeros come from two sources: a structural-zero process (always zero, e.g., never susceptible) plus the count process (could be zero or non-zero among the susceptible). Choose hurdle when the binary “any event” decision is conceptually separable from the count “how many” (e.g., GP visits: did you go at all this year? if yes, how many?). Choose zero-inflated when some subjects are structurally immune (e.g., contraception use among postmenopausal women, structural zeros, versus premenopausal users counting cycles). Distinction matters because the two models give different interpretations of the ‘extra-zero’ subjects.
Reflection saved!
* Complete the quiz and reflection to continue.
Final Assessment

Lesson 4: Final Assessment

15 questions • 100% required to pass

Bringing It All Together

This module extended the binary toolkit of the previous lesson to two further members of the generalised linear model family. The first part took outcomes with three or more categories: it started with the four-model landscape and the Apgar-score example, then walked through the multinomial logit (general but parameter-hungry), the proportional-odds model (parsimonious for ordinal data when its assumption holds), and the adjacent-category and continuation-ratio models (alternatives when proportional odds fails or the categories are sequential). The recurring theme is that the choice of logit determines what each coefficient means: a single estimand takes a different shape under each model, and the right shape depends on the structure of the outcome and the question being asked.

The second part assembled the count-and-rate toolkit. It started with the Poisson distribution and used its log-link form to build a regression, then introduced the offset term, the small piece of arithmetic that converts a count model into a rate model and unifies the cohort and incidence-density designs you have already met. From there it moved to evaluation: Pearson, deviance, and Anscombe residuals, goodness-of-fit tests, and the variance-to-mean comparison that makes overdispersion visible, before introducing negative binomial regression as the everyday workhorse when Poisson assumptions break and the zero-adjusted (hurdle and zero-inflated) models for outcomes with a separate at-risk process.

Seen together, the two parts make the same point from two directions: a generalised linear model is a distribution plus a link, and once the outcome is characterised correctly (nominal or ordered, count or rate, with or without excess zeros) the coefficients, the diagnostics, and the reporting follow. The final assessment asks you to recognise which model fits a given outcome, to interpret its coefficients without sliding back into the binary-logistic vocabulary by reflex, to reach for the right count model and report rate ratios with appropriate uncertainty, and to use the diagnostic flowchart as your default answer to "which model?". A later lesson takes on the next major outcome type, time to event, where censoring and the timing of events extend the regression toolkit again.

Key Takeaways from this lesson

  • Nominal vs ordinal outcomes call for different families of models; ordering is information you can either use (parsimony) or ignore (generality).
  • Multinomial logistic regression fits J−1 simultaneous logits against a baseline and its exponentiated coefficients are relative risk ratios; the proportional-odds model assumes one coefficient across every cumulative cutpoint, and that assumption must be tested (Brant test), not assumed.
  • The adjacent-category model is a constrained multinomial that compares each category with its neighbour; the continuation-ratio model suits sequential-stage outcomes and can be fit as a series of binary logistic regressions on recoded data.
  • Always start by sketching the logit your model uses; the choice of comparison set is what makes any of these models ordinal or nominal.
  • Counts and rates are a distinct outcome family with their own GLM, the Poisson with a log link; the offset term turns a count model into a rate model by absorbing person-time or population denominators.
  • Exponentiated coefficients in Poisson and negative binomial regression are rate ratios, interpreted multiplicatively.
  • Overdispersion (variance exceeding the mean) is the most common Poisson failure mode and inflates Type I error if ignored; negative binomial regression is the default fix whenever the dispersion test rejects Poisson.
  • Zero-inflated and hurdle models handle outcomes with a separate at-risk process generating excess zeros; zero-truncated models handle outcomes where zeros cannot be observed.

This final assessment covers all material from the module. You must answer all 15 questions correctly (100%) and complete the final reflection to finish the lesson.

Reflection

A registry follows 1,800 patients with a chronic condition. For each patient it records a disease-severity grade at enrolment (mild, moderate, severe), the number of emergency visits during follow-up, and the length of follow-up, which differs between patients; about half of the patients have no visits at all. Reflecting on both parts of this module, walk through your modelling strategy for each outcome: which model you would fit for severity grade and why, which assumption you would test and what you would do if it failed, how you would model the visit counts given unequal follow-up and the many zeros, which diagnostics would tell you whether Poisson is adequate, and how you would interpret and report the coefficients from each model.

Model answerSeverity grade is ordinal, so the natural starting point is the proportional-odds (cumulative logit) model: one coefficient per predictor across the mild-versus-higher and moderate-or-lower-versus-severe cutpoints, interpreted as the odds ratio of being in a higher severity category. Test the proportional-odds assumption with the Brant test and a likelihood-ratio comparison against the multinomial model; if it fails for some predictors, move to a partial or generalised ordinal model, or, if the grades behave as sequential stages, a continuation-ratio model fit as binary logistic regressions on recoded data; if the ordering carries no information for the question, the multinomial model with relative risk ratios against the mild baseline is the fallback, with the independence-of-irrelevant-alternatives assumption in mind. Emergency visits are counts accumulated over unequal follow-up, so fit a Poisson regression with log(follow-up time) as an offset, which turns the model into one for visit rates and makes exponentiated coefficients incidence rate ratios. Check adequacy with the Pearson dispersion ratio and deviance, Pearson and Anscombe residuals; a dispersion parameter well above one signals overdispersion, so first ask whether it is apparent (missing predictors or interactions, wrong functional form) and then, if real, fit a negative binomial model (NB-2, with a likelihood-ratio test of alpha = 0 against Poisson). With half the patients at zero, compare the observed and predicted zero counts; if zeros exceed what the negative binomial predicts and there is a substantive at-risk process (some patients never use emergency care), fit a hurdle or zero-inflated negative binomial model and compare with a Vuong test or AIC. Report each model with its own scale: cumulative odds ratios (or relative risk ratios) with confidence intervals for severity, incidence rate ratios per unit of follow-up for visits, the assumption tests and dispersion diagnostics that justified the choice, and the decision path from Poisson to the final count model.

Minimum 20 characters required.

✓ Reflection saved

Final Knowledge Assessment

Final assessment: the 15 questions

1. What type of outcome data has categories with no natural ordering?

Nominal data have categories with no inherent ordering or ranking. Examples include type of disease, ethnicity, or mode of transport. Ordinal data, by contrast, have a meaningful ordering among categories.

2. How many sets of coefficients does a multinomial model with 4 outcome categories estimate?

A multinomial logistic model with J = 4 categories estimates J−1 = 3 sets of coefficients, each comparing one non-baseline category to the baseline category.

3. In a proportional-odds model, the OR for a predictor represents:

The proportional-odds assumption means that a single OR applies at every cutpoint. Regardless of where you dichotomise the ordinal outcome, the estimated OR for each predictor is the same.

4. The IIA assumption in multinomial logistic regression means:

The Independence of Irrelevant Alternatives (IIA) assumption states that the relative probability (odds) of any two outcomes does not change when other alternatives are added to or removed from the choice set.

5. In a multinomial model, exponentiated coefficients are technically:

Exponentiated coefficients from a multinomial logistic model are ratios of relative risks (RRR). They compare the probability of being in one category relative to the baseline, but they are not true odds ratios as in standard binary logistic regression.

6. The Brant test evaluates:

The Brant test is a Wald-type test that evaluates the proportional-odds assumption. It provides both an overall test and individual tests for each predictor, identifying which specific variables violate the assumption of equal effects across cutpoints.

7. The adjacent-category model is a constrained version of:

The adjacent-category model is a constrained version of the multinomial logistic model. The constraint is that the coefficient for categories n levels apart equals n times the coefficient for adjacent categories. This can be tested by comparing the two models with a likelihood-ratio test.

8. Continuation-ratio models are best suited for:

Continuation-ratio models are designed for outcomes where each level must be “passed through” to reach higher levels. The model asks: given that you reached at least level j, what are the odds of reaching level j+1? This is ideal for sequential or staged processes.

9. Which type of count data involves dividing event counts by accumulated person-time?

Incidence rates use person-time at risk as the denominator, dividing the number of new events by the accumulated person-time of follow-up.

10. The Poisson distribution assumes:

The fundamental property of the Poisson distribution is that E(Y) = Var(Y) = μ. This single-parameter property is what distinguishes it from the negative binomial.

11. In Poisson regression, the offset term represents:

The offset is ln(person-time) which accounts for different exposure times across observations, allowing the model to estimate rates rather than raw counts.

12. The exponentiated coefficient from a Poisson regression (eβ) is interpreted as:

eβ gives the incidence rate ratio, the multiplicative change in the event rate per unit change in the predictor.

13. Which is a cause of APPARENT (not real) overdispersion?

Missing important predictors is a model specification issue that creates apparent overdispersion, which can be resolved by correcting the model rather than changing distributional assumptions.

14. To test whether negative binomial regression provides a better fit than Poisson, you use:

Since Poisson is nested within NB (when α = 0), a likelihood ratio test comparing the two models tests whether the extra parameter is needed.

15. In a hurdle model, zero counts are generated by:

In a hurdle model, ALL zeros come from the binary component. Once the “hurdle” is crossed (event > 0), only positive counts are modelled by the truncated count component.

✦ Before submitting: pass every section knowledge check (100%) and complete every reflection.

🏆 Congratulations!

A later lesson, Survival Data, takes on the next major outcome type: time-to-event. Survival models extend the regression toolkit to handle censoring (people who haven't yet had the event) and the rich information in the timing of events, rather than only whether they occurred.

You have successfully completed this lesson: Generalized Linear Models.

Your responses have been downloaded automatically.