MPH 510 Module 7 Evaluating a Public Health Policy Example

Clearing the Air: Using Epidemiology to Evaluate Smoke-Free Laws

Student Name

Master of Public Health Program, Aspen University

MPH 510: Epidemiology in Public Health

Instructor Name

Month Day, Year

Clearing the Air: Using Epidemiology to Evaluate Smoke-Free Laws

Public health policies should be evaluated as carefully as medical treatments, but policies cannot usually be randomized. Epidemiologists therefore rely on natural experiments, comparing outcomes before and after a policy, or between places with and without it. This paper examines how smoke-free laws have been evaluated, what the evidence shows and how a county could evaluate its own new law.

Why Smoke-Free Laws

Secondhand smoke causes heart disease and lung disease in nonsmokers, and even brief exposure can affect blood vessels and platelets. Smoke-free laws prohibiting smoking in workplaces, restaurants and bars aim to protect nonsmokers and encourage smokers to quit. Because heart attacks can follow quickly after exposure, researchers hypothesized that hospital admissions might fall soon after laws took effect.

The Helena Study

In 2002, Helena, Montana, enforced a smoke-free law for six months before a court suspended it. Researchers compared heart attack admissions to the city's only hospital during those six months with the same months in earlier years and with admissions from outside the city. Admissions from within Helena fell from an average of 40 to 24 during the law, while admissions from outside the city showed no significant change (Sargent et al., 2004).

Limits of a Single Study

Helena was a small city with few events, so the estimate was imprecise, and a single before-and-after comparison cannot rule out coincidences. Critics questioned whether such a large drop was plausible. The appropriate response was replication: if smoke-free laws reduce heart attacks, the effect should appear consistently across many places.

The Meta-Analysis

A meta-analysis pooled 45 studies of 33 smoke-free laws with a median follow-up of 24 months. Comprehensive laws were associated with significantly lower hospital admissions or deaths for all four diagnostic groups studied (Tan & Glantz, 2012). The table summarizes the pooled estimates.

Dose-Response by Law Strength

The meta-analysis grouped laws by comprehensiveness: workplaces only; workplaces and restaurants; or workplaces, restaurants and bars. More comprehensive laws were associated with larger reductions in coronary events (Tan & Glantz, 2012). This gradient, stronger laws producing larger effects, is itself evidence for a causal relationship, much like a dose-response gradient for an exposure.

Interrupted Time Series

A stronger design than a simple before-and-after comparison is the interrupted time series, which uses many data points before and after a policy to model the underlying trend and test whether the policy changed the level or slope of the outcome. The approach accounts for trends already underway and for seasonal patterns, and it can be strengthened with a control series from an area without the policy (Lopez Bernal et al., 2017).

Threats to Validity

Policy evaluations face several threats. Secular trends, such as falling heart attack rates from better treatment, can mimic a policy effect if not modeled. Other events at the same time, such as a tobacco tax increase, can confound results. Changes in diagnostic criteria, such as more sensitive troponin tests, can alter recorded rates. Regression to the mean can make a policy adopted after an unusually bad year look effective.

Evaluating a County Law

A composite county extended its smoke-free law to bars, casinos and outdoor dining areas. The evaluation plan uses monthly hospital admissions for heart attack, stroke and asthma for five years before and three years after the law, modeled with segmented regression that accounts for trend, season and population changes. A neighboring county without the change serves as a control series. Secondary outcomes include air quality measurements in bars and self-reported secondhand smoke exposure from the state survey.

Data Sources

Hospital discharge data provide admissions by county of residence and diagnosis code. Vital statistics provide deaths. The behavioral risk survey provides smoking prevalence and exposure. Air monitors provide particle concentrations. Using residence rather than hospital location ensures that residents treated elsewhere are counted.

Interpreting Results Carefully

Even a strong design yields estimates with uncertainty. The county's evaluation will report confidence intervals, test sensitivity to different model choices and compare results with the published range. A result within the range of the meta-analysis would add to the evidence; a null result would prompt examination of compliance and enforcement.

Economic Evaluation

Beyond health outcomes, evaluations can estimate economic effects. Fewer hospital admissions mean lower health care costs, and studies of restaurant and bar revenues after smoke-free laws have generally found no lasting economic harm, contrary to industry predictions. Including economic outcomes answers common objections from business owners and legislators.

Publication Bias

Meta-analyses can be affected by publication bias if studies showing no effect are less likely to be published. The meta-analysis examined this possibility, and the consistency of results across many settings, including large national studies, reduces concern. Still, evaluators should register their analysis plans in advance so that null results are reported as fully as positive ones.

Equity Considerations

Smoke-free laws may benefit groups differently. Workers in bars and casinos, often lower-wage employees, had the highest exposure before laws and stand to gain the most. Evaluations should report outcomes by income, occupation and race where data allow, to show whether the policy narrows exposure gaps.

Mechanisms Behind the Findings

Biological evidence supports the association. Secondhand smoke exposure increases platelet activation and impairs the function of blood vessel linings within minutes, effects that can trigger heart attacks in people with existing coronary disease. Reduced exposure after laws take effect would be expected to lower such events quickly, which is consistent with the timing seen in evaluations.

Compliance and Enforcement

A law's effect depends on compliance. Evaluations should measure whether smoking actually stopped in covered venues, using inspections, complaints and air monitoring. A law with poor compliance would be expected to show little health benefit, and interpreting a null result requires this information.

Conclusion

Smoke-free laws illustrate how epidemiology evaluates policy: a striking early study prompted replication, a meta-analysis confirmed consistent reductions in hospitalizations with a dose-response by law strength, and designs such as interrupted time series offer ways to evaluate new laws rigorously. The same approach can be used for taxes, zoning rules and other policies that shape population health.

References

Lopez Bernal, J., Cummins, S., & Gasparrini, A. (2017). Interrupted time series regression for the evaluation of public health interventions: A tutorial. International Journal of Epidemiology, 46(1), 348-355. https://doi.org/10.1093/ije/dyw098

Sargent, R. P., Shepard, R. M., & Glantz, S. A. (2004). Reduced incidence of admissions for myocardial infarction associated with public smoking ban: Before and after study. BMJ, 328(7446), 977-980. https://doi.org/10.1136/bmj.38055.715683.55

Tan, C. E., & Glantz, S. A. (2012). Association between smoke-free legislation and hospitalizations for cardiac, cerebrovascular, and respiratory diseases: A meta-analysis. Circulation, 126(18), 2177-2183. https://doi.org/10.1161/CIRCULATIONAHA.112.121301