Loyola University Chicago

School of Education

C2 Training Sessions

Methods Training Sessions (Scroll Down for Applied Sessions)

Introductory Sessions

Tuesday, May 21st

Problem Formulation (10:45 – 12:00)

This workshop will review the types of research questions that are appropriate for Campbell systematic reviews, provide instruction on how best to construct research questions for systematic reviews, and discuss some of the issues Campbell authors may face at the problem formulation stage of a systematic review.

Presenter: Aron Shlonsky, University of Toronto 

Literature Searching (1:45 – 3:00)

This workshop will review best practices of comprehensive literature searches and literature retrieval in Campbell systematic reviews, discuss common issues that arise during literature searches, and review key concepts from the Campbell Collaboration information retrieval guide.

Presenter: Karianne Hammerstrom

Coding (330 – 4:45)

This workshop will offer guidance on how to extract information from primary studies when conducting a systematic review, review different approaches to study quality coding, and discuss common issues that arise during the coding phase of a systematic review.

Presenters: Sandra Jo Wilson, Vanderbilt University


Wednesday, 22nd

Calculating Effect Sizes (10:30 – 11:45)

This workshop will cover how to calculate the most common effect size metrics typically encountered in a Campbell review (e.g., standardized mean difference, odds ratio, and risk ratios), providing guidance on how to estimate or approximate effect sizes based on different types of primary study data, and discuss common problems that may arise when calculating effect sizes.

Presenter: David Wilson, George Mason University

Introduction to Meta-Analysis (1:00 – 2:30)

This workshop will cover introductory meta-analysis methods for synthesizing effect sizes, demonstrate software available for conducting meta-analyses, and review common issues that may arise when conducting a meta-analysis for a Campbell Review.

Presenter: Joshua R. Polanin, Loyola University Chicago

Applied Sessions

Tuesday, May 21st

Moderator Analysis (10:45 – 12:00)

This workshop will review methods for assessing effect size moderators in a meta-analysis, covering analysis of variance and meta-regression models, the strengths and limitations of various moderator analysis methods, and discussing common dilemmas that can occur when conducting moderator analysis in a Campbell systematic review.

Presenter: Ryan Williams, University of Memphis

Using a Broader Range of Evidence in Reviews(1:45 – 3:00)

This workshop will review methods for incorporating a broader range of evidence in Campbell systematic reviews, discussing the importance of program theories to guide mixed methods approaches, and providing suggestions on maintaining rigor and transparency with such approaches.

Presenter: Birte Snilstveit, 3ie

Measuring and Assessing Study Quality (3:30 – 4:45)

This workshop will discuss best practices for measuring the quality of primary studies included in a systematic review, assessing the impact of study quality on review findings, and reviewing common issues that arise when considering study quality in a Campbell review.

Presenter: Jeff Valentine, University of Louisville


Wednesday, May 22nd

Graphical Displays in Meta-Analysis (10:30 – 11:45)

This workshop will review common graphical displays used in meta-analysis, discuss software options for creating meta-analysis graphs, and provide suggestions on how to produce efficient graphical displays of meta-analysis findings in Campbell reviews.

Presenter: Emily Tanner Smith, Vanderbilt University

Interpreting the Practical Significance of Meta-analysis Findings (1:00 – 2:30)

This workshop will provide guidance on the how to interpret findings from meta-analysis in ways that are meaningful to users of Campbell reviews. The workshop will discuss different methods available for the substantive interpretation of meta-analysis findings, and discuss common issues that may arise at this phase of a Campbell review.

Presenter: Mark Lipsey, Vanderbilt Universit