Jul 27, 2018
## Quality improvement (QI) for the epidemiologist
More and more frequently I am being asked to evaluate quality improvement interventions. Recently I worked on a project that altered screening guidelines for
In some sense, this is not a traditional epidemiological application of biostatistics. Rather, it is a continual process improvement program to reduce unnecessary
QI methods fall under two general categories: visualization of the data and analysis of the data. The first step should be to visualize the data. Can you detect trends? Does the variance change over time? One of the easiest visualizations is a run chart. In this type of chart, the x-axis is time, and the y-axis represents the outcome under study. The data need to be organized as time-series data: that is, measures of the outcome per unit time. The data dictate the unit of time. For example, in the There are various techniques to explore process and quality improvement as the result of an intervention. There are (interrupted) time series, statistical process control charts, regression analyses, and so on. Process control charts, of which the run chart is probably the simplest, is the technique of choice here. Users of R can turn to a package called qicharts2 that implements QI analysis and visualization for continuous data (using the function qic) and categorical data (using the function paretochart). As before, the goal is to differentiate random variability from non-random variability (aka, the signal or the result of the intervention). There are a handful of methods proposed to detect non-random variability, all with the goal of answering the question, did some intervention result in a change? These are often based on an individual or series of time points occurring outside of a certain threshold (such as the 3-sigma limit, similar to a exceeding the confidence interval bounds). Visualizing a run chart of the data will allow an overall sense of the trends. The run chart includes the median of the data, and can be partitioned by pre and post intervention periods. A run of 8 points above or below the median indicates an intervention effect (using the so-called Western Electric rules). If a trend is detected in the run chart, then the analyst can explore more specific control charts based on assumptions about the data including its distribution and mean. See "Choosing the right control chart" on the qicharts2 vignette.
For those researchers interested in p-values of the QI analysis, there are a few different ways to generate these. A p-value for the overall intervention effect can be calculated through a non-parametric test, like the rank-sum test, comparing the distribution of values before and after the intervention. A p-value for the overall trend of the data can be calculated as a test for trend, using a linear regression predicting count by time. This can further be stratified by the intervention. Depending on the data, the researcher needs to be careful to guard against assumptions about these analyses that are not inherent in process control chart. For example, the |