Did you know courts hand out “random” satisfaction surveys? Except they’re anything but random. Those results are calculated and recorded by the Michigan State Court Administrative Office as a measure of court effectiveness and public satisfaction. Every year since 2015, Barry County has disproportionately favored divorce cases for survey sampling. The real uptick occurred when Judge Michael Schipper took over the Circuit Court.

How the Survey System Works — And How It Can Be Gamed

For one week per year, every person leaving the courthouse is supposed to receive a survey. That sounds fair enough. Here is the problem: the court controls the docket, which means the court controls which cases are scheduled during survey week, and therefore controls which litigants receive surveys.

Obviously this is flawed, because it only shows what the court wants the state system to see.

Why Divorce Cases Produce Better Scores Divorce and child custody cases tend to produce more favorable survey responses because they tend to favor women, and the party who prevails in a hearing is more likely to report satisfaction with the court. Scheduling survey week to coincide with a high proportion of family court hearings, while dramatically undersampling criminal cases where defendants and their families consistently experience the most adversarial outcomes, produces a satisfaction score that has nothing to do with how the court actually performs for most of the people who appear before it.

The Numbers Don’t Lie

Barry County’s own publicly available data tells this story clearly. According to the 2021 Court Caseload Report, the sample breakdown looks like this:

Barry County 5th Circuit — 2021 Survey Sample Source: SCAO
Case Type Total Cases Surveyed Survey Rate
Criminal Cases 300 5 1.7%
Divorce with Children 172 17* combined
Divorce without Children 161 17* combined
*17 total individuals surveyed across 333 combined divorce cases. Divorce cases made up 49% of the total survey sample in 2021.
300 Criminal Cases

Only 5 individuals surveyed from this population. That is a 1.7% survey rate for the case type most likely to produce critical feedback.

49% Divorce Share of Sample

Nearly half of all survey respondents in 2021 came from divorce cases, despite those cases representing a much smaller share of the total docket.

2015 Pattern Start Year

Divorce case overrepresentation in Barry County’s survey sample has been consistent every year since 2015, with the uptick correlating to Schipper’s tenure on the Circuit Court.

“This is called cherry-picking. It’s easy to control your score and be graded well when you also control where the surveys go.”

Why It Matters

By scheduling and distributing surveys to cases that will produce favorable reviews, the court is not getting a true representation of court performance or public satisfaction. It is skewing the numbers. And those numbers get reported to SCAO as if they mean something.

What This Conceals

The people whose experiences are most absent from this data are the people who appear before Judge Schipper in criminal court. The defendants. Their families. The people who have been subjected to sentences that exceed guidelines, violated plea agreements, and the courtroom conduct that multiple attorneys have described as abusive. They are not being surveyed. They are being excluded from the record that gets sent to the state as evidence that the court is performing well.

A satisfaction survey that systematically excludes the most dissatisfied population is not a satisfaction survey. It is a cover story.

The Full 2021 Report

You can find the full Barry County 2021 Public Satisfaction Survey report published by SCAO here: SCAO 2021 Public Satisfaction Report — Barry County →

The 2021 Caseload Report showing total case volumes is here: SCAO 2021 Caseload Report — Barry County →

Cross-referencing these two documents is how the cherry-picking pattern becomes visible. The survey data only makes sense when compared against the actual caseload.

Primary Sources SCAO Reports — Barry County

2021 Public Satisfaction Survey — Barry County 5th Circuit — courts.michigan.gov →

2021 Caseload Report — Barry County 5th Circuit — courts.michigan.gov →

How to cite: Williams, R. (2023, February 28). How Michigan Courts Manipulate Court Satisfaction Surveys to Hide the Truth. Clutch Justice. https://clutchjustice.com/2023/02/28/michigan-court-surveys/