It’s not every day the headlines announce government officials releasing mounds of data about their own operations. Actually, the frequency verges on the unprecedented. Cook County State Attorney Kim Foxx’s decision to release information on years’ worth of her office’s decision-making is, in that light, astounding. Legal scholars have lamented the existence of so-called “black Read more about Is the Prosecutorial Black Box Finally Opening?[…]
On Tuesday, Jan. 16 pretrial staff in Polk County, Iowa entered their offices with a slightly different charge. They had been accustomed to perusing a list of arrestees scheduled for first appearance and searching for individuals who qualified for an interview and pre-disposition release. That morning, some staff members continued this time- and resource-intensive practice. Read more about Previewing and Reviewing Pretrial Risk Assessment RCTs[…]
The A2J Lab receives many comments, inquiries, and questions via the website. Most come from U.S. attorneys and researchers. From time to time, though, we are lucky to hear from others around the world committed to making their court systems more open and their legal procedures more transparent. One such kindred spirit is Jéssica Raiane, an attorney living in Goianésia, Goias, Brazil. She kindly has shared her thoughts on the challenges facing A2J proponents in her home country. The original Portuguese post is followed by an English translation.
Today we bring you another look at key field partners who have helped make the Dane County PSA RCT one of the A2J Lab’s signature series. Part I covered the work of the County’s two Assessors, who perform the essential work of populating the PSA’s risk factors and generating its recommendations day in and day out.
Last week, we marked the launch of our PSA RCT in Dane County, Wisconsin. Starting today, I will be pulling back the field experiment curtain, as it were, and introducing some of the A2J Lab’s field partners. These Dane County employees have worked tirelessly for almost two years to make the PSA’s implementation and our concurrent evaluation possible.
First, a confession: flossing and I enjoy a complicated relationship. I do it, but not as consistently as four out of five dentists might prefer. Yet, using several other dental hygiene implements, I somehow emerge from biannual checkups with pretty solid marks. And it seems I have (the absence of consistent) science on my side!
Greetings from Indianapolis and the National Legal Aid and Defender Association (NLADA) annual conference! The proceedings have gathered many of the best minds and providers in the legal services field. There is real momentum for collecting data, making use of promising technologies, and implementing evidence-based practices. All great news for the A2J Lab.
How Should We Think about Racial Disparities?
In a previous post, I considered some of the less convincing critiques of pretrial and sentencing risk assessments that sound in the ecological fallacy. The fallacy argument mistakenly targets risk scores as applying only group inferences to individual case decision-making. The takeaway was straightforward. A comprehensive understanding of actuarial tools must include rigorous counterfactual thinking about a state of the world in which they aren’t available. In this follow-up, I discuss an even more serious claim: that actuarial tools might lead to unjustifiable racial disparities in criminal justice outcomes.
Or How We Should Be Thinking Counterfactually About Actuarial Tools
Nate Silver’s widely heralded FiveThirtyEight.com site now tracks more than just presidential elections. He and his colleagues apply statistical modeling or reasoning to everything from the Emmys to ERAs. Just over a year ago, its contributors–in collaboration with the Marshall Project (which itself is funded by the A2J Lab’s sponsor, the Arnold Foundation)–released a feature on the use of pretrial and sentencing risk assessments. So, too, did investigative journalists at ProPublica.
Both pieces raised serious questions about the use of risk scoring mechanisms. Should officials base decisions about individual arrestees or convicted defendants on aggregate data from other cases? Is there any evidence that these tools are racially biased? Former Attorney General Eric Holder previously voiced those concerns, best captured in his statement: “Although these measures were crafted with the best of intentions, I am concerned that they inadvertently undermine our efforts to ensure individualized and equal justice. . . . [T]hey may exacerbate unwarranted and unjust disparities that are already far too common in our criminal justice system and in our society.” […]