This page is under construction. We present a first collection of resources, but there is much more to come.
There are many innovative projects happening — but how do we take the next step, to evaluate them?
On this page, we present different methods to measure and evaluate access to justice innovations. This includes tools to review websites and other digital experiences; to gather user feedback and make it meaningful; and to judge how a service, organization, or other big system design has worked.
Measurements often are custom-designed for a project, but there can be some more general tools and principles that can be used across projects.
Idea Review sheet
The Idea Review is an initial survey-like tool, to evaluate a concept that has been proposed for an Access Innovation.
We use it at the Legal Design Lab in order to judge ideas as they have emerged out of brainstorms, and after they’ve been sketched out in rough prototypes.
We present this heuristic tool both to subject matter experts and target users, for them to give feedback that we can easily process.
It’s a quick tool to get a mix of quantitative and qualitative feedback — and it’s best used when more than one idea is being reviewed.
Randomized Controlled Trials
A Randomized Controlled Trial (RCT for short) is an empirically rigorous way to determine if a thing you are doing (let’s call it an ‘intervention’) is having the effect you intended it to. It involves careful planning of what exactly you are testing — with identification of the ‘variables’ and the ‘conditions’, and having multiple testing groups with different variations of these variables.
The goal is to be able to have a group that has used the intervention you’re testing the efficacy of, and a similar group that has not used it — the ‘control’ group. Then you can collect data that will more clearly demonstrate whether the group with the intervention has noticeably different results than the control group.
Read more about RCTs and examples of how to run them here, at BetterEvaluation.
Quick Customer Rating machine
A quick way to get user feedback on an experience, service, or product, is to ask them to use a very simple Rating Machine. Often it’s on a tablet (for an in-person service), on a browser window (for a web-based service), or a paper sheet (again for in-person). Ideally, it will be a very quick and visual interface, that lets the user quickly put a rating on what they’ve just experienced.