MEASURING AND REPORTING IMPACT OF PRO BONO INITIATIVES TO STRENGTHEN ACCESS TO JUSTICE Dr Christopher Walsh Senior Research Analyst and Policy Advisor.

Slides:



Advertisements
Similar presentations
St Kentigerns Academy. Some examples of the projects that learners have been involved in for the Leadership Award…
Advertisements

Street Law in Community Colleges A law-based civic learning program for community colleges.
Leadership Development Training: What To Expect in Your First Year October 23, 2014.
LEARNER CENTERED LEARNER DESIGNED Learning & Preparation Objectives Learning Resources and Strategies Evidence of Accomplishment of Objectives Criteria.
April 6, 2011 DRAFT Educator Evaluation Project. Teacher Education and Licensure DRAFT The ultimate goal of all educator evaluation should be… TO IMPROVE.
Social Research & Consulting, Inc. A Power Point Side Show for.
Leveraging Statewide Partnerships to Drive Educational Outcomes Live United Voices of JAG.
Paul McKeown & Sarah Morse Northumbria University.
CEET Conference 2011 Funding VET for Social Inclusion Competitive tendering and contestable funding in VET: approaches to supporting access and equity.
CB330005S Review and Planning UND: April 2007.
Common Core Standards Ready for College, Work, and Life  A framework around which teachers can create a collectively built body of effective knowledge.
An Option for the Thai Legal Education Reform?: Learning from CLE in China Panarairat Srichaiyarat Legal Consultation Center Faculty of Law Chiang Mai.
Critical Appraisal Dr Samira Alsenany Dr SA 2012 Dr Samira alsenany.
8 th REGENERATION MANAGEMENT RESEARCH NETWORK Matching rhetoric with reality: the challenge for third sector involvement in local governance Wednesday.
HAMLINE UNIVERSITY SCHOOL OF LAW LEARNING OUTCOMES FOR LAWYER ACHIEVEMENT (L.O.L.A.)
Dr. Mary Rogan Dublin Institute of Technology
Learning through Service: The Contribution of Service- Learning to First Year Pre-Service Teachers Miranda Lin, Ph.D., Alan Bates, Ph.D., & Ashley Olson.
Goal 3, Volunteer Development and Systems to Support Youth: Logic Model and Communications Plan Situation Statement During 2005, over 11,218 adult volunteers.
C o n f i d e n c e p e r f o r m a n c e d i s t i n c t i o n q u a l i t y Nursing Facility Family Satisfaction Survey Report Prepared for: Wiley Mission.
performance INDICATORs performance APPRAISAL RUBRIC
Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)
Count us in! The growing role of learning support programs in achieving education outcomes for disadvantaged students Anne Pate Research Officer, Research.
H OW TO G ET P RO B ONO L EGAL S ERVICES FOR Y OUR S MALL B USINESS Angie Hall Staff Attorney Small Business Legal Assistance Program (SBLAP) This presentation.
30 th January 2006 GfK NOP Custom Research Market Test – Initial Quantitative Results Market Need for The Law Society.
Building Sustainable Development Oak Island Resort, NS November 18-19, 2005 How to Write a Successful Proposal Lynn Langille Atlantic Health Promotion.
LEGAL AID SYMPOSIUM OCTOBER 2014 THIMPHU, BHUTAN PREPARED BY LARRY TAMAN 1 Legal Aid: International Standards and Practical Models.
TRANSITION PROJECT LEARNING NETWORK WORKSHOP 3 AISLING PROJECT: TRANSITION PROJECT.
Overall Teacher Judgements
Impact assessment framework
Justice Reform Practice Group Legal Vice Presidency The World Bank ABA Rule of Law Informational Series - May 4, 2011, Washington DC Presenter: Barry Walsh.
Pro bono: legal services undertaken voluntarily and without payment as a public service.
Advocating for Clinic from the “Outside”: Lessons from the Coalface in Ireland Larry Donnelly Manager, Public Interest Law Alliance (PILA) (
ED 562 Seminar Dr. Rubel. Tonight’s Agenda Class Share Discussion Questions Q & A The Final Project.
The Best Bank for Colleagues: Making it a reality Angie Risley Group HR Director 26 April 2012.
“ALL I NEED IS TO PASS MY EXAMS”: THE DILEMMA OF USING A LEARNER-CENTERED TEACHING APPROACH IN GHANAIAN UNIVERSITIES George, K.T. Oduro, (PhD) College.
How can we evaluate the impact of supported employment and help make a better business case To demonstrate impact we need to measure the social value created.
Workshop 6 - How do you measure Outcomes?
PROFESSOR KATHRYN HOLLINGSWORTH Community, Engagement and Social Justice: Improving the law student experience through pro bono placements.
The importance of a preliminary analysis in the course production process Prepared by: Beatrice Ghirardini, Chiara Nicodemi, Fabiana Biasini Instructional.
A Basic Guide to Academic Assessment Presented by Darby Kaikkonen Director of Institutional Research.
1 SHARED LEADERSHIP: Parents as Partners Presented by the Partnership for Family Success Training & TA Center January 14, 2009.
Guidelines for Reviewing AHC Forum Posters Department of Research “Research is a vital component of training tomorrow’s healthcare providers and delivering.
Healthy Futures Performance Measures Session. Session Overview Combination of presentation and interactive components Time at the end of the session for.
Project Design Jennifer Coffey OSEP May 4,
The Value of Rubrics in Messy Non-Profit Evaluation Contexts Kate McKegg American Evaluation Association Conference Washington DC, 2013.
Financial Exclusion Topic Report: a presentation to the Scottish Household Survey User Day Keith Hayton GEN 26 th November 2007.
Staff All Surveys Questions 1-27 n=45 surveys Strongly Disagree Disagree Neutral Agree Strongly Agree The relative sizes of the colored bars in the chart.
Evaluation: from Objectives to Outcomes Janet Myers, PhD MPH AIDS Education and Training Centers National Evaluation Center
National Board Study Group Meeting Dan Barber 5 th Grade Teacher, Irwin Academic Center
Fashion MARKETING TID1131. Types of research Quantitative research Information relating to numbers – quantity. Method - surveys Qualitative research To.
Leading the Way. Coaches realize The whole is never the sum of the parts – it is greater or lesser, depending on how well the individuals work together.
Students in professional spaces: impacting on social justice issues Teri-Lisa Griffiths and Jill Dickinson Social Justice Week 2016 #SHUsocialjustice.
Module 9 Monitoring and Evaluation Tuesday, Oct 14, 2013 Ngo Thi Loan and John Carter.
NIBPS & PSI Joint Careers Event What to do with your psychology degree Dr Barbara McConnell Senior Lecturer, Early Childhood Studies.
STRONG FAMILY AND COMMUNITY ENGAGEMENT IS CENTRAL TO EFFECTIVE SCHOOL REFORM Jan Patterson and Ann Bliss Smarter Schools National Partnerships Key Reform.
© Copyright  People at Work Project - Overview  People at Work Project - Theoretical Underpinnings  People at.
What Women have said helps them to succeed An evaluation of the women’s programs.
Dr Liz Beaty, Director Strategic Academic Practice and Partnership Individual Learning and Institutional Change: Developing Higher Education.
In partnership with Global Learning Programme: Critical thinking in global learning.
The United Kingdom experience in data collection and statistics on disability Ian Dale Head of Disability Analysis Department for Work and Pensions Steel.
Results from the 2012 Donor Engagement Benchmark Survey.
Implementing P4P in a Family Medicine Residency Program: From the Residents’ Point of View Laura Pattison MD Outgoing Chief and P4P Advocate Maya Miley.
Engaging New Lawyers in Pro Bono Service 7 th Pro Bono Stakeholders’ Round Table University of Calgary Downtown – November 7, 2013 Matthew Huys
Technical Business Consultancy Project
ALT Conference – Filling the Gap?
The contribution of CLCs to legal education – a pilot study
A Practice-Based Approach: Improving Law Student Employability Skills in the Context of a Pro Bono Teaching Clinic Dr Francina Cantatore, Centre for Professional.
A Pro Bono Teaching Clinic: Preparing Law Students for Legal Practice and Promoting Community Service Dr Francina Cantatore, Centre for Professional Legal.
Joint initiatives: Using a pro bono teaching clinic to prepare law students for legal practice and promote community service Dr Francina Cantatore.
Pro Bono Teaching Clinics: Collaborative Models for Promoting Law Graduate Employability Skills and Community Service Dr Francina Cantatore,
Presentation transcript:

MEASURING AND REPORTING IMPACT OF PRO BONO INITIATIVES TO STRENGTHEN ACCESS TO JUSTICE Dr Christopher Walsh Senior Research Analyst and Policy Advisor (BABSEA CLE) Associate Prof. of Education & Program Director (Torrens University Australia)

Overview Why measure impact? ‘Good’ key performance indicators. Sample survey questions. Characteristics of effective surveys. The survey is a critical instrument that clinics can use to measure their impact. Provide a data analysis plan and guidelines. Knowledge beautiful: Visually representing data for for stronger impact.

Why measure impact?

Measuring impact is the recognised way in which you show the value the CLE program is delivering to its beneficiaries and society as a whole. Surveys are an instrument that clinics themselves can use to measure their impact on future law professionals and advocates for justice. Why it matters? We want to know if the program had an impact and the average size of that impact. Pathway to more funding…

‘ Good’ key performance indicators (KPIs) A Key Performance Indicator (KPI) is a measurable value that demonstrates how effectively a clinic is achieving key access to justice objectives. Clinics can use KPIs to evaluate their success at reaching targets. Sample CLE program objective: To develop university law clinics that transform law students into knowledgeable, skilled, and ethical lawyers who: are sensitive to the injustices of the legal system for the poor and otherwise disadvantaged will either engage in public interest law themselves or support lawyers who do this work. So what is the KPI?

The KPI is a measurable value that demonstrates how effectively a clinic is achieving its stated objectives...or not...

Sample survey questions to measure whether the KPIs have been realised Strongly agreeAgreeDisagreeStrongly disagree I believe it is important for lawyers to provide pro bono services to poor or disadvantaged clients I will engage in pro bono work in the future You measure something measurable that is directly realated to the

The survey is a critical instrument that clinics can use to measure their impact But only if it is well designed well, easy to use and you REALLY know how to analyse the data collected… Himelein, K., Menzies, N., & Woolcock, M. (2010). Surveying justice : a practical guide to household surveys. Justice and development working paper series ; no. 11. Washington, DC: World Bank. 10/01/ /surveying-justice-practical- guide-household-surveys 10/01/ /surveying-justice-practical- guide-household-surveys

Characteristics of effective surveys 1. Collects sufficient demographic information 2. Is focused and to the point 3. Extremely clear questions 4. One part questions 5. Only use other or neutral when you can ask for explanation or further details 6. Logical sequencing of questions 7. Provide incentive to increase motivation (share results) 8. Know how you will analyses the results BEFORE you administer the survey

Provide/develop a data analysis plan and guidelines for data analysis (and use it!) to drive your survey design Otherwise you might not collect ‘good’ data… Survey monkey has great free advice!

Knowledge beautiful! Consider visually representing your data for for stronger impact and to make it accessible to diverse audiences

Did you have the opportunity to reflect on your experiences and discuss the impact of the law and legal system on clients and attendees with your supervisor and fellow students as part of a planned meeting or class?

How helpful was the classroom/training component in preparing you for the experiential component of the clinic?

Did your primary supervisor for the experiential component also teach in the classroom/training component?

In your country, as a lawyer can one do volunteer legal work (without pay, pro bono)?

Approximately what portion of the clinic’s clients or attendees at presentations were low income or otherwise unable to obtain legal assistance/information in your community?

My clinic was highly specialized in that we concentrated our work in one area of the law (eg. criminal, family law, employment law)

3 Key points to take away… 1. Surveys need extremely clear questions… 2. Develop a data analysis plan and guidelines for data analysis (and use it!) to drive your survey design 3. Ask, can I represent my data visually for greater impact?

Thank you