DARM 2013: Assessment and decision making Mikko V. Pohjola, Nordem Oy, (THL)

Presenter background M.Sc. (tech), University of Oulu, Industrial engineering and management, 2006 PhD student, University of Eastern Finland, Environmental health / SYTYKE, 2007-2012 Researcher, National Institute for Health and Welfare (THL), 2006-2011 Research consultant, Nordem Oy, 2012-> Also former work experience in consultancy entrepreneurship as well as industry

Contents Some practical things Homework 1 - basic concepts Effectiveness of decisions and decision support? Expert roles? Aim: to understand the big picture on this course (in order to understand how the more detailed/practical parts relate to the course topic as well as to your expertise)

Homework 1 regulatory and academic assessment approaches? traditional and novel assessment approaches? relevant stakeholders? effectiveness? decision support? pragmatic knowledge service? role of modelling? framework for effective assessment and knowledge- based policy? intentional artifacts?

Concepts Assessment – knowledge support for practical needs Policy – decisions and actions with societal relevance Practices – (common) ways of dealing with things Effectiveness – capability (or likelihood) of achieving intended outcomes Evaluation – analysis of the capability (or likelihood) of achieving intended outcomes

Decision analysis & risk management? Extrapolation Measurements and population characteristics Hazard identification Dose-response assessment Exposure assessment Risk characterization Regulatory options Evaluation of options Decisions and actions Risk assessment Risk management Observations

Assessment & decision making? Policy making Assessment Implementation Outcomes

Basic problem Lankinen, et al.: State research institutes and research funding: proposal on a comprehensive reform: “Preparation, decision-making and implementation of policy should be based on researched information and evidence.…the use of research- based information in social policy decision-making, must be strengthened” If we want policy to be ”knowledge-based” and ”effective”… …what constitutes effective knowledge-based policy? and effective knowledge support to policy making?

Common perspectives to effectiveness Assessment (and modeling) Quality assurance / control Uncertainty analysis Technical assessment of models ”Effectiveness” Other Policy Outcomes (vs. objectives) Behavioral responses + CBA Monitoring Ex ante – ex post evaluation Factors limiting implementation Process Use Output Constraints Outcomes Context Modelling/assessment Enablers

Framework for knowledge-based policy (Knowledge) practices Policy making Assessment Implementation Outcomes Guidance of action both now and in future. Design: purposes, execution plan, evaluation measures Execution: evaluation of implementation, evaluation of design, evaluation of means Follow-up: overall evaluation (including all previous + outcomes) Process Product Use Interaction Design Execution Follow-up Evaluation & management

Framework for knowledge-based policy Focus on knowledge support to decision making Decision makers' needs? Societal needs? Other needs? Expert knowledge Local knowledge Opinions, views, perspectives, values → collaborative search for questions and answers

Engagement & Interaction

Collaboration & openness

Framework for knowledge-based policy Evaluation and management of effectiveness -> proactive guidance of decisions and actions both now and in the future Transparency & effectiveness Dimensions of openness Properties of good assessment Relational evaluation approach

Transparency & effectiveness Dimensions of openness Scope of participation Access to information Timing of openness Scope of contribution Impact of contribution

Transparency & effectiveness Properties of good assessment Quality of content Applicability Relevance Availability Usability Acceptability Efficiency

Evaluation & management Relative evaluation approach Co-development of practices Multiple perspectives Evaluation of Plan Implementation Outcomes

Conclusions Pohjola M.V.: Assessments are to change the world - Prerequisites for effective environmental health assessment: Common practices of environmental health assessment are insufficient. Policy decisions are not based on best available knowledge. Collaboration, openness, practical problem framing, application of science also in development of solutions is needed in assessment- policy-society interaction. Methods and tools of assessment as well as public attitudes already enable open, transparent and collaborative policy support. A cultural change in assessment and particularly policy making is still required. The focus of future development shall be set particularly on developing practices of effective use of knowledge in policy making.

What is the role of experts (like you)? Research, background knowledge Substantive expertise, expert knowledge for assessments Facilitation of decision support? Opinions, lay person views? …?

Got answers now? regulatory and academic assessment approaches? traditional and novel assessment approaches? relevant stakeholders? effectiveness? decision support? pragmatic knowledge service? role of modelling? framework for effective assessment and knowledge- based policy? intentional artifacts?

Thank you!