1. DARM 2013: Assessment and decision making
Mikko V. Pohjola, Nordem Oy, (THL)

2. Presenter background
M.Sc. (tech), University of Oulu, Industrial engineering and management, 2006
PhD student, University of Eastern Finland, Environmental health / SYTYKE,
Researcher, National Institute for Health and Welfare (THL),
Research consultant, Nordem Oy, 2012->
Also former work experience in consultancy entrepreneurship as well as industry

3. Contents Some practical things Homework 1 - basic concepts
Effectiveness of decisions and decision support?
Expert roles?
Aim: to understand the big picture on this course
(in order to understand how the more detailed/practical parts relate to the course topic as well as to your expertise)

4. Homework 1 regulatory and academic assessment approaches?
traditional and novel assessment approaches?
relevant stakeholders?
effectiveness?
decision support?
pragmatic knowledge service?
role of modelling?
framework for effective assessment and knowledge- based policy?
intentional artifacts?

5. Concepts Assessment – knowledge support for practical needs
Policy – decisions and actions with societal relevance
Practices – (common) ways of dealing with things
Effectiveness – capability (or likelihood) of achieving intended outcomes
Evaluation – analysis of the capability (or likelihood) of achieving intended outcomes

6. Decision analysis & risk management?
Extrapolation
Measurements and population characteristics
Hazard identification
Dose-response assessment
Exposure assessment
Risk characterization
Regulatory options
Evaluation of options
Decisions and actions
Risk assessment
Risk management
Observations

7. Assessment & decision making?
Policy making
Assessment
Implementation
Outcomes

8. Basic problem
Lankinen, et al.: State research institutes and research funding: proposal on a comprehensive reform:
“Preparation, decision-making and implementation of policy should be based on researched information and evidence.…the use of research- based information in social policy decision-making, must be strengthened”
If we want policy to be ”knowledge-based” and ”effective”…
…what constitutes effective knowledge-based policy?
and effective knowledge support to policy making?

9. Common perspectives to effectiveness
Assessment (and modeling)
Quality assurance / control
Uncertainty analysis
Technical assessment of models
”Effectiveness”
Other
Policy
Outcomes (vs. objectives)
Behavioral responses + CBA
Monitoring
Ex ante – ex post evaluation
Factors limiting implementation
Process
Use
Output
Constraints
Outcomes
Context
Modelling/assessment
Enablers

10. Framework for knowledge-based policy
(Knowledge) practices
Policy making
Assessment
Implementation
Outcomes
Guidance of action both now and in future.
Design: purposes, execution plan, evaluation measures
Execution: evaluation of implementation, evaluation of design, evaluation of means
Follow-up: overall evaluation (including all previous + outcomes)
Process
Product
Use
Interaction
Design
Execution
Follow-up
Evaluation &
management

11. Framework for knowledge-based policy
Focus on knowledge support to decision making
Decision makers' needs?
Societal needs?
Other needs?
Expert knowledge
Local knowledge
Opinions, views, perspectives, values
→ collaborative search for questions and answers

12. Engagement & Interaction

13. Collaboration & openness

14. Framework for knowledge-based policy
Evaluation and management of effectiveness -> proactive guidance of decisions and actions both now and in the future
Transparency & effectiveness
Dimensions of openness
Properties of good assessment
Relational evaluation approach

15. Transparency & effectiveness
Dimensions of openness
Scope of participation
Access to information
Timing of openness
Scope of contribution
Impact of contribution

16. Transparency & effectiveness
Properties of good assessment
Quality of content
Applicability
Relevance
Availability
Usability
Acceptability
Efficiency

17. Evaluation & management
Relative evaluation approach
Co-development of practices
Multiple perspectives
Evaluation of
Plan
Implementation
Outcomes

18. Conclusions
Pohjola M.V.: Assessments are to change the world - Prerequisites for effective environmental health assessment:
Common practices of environmental health assessment are insufficient. Policy decisions are not based on best available knowledge.
Collaboration, openness, practical problem framing, application of science also in development of solutions is needed in assessment- policy-society interaction.
Methods and tools of assessment as well as public attitudes already enable open, transparent and collaborative policy support. A cultural change in assessment and particularly policy making is still required.
The focus of future development shall be set particularly on developing practices of effective use of knowledge in policy making.

19. What is the role of experts (like you)?
Research, background knowledge
Substantive expertise, expert knowledge for assessments
Facilitation of decision support?
Opinions, lay person views? …?

20. Got answers now? regulatory and academic assessment approaches?
traditional and novel assessment approaches?
relevant stakeholders?
effectiveness?
decision support?
pragmatic knowledge service?
role of modelling?
framework for effective assessment and knowledge- based policy?
intentional artifacts?

21. Thank you!