Risk management: From needs to knowledge, knowledge to action Mikko Pohjola, THL.

Slides:



Advertisements
Similar presentations
Exploring uncertainty in cost effectiveness analysis NICE International and HITAP copyright © 2013 Francis Ruiz NICE International (acknowledgements to:
Advertisements

Introduction to Research Methodology
Mr. Brooks Foundations of Technology.  Students will: ◦ Develop an understanding of the relationships among technologies and connections with other fields.
Introduction to assessment performance Mikko Pohjola, THL.
UIA Associations Round Table – Europe 2014 Dublin, November 2014 Achieving impact and finding the funds Dr Dragana Avramov PSPC, Brussels 14/11/2014www.avramov.org1.
RESEARCH METHODS Introduction to Research Lecture 1:
DECO3008 Design Computing Preparatory Honours Research KCDCC Mike Rosenman Rm 279
Inquiry and Critical Thinking 1.Analyze problems, articulate questions or hypotheses, and determine the need for information 2. Access and collect the.
SUNITA RAI PRINCIPAL KV AJNI
Health Systems and the Cycle of Health System Reform
Science Inquiry Minds-on Hands-on.
FAO/WHO CODEX TRAINING PACKAGE
The Research Problem and Objectives Lecture 6 1. Organization of this lecture Research Problem & Objectives: Research and Decision/Action Problems Importance.
Creating the relationship between good science and informed policy John C. Tracy, Director Idaho Water Resources Research Institute University of Idaho.
Risk management: State-of-the-art? Mikko Pohjola, THL.
Risk management: A social learning perspective? Mikko Pohjola, THL.
Margaret J. Cox King’s College London
Application of toxicological risk assessment in the society Jouni Tuomisto, THL, Kuopio.
Introduction to assessment performance Mikko Pohjola, THL.
06/10/2015 Presentation name / Author1 Evaluating assessment performance Mikko Pohjola, THL.
National Public Health Institute, Finland Pyrkilo – a modified risk assessment method Jouni Tuomisto National Public Health Institute (KTL)
Management of assessments and decision making: execution, facilitation, evaluation Mikko V. Pohjola, Nordem Oy (THL)
Guide Jouni Tuomisto, Mikko Pohjola - National Institute for Health and Welfare - Department of Environmental Health – Finland Introduction: The world.
Introduction to risk management Jouni Tuomisto, Mikko Pohjola THL.
Shared understanding Jouni Tuomisto, THL. Outline What is shared understanding? Main properties Examples of use How does it make things different? Rules.
Risk management: State-of-the-art? Mikko Pohjola, THL.
Open policy practice: open science- based assessments for decision-makers Jouni Tuomisto National Institute for Health and Welfare, Kuopio, Finland.
Introduction to risk management Jouni Tuomisto, Mikko Pohjola THL.
Introduction to assessment performance Mikko Pohjola, THL.
Lesson Overview 1.2 Science in Context.
Introduction to risk management Jouni Tuomisto, Mikko Pohjola THL.
Module 3 Risk Analysis and its Components. Risk Analysis ● WTO SPS agreement puts emphasis on sound science ● Risk analysis = integrated mechanism to.
RE - SEARCH ---- CAREFUL SEARCH OR ENQUIRY INTO SUBJECT TO DISCOVER FACTS OR INVESTIGATE.
 Knowledge management is managing the organization’s knowledge by means of systematic and organized processes.  For acquiring, organizing, sustaining,
Scientific Inquiry by:. Icebreaker “Scientific Inquiry refers to the diverse ways in which scientists study the natural world and propose explanations.
18/11/2015 Presentation name / Author1 Assessments – science-based decision support Mikko Pohjola, THL.
Copyright © 2011 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 5 Theory, Research, and Evidence-Based Practice.
Introduction to risk management Jouni Tuomisto, Mikko Pohjola THL.
Shared understanding Jouni Tuomisto, THL. Outline What is shared understanding? Main properties Examples of use How does it make things different? Rules.
National Public Health Institute, Finland Open Risk Assessment Lecture 2: General assessment framework Mikko Pohjola KTL, Finland.
DARM 2013: Assessment and decision making Mikko V. Pohjola, Nordem Oy, (THL)
National Public Health Institute, Finland Open risk assessment Lecture 5: Argumentation Mikko Pohjola KTL, Finland.
Royal Irish Academy Briefing Bert Rima 109/01/2016.
Application of toxicological risk assessment in the society Jouni Tuomisto, THL, Kuopio
National Public Health Institute, Finland Open risk assessment Lecture 5: Argumentation Mikko Pohjola KTL, Finland.
The Research Problem and Objectives Lecture 6 1. Organization of this lecture Research Problem & Objectives: Research and Decision/Action Problems Importance.
National Public Health Institute, Finland Open Risk Assessment Lecture 2: General assessment framework Mikko Pohjola KTL, Finland.
Building Blocks of Scientific Research Chapter 5 References:  Business Research (Duane Davis)  Business Research Methods (Cooper/Schindler) Resource.
Introduction to assessment performance Mikko Pohjola, THL.
ABRA Week 3 research design, methods… SS. Research Design and Method.
What is Research?. Intro.  Research- “Any honest attempt to study a problem systematically or to add to man’s knowledge of a problem may be regarded.
Copyright © 2011 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 1 Research: An Overview.
Stage 1 Integrated learning Coffee Shop. LEARNING REQUIREMENTS The learning requirements summarise the knowledge, skills, and understanding that students.
Risk management: Facilitation of (open) risk management Mikko Pohjola, THL.
The trend and/or issue of 'Cotton Wool Kids'. ‘Critical Evaluation” is the process of making informed and valid judgements or conclusions supported.
Abstract A step-wise or ‘tiered’ approach has been used as a rational procedure to conduct environmental risk assessments in many disciplines. The Technical.
Organizations of all types and sizes face a range of risks that can affect the achievement of their objectives. Organization's activities Strategic initiatives.
Decision analysis and risk management: Introduction to course Jouni Tuomisto, THL.
Evolving Best Practice in Governance Policy Developing Consumer Confidence in Risk Analysis Applied to Emerging Technologies Department of food science.
Application of toxicological risk assessment in the society
DARM 2013: Assessment and decision making
AF1: Thinking Scientifically
Introduction to risk management
Impact assessment and decision making
Open risk assessment Lecture 5: Argumentation
CASE STUDY BY: JESSICA PATRON.
Application of toxicological risk assessment in the society
Considerations in Development of the SBSTA Five Year Programme of Work on Adaptation Thank Mr. Chairman. Canada appreciates this opportunity to share.
Curriculum and Philosophy
European Commission, DG Environment Air & Industrial Emissions Unit
Presentation transcript:

Risk management: From needs to knowledge, knowledge to action Mikko Pohjola, THL

Contents Lecture Round-up of (open) EHRM Development of shared beliefs to guide action Discussion Agumentation on the use/ban of Pandemrix

Round-up of (open) EHRM

Round-up EHRM is “the practice of organizing decision making and taking actions upon known and perceived risks to environment and health” i.e. trying to influence what actually happens regarding risks Many factors drive RM - systematic science-based decision support (assessments) is one of them Is or should it be the most important/influential?

Societal setting for RA/RM Risk assessment is collection, synthesis and interpretation of scientific information and value judgments for use of the society Risk management is use and implementation of that information

Round-up Systematic RM identifies needs for assessments and implements knowledge from assessments (and elsewhere) to practice Basically the aim of assessment and management is (or should be!) the same: good societal decisions and actions -> Decision-oriented assessment (DA)

Risk analysis Risk assessmentRisk management Hazard identification Exposure assessment Dose- response assessment Options generation Policy selection & implementation Policy effect evaluation Options evaluation Risk characterization Lessons from the KTL Centre of excellence in environmental health risk analysis

Does risk analysis pay off? Risk assessmentRisk management Hazard identification Exposure assessment Dose-response assessment Risk communication Options generation Policy selection & implementation Policy effect evaluation Options evaluation Risk characterization Million euro cycle Billion euro cycle

General RA/RM framework Systematic analysis according to societal needs

Why do we do modelling? (2) Decision options are difficult to compare. Models can summarise important points and help us choose.

Round-up EH is complex in many ways Causes, effects, actors, roles, relations, … Physical, chemical, biological, social, technological, economical, political, … Many approaches exist, most confine themselves to certain specifics of EH Useful within their own boundaries, but not sufficient to address all complexity of EH

NRC: Red book Extrapolation Measurements and population characteristics Hazard identification Dose-response assessment Exposure assessment Risk characterization Regulatory options Evaluation of options Decisions and actions Risk assessmentRisk management Observations NRC Risk Assessment in the Federal Government: Managing the Progress. The National Research Council. National Academy Press, Washington D.C.

REACH – EU Chemical safety Hazard assessment ▪ Hazard identification ▪ Classification & labeling ▪ Derivation of threshold levels ▪ PBT/vPvB assessment Exposure assessment ▪ Exposure scenarios building ▪ Exposure estimation Risk characterisation Information: available vs. required/needed ▪ Substance intrinsic properties ▪ Manufacture, use, tonnage, exposure, risk management Dangerous or PBT/vPvB Risk controlled noyes noyes Iteration Chemical safety report ECHA Guidance on Information Requirements and Chemical Safety Assessment. Guidance for the Implementation of REACH.

Round-up The traditional model of separating expert, decision maker and stakeholder/public contributions does not serve “knowledge-based societal actions upon issues relevant to environment and health” optimally Well-reasoned, sustainable policies & practices? Influence of assessment on policy/practice? Meaningfulness/effectiveness of participation?

Purposes for participation Other factors Assessment Participation Outcome Decision making

IDEA framework (IEHIA/INTARESE) Briggs: A framework for integrated environmental health impact assessment of systemic risks. Environmental Health 2008, 7:61.

Round-up EXAMPLE: climate change is a major (and extremely complex) environmental health issue Think of e.g. CC related decision making and actions in the City of Kuopio What risks are related? What causes (for risks) are there? What effects do they have? Whose actions relate to the causes? Who are influenced by the effects? Who can influence (manage) the risks? How? Who are relevant actors regarding the risks? On what basis does/should they act upon the risks? Do common/traditional assessment/management approaches serve the needs of CC related DM?

Round-up No common solid theory for EHRM exists Common frameworks are mostly procedural and oversimplified Reality of RM is sometimes far from what is imag(in)ed in EHRM and assessment frameworks A proper theory should better …recognize the nature of actual needs …serve the plurality of ways to address the needs …be applicable across the whole range of needs, from the simplest to the most complex

EHRM framework The Presidential / Congressional commission on Risk Assessment and Risk Management: Final Report Volume 1, 1997.

NRC: Science and decisions (Silver book) NRC Science and Decisions: Advancing Risk Assessment. The National Research Council. National Academy Press, Washington D.C.

Round-up Change is needed… …and it is already starting to happen Assessment-management-stakeholders intertwined Practice-driven (needs-driven) search for knowledge Broad scoping: EH issues inherently within a broader context Opinions and values as valid inputs Success determined according to outcomes

Research question for open risk management How can scientific information and value judgements be organised for improving societal situations by identifying potential decisions and relevant outcomes in a situation where open participation is allowed? Emphasis: The decision situation should be clarified.

Research question for open assessment How can scientific information and value judgements be organised for improving societal decision- making in a situation where open participation is allowed? Emphasis: The decision situation is clear, focus on evaluating and choosing good options.

Open risk management: overview QRAQRA

Round-up Methods, tools and practices to enable ORM/OA are being developed Collaborative learning Technical support for: Collective knowledge creation (=learning) Implementation of knowledge …in a social context, for practical needs E.g. Opasnet

Three metaphors of learning

Round-up (increased) openness becoming easier to reason for and easer to be accepted, but many hindrances exist in practice A cultural change is needed Plenty of examples come up everyday Purpose Method System OutcomeUse

Round-up From Process-centeredness Separation and disengagement Narrow scopes Individual learning (monologue) Producing and sharing information (dialogue) Curiosity-driven question setting …

Round-up Towards Focusing on content Openness (in all its aspects) Rich contextuality and situatedness Collaboration, co-creation of knowledge (trialogue) Practice/needs-driven questions Outcome-orientation …

Open risk management A collaborative game of questions and answers Experts PublicStakeholders Decision makers Other influence Outcome

Opasnet Assessment Participant’s knowledge Participant’s updated knowledge Updated assessment Participant’s updated knowledge Decision Decision making Perception Contribution Pohjola et al. State of the art in benefit- risk analysis: Environmental health. Manuscript.

Outcome-oriented modelling approach Matthews et al.: Raising the bar? – The challenges of evaluating the outcomes of environmental modelling and software. Environmental Modelling & Software, March 2011, Pages

Properties of good assessment

Round-up summary/conclusions In the end it is all about developing well-founded shared belief systems to guide actions upon issues with great societal relevance Intentionally created collective knowledge is a means towards (collectively) desired ends

Example: what makes a good hammer?

Development of shared belief systems

Science and shared belief systems Falsification and “scientific method” Justified true belief and its problems Inference rules Shared belief systems Shared belief systems as artifacts (intentionally produced objects) Hypothesis development and testing Abductive reasoning and argumentation Game of questions and answers Evaluation of page content in Opasnet

Different ways of sharing knowledge in a group Live discussion Written discussion Formal argumentation Quantitative model  There is a need for tools that bring these different ways closer and make it easier to cross the barriers.

Objective: improve action as much as possible Does not require that everybody understand the knowledge, as long as the knowledge guides them. It is enough that people accept and act based on the outcome of a discussion by the group, even if they don’t know the details, understand them, or even agree with them. Example: Pandemrix use?Pandemrix use?

Scientific method: steps Mathematical method Scientific method 1Understanding Characterization from experience and observation 2AnalysisHypothesis: a proposed explanation 3Synthesis Deduction: prediction from the hypothesis 4ReviewReview/ExtendExtendTest and experiment George Polya in

Inference rules: axioms and concepts. Axioms of open assessment define the things that cannot be verified by observation, so there is no other way to know but just to believe. Axioms of open assessment Statement is a presentation of opinion or position about something that is (ie., a scientific statement) or something that should be (ie., a moral statement). Statement A group in open assessment means one or more individuals who participate in some activity, e.g. performing or reading an assessment.groupopen assessment A belief system is a collection of statements that are considered valid by a person or group.belief systemstatementsgroup A belief system that is considered valid by a group is called a shared belief system.group shared belief system

Discussion rules in practice An argument is valid if it is promoted and not attacked by a valid argument. The order of arguments: 1.Valid attacking arguments 2.Invalid attacking arguments 3.Valid defending arguments 4.Invalid defending arguments 5.Comments and branches

Successful attacks Successful attacks are based on arguments showing that the attacked statement – is not true or – is not relevant in its context and – the attacking argument itself is not attacked. Note: if a statement is weak – it is easier to defend – it has smaller impact on the resolution.  Try to optimise the strength of your statements.

Inference rules (1/2) Anyone can promote a statement about anything.statement A promoted statement is considered valid unless it is invalidated (i.e., convincingly shown not to be true, or successfully attacked).statement A priori beliefs are updated into a posteriori beliefs based on and only on – observations (in case of scientific statements) orstatements – opinions (in case of moral statements) andstatements – open criticism that is based on shared rules. In practice, this means the use of scientific method. open criticismscientific method There may be uncertainty about whether a statement is true. This can be quantitatively measured with subjective probabilities.uncertaintystatementsubjective probabilities There can be other rules than these inference rules for deciding what a group should believe. Rules are treated as statements.groupstatements The validity of a statement is always conditional to a particular group.statement group

Inference rules (2/2) If two people within a group promote conflicting statements, the a priori belief is that each statement is equally likely to be true.group A statement always has a field in which it can be applied. By default, a scientific statement applies in the whole universe and a moral statement applies within a group that considers it valid.statement Two moral statements by a single group may be conflicting only if the fields of application do not overlap.statements Opinions of each person are given equal weight.

Evaluation of page content in Opasnet

Discussion Argumentation on use/ban of Pandemrix