Guide Jouni Tuomisto, Mikko Pohjola - National Institute for Health and Welfare - Department of Environmental Health – Finland Introduction: The world.

Slides:



Advertisements
Similar presentations
Critical Reading Strategies: Overview of Research Process
Advertisements

The Robert Gordon University School of Engineering Dr. Mohamed Amish
Copyright © 2008 Pearson Prentice Hall. All rights reserved Copyright © 2008 Prentice-Hall. All rights reserved. Committed to Shaping the Next.
Developing Arguments for the Science Classroom Kris Carroll CPDD Curriculum & Professional Development Division, Science Health & Foreign Language June,
Fit to Learn Using the Employability Skills Framework to improve your performance at College The Employability Skills Framework has been developed by business.
Writing for Publication
1. Profile Decision-making and risk assessment under uncertainty Special expertise on software project risk assessment Novel applications of causal models.
Scientific Research Dr. Noura Al-dayan.
MARLAP Measurement Uncertainty
15 de Abril de A Meta-Analysis is a review in which bias has been reduced by the systematic identification, appraisal, synthesis and statistical.
Dissemination and Critical Evaluation of Published Research Peg Bottjen, MPA, MT(ASCP)SC.
Learning with Bayesian Networks David Heckerman Presented by Colin Rickert.
introduction to MSc projects
Chapter 9: Introduction to the t statistic
The phases of research Dimitra Hartas. The phases of research Identify a research topic Formulate the research questions (rationale) Review relevant studies.
This chapter is extracted from Sommerville’s slides. Text book chapter
Office of Institutional Research, Planning and Assessment January 24, 2011 UNDERSTANDING THE DIAGNOSTIC GUIDE.
CSD 5100 Introduction to Research Methods in CSD First Day Opening Stretch Course Requirements/Syllabus What is Science? What is Research? The Scientific.
Term 2, 2011 Week 1. CONTENTS Types and purposes of graphic representations Spreadsheet software – Producing graphs from numerical data Mathematical functions.
VTT-STUK assessment method for safety evaluation of safety-critical computer based systems - application in BE-SECBS project.
Moodle (Course Management Systems). Assignments 1 Assignments are a refreshingly simple method for collecting student work. They are a simple and flexible.
Chapter 8 Introduction to Hypothesis Testing
Introduction to assessment performance Mikko Pohjola, THL.
06/10/2015 Presentation name / Author1 Evaluating assessment performance Mikko Pohjola, THL.
National Public Health Institute, Finland Pyrkilo – a modified risk assessment method Jouni Tuomisto National Public Health Institute (KTL)
Using wiki in Urgenche Jouni Tuomisto, THL. There is help for wikis and Opasnet People are not complaining enough! –Most wiki problems can be easily solved.
Shared understanding Jouni Tuomisto, THL. Outline What is shared understanding? Main properties Examples of use How does it make things different? Rules.
National Public Health Institute, Finland Open risk assessment Lecture 7: Evaluating assessment performance Mikko Pohjola KTL, Finland.
Open policy practice: open science- based assessments for decision-makers Jouni Tuomisto National Institute for Health and Welfare, Kuopio, Finland.
Decision analysis and risk management: Introduction to course Jouni Tuomisto, THL.
Introduction to assessment performance Mikko Pohjola, THL.
LEVEL 3 I can identify differences and similarities or changes in different scientific ideas. I can suggest solutions to problems and build models to.
Quantitative Project Risk Analysis 1 Intaver Institute Inc. 303, 6707, Elbow Drive S.W., Calgary AB Canada T2V 0E5
Sampling distributions rule of thumb…. Some important points about sample distributions… If we obtain a sample that meets the rules of thumb, then…
Presenting and Analysing your Data CSCI 6620 Spring 2014 Thesis Projects: Chapter 10 CSCI 6620 Spring 2014 Thesis Projects: Chapter 10.
National Public Health Institute, Finland Open Risk Assessment Lecture 2: General assessment framework Mikko Pohjola KTL, Finland.
10 Evaluating Clinical Trials. LIMITED LICENSE TO MODIFY. These PowerPoint® slides may be modified only by teachers currently teaching the SEPUP course.
DECISION MODELING WITH MICROSOFT EXCEL Chapter 14 Copyright 2001 Prentice Hall Publishers and Ardith E. Baker Part 3 andand PERT CPM.
Research Methodology Class.   Your report must contains,  Abstract  Chapter 1 - Introduction  Chapter 2 - Literature Review  Chapter 3 - System.
National Public Health Institute, Finland Open risk assessment Lecture 5: Argumentation Mikko Pohjola KTL, Finland.
Guide Background Climate mitigation policies in municipalities have global impacts on climate change, but the actual impacts on the municipalities themselves.
1 Chapter 12 Configuration management This chapter is extracted from Sommerville’s slides. Text book chapter 29 1.
LITERATURE REVIEW ARCHELLE JANE C. CALLEJO, PTRP,MSPH.
Fundamentals of Governance: Parliament and Government Understanding and Demonstrating Assessment Criteria Facilitator: Tony Cash.
National Public Health Institute, Finland Open risk assessment Lecture 5: Argumentation Mikko Pohjola KTL, Finland.
Now what? 1.  I have short-listed projects I am interested in  I know the types of projects I would like to pursue  I have an idea of the resources.
National Public Health Institute, Finland Open Risk Assessment Lecture 2: General assessment framework Mikko Pohjola KTL, Finland.
Unit 11: Evaluating Epidemiologic Literature. Unit 11 Learning Objectives: 1. Recognize uniform guidelines used in preparing manuscripts for publication.
Introduction to assessment performance Mikko Pohjola, THL.
Ideas on Selection and Approval of Models for EPA Regulatory Use by John S. Irwin EPA Eighth Conference on Air Quality Modeling September.
Artificial Intelligence, simulation and modelling.
Experimental Psychology PSY 433 Chapter 5 Research Reports.
Copyright © 2011 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 1 Research: An Overview.
Uncertainty and confidence Although the sample mean,, is a unique number for any particular sample, if you pick a different sample you will probably get.
#1 Make sense of problems and persevere in solving them How would you describe the problem in your own words? How would you describe what you are trying.
Anyone can solve common problems The world is packed with common problems awaiting for solutions - global warming, urban air pollution, contaminants in.
Decision support with online collaborative models Jouni Tuomisto THL, Kuopio.
Risk management: Facilitation of (open) risk management Mikko Pohjola, THL.
Decision analysis and risk management: Introduction to course Jouni Tuomisto, THL.
Decision support with online collaborative models Jouni Tuomisto THL, Kuopio.
Managing Data Resources File Organization and databases for business information systems.
Quantitative Methods for Business Studies
Jouni T. Tuomisto1, John S. Evans2, Arja Asikainen1, Pauli Ordén1
Experimental Psychology
Introduction to risk management
Open risk assessment Lecture 5: Argumentation
Navigating through TIDE
Quantitative Project Risk Analysis
Activating your account and navigating through TIDE
Activating Your Account and Navigating Through TIDE
Presentation transcript:

Guide Jouni Tuomisto, Mikko Pohjola - National Institute for Health and Welfare - Department of Environmental Health – Finland Introduction: The world is packed with common problems awaiting for solutions - global warming or urban air pollution to name a few. Many people would be willing to make an effort in solving these problems but so far have been lacking practical means to contribute. Open assessment is a method that aims to offer rules and practices for collecting and synthesising information by self-organised groups into useful pieces (or objects) of information to guide decisions. Information: shared questions and answers In open assessment, the information needed for making a decision is organised as an assessment that predicts the impacts of different decision options on some outcomes of interest. Decisions, outcomes, and other particular issues are modelled as distinct and self-standing information objects called variables. In practice, a variable is a pair of web pages (one for content about an issue, another for discussion about the content) in an open web-workspace Opasnet ( They contain all information (text, numerical values, and software code) needed to describe and actually run that part of an assessment model. Pages have a universal structure: a research question (what is the issue?), result (what is our current best answer?), and rationale (why do we believe in the answer?). Anyone can participate in reading, evaluating, and contributing to web page content just as in Wikipedia. The content reflects and communicates the shared understanding of the issue in the participating group. As the group gets larger and the contributions richer, the content asymptotically approaches the best current scientific knowledge about the issue. Inference rules: There are rules to manage discussions in an open assessment about a particular issue (documented on its discussion page) and then to decide what to believe about it (documented on its content page). Anyone can promote a statement about anything. A statement can be factual (what is?) or moral (what should be?) by nature. A promoted statement is considered valid unless it is invalidated (i.e., convincingly attacked with a valid statement). The validity of a statement is always conditional to a particular group (which is or is not convinced). Statements can be defended or attacked with other statements thus forming a hierarchical structure. When a discussion is resolved, all valid top-level statements are incorporated into the content page. All resolutions are provisional, and anyone can re-open a discussion. If there is uncertainty about whether a statement is true, the uncertainty is quantitatively measured with subjective probabilities. A priori beliefs are updated into a posteriori beliefs based on observations (in case of factual statements) or opinions (in case of moral statements) and open criticism that is based on rationality, relevance, and other shared rules. Mahdolliset yhteistyökumppanien yhteystiedot tulevat leipiksen loppuun erilliseen kappaleeseen. Mahdolliset yhteistyökumppanien yhteystiedot tulevat leipiksen loppuun. Arial Italic 36/46 pt. Figure 2. A discussion. The main statement is shown on top. Arguments (i.e., statements within a discussion) form a hierarchical structure. Green: defends, red: attacks, gray: invalidated arguments. Figure 1. Part of an open assessment page showing the variables included in the assessment as a causal diagram and as a list of links to more detailed pages. Kuva, graafi tai taulukko voi olla 3 palstan levyinen Open Assessment: developing shared understanding for practical use

Guide Teemu Rintala, Jouni T. Tuomisto, Einari Happonen, Juha Villman – National Institute for Health and Welfare - Department of Environmental Health – Finland Introduction Opasnet is a web-workspace for making impact assessments, especially open assessments. A main objective is that all work needed in an assessment can be performed using this single interface, whether it be information collection, numerical modelling, discussions, statistical analyses on original data, publishing original research results, peer review, organising and distributing tasks within a group, or dissemination of results to decision-makers. This poster briefly describes some of the existing functionalities. Main functionalities: wiki and database The user interface of Opasnet is an open wiki and it is in many respects similar to Wikipedia with content pages and discussion pages, with additional functionalities for structured discussions. Assessments consist of variables which are in practice self-standing Opasnet pages. Most variables have numerical values as results, often expressed as probability distributions. Opasnet has a database that can store very flexibly almost any results that can be expressed as two-dimensional tables. Results can be uploaded and downloaded using a respective Opasnet page as interface. Further, if one variable (B) is causally dependent on variable (A), the result of A can be automatically retrieved and used in a formula for calculating B using a simulation and modelling functionality based on statistical software R. Because Opasnet contains interconnected distributions of variables, it is also a very large Bayesian belief network, which can be used for assessment-level analyses and conditioning and optimising different decision options. Opasnet can be used to find optimal decision options and also to assess the value of further information for a particular decision. Other functionalities Opasnet contains functionalities for discussing and evaluating the content of Opasnet, in addition to the main purpose for discussing real-world phenomena. The most common form of these "meta-level" functionalities are rating bars on many Opasnet pages. Users can evaluate the scientific quality and usefulness of that page. This information can then be used by the assessors to direct further work or by readers to evaluate reliability of a page content. The users are also allowed to make peer reviews of pages. These are similar to peer reviews in scientific journals. Contribution scores can be used to estimate user contributions quantitatively, but more advanced methods are in development. Task functionality keeps task lists and sends notifications to users to whom tasks are assigned by others. Any information organised for any previous assessment is readily available for a new assessment on an analogous issue. Thus, the work time for data collection is reduced and efficiency is increased. If malevolent attacks occur, a content page can be protected without restricting the discussion about, or improvement of, the content on the related discussion page; the resolutions from the discussions are simply updated to the actual content on the issue page by a trusted moderator. Mahdolliset yhteistyökumppanien yhteystiedot tulevat leipiksen loppuun erilliseen kappaleeseen. Mahdolliset yhteistyökumppanien yhteystiedot tulevat leipiksen loppuun. Arial Italic 36/46 pt. Figure 1. R script written on a wiki page with related results. Opasnet functionalities for impact assessment Figure 2. An assessment page showing a toolbar on left and a metadata box on right. The box contains information about e.g. moderators, main contributors (optional), and user evaluations of the page content.