Presentation is loading. Please wait.

Presentation is loading. Please wait.

NZSSES/ICSER Conference Defining and Evaluating ‘Science for Sustainability’ AIRP-SD Project Paul Weaver & Leo Jansen

Published byAlvin Douglas Modified over 9 years ago

Similar presentations

Presentation on theme: "NZSSES/ICSER Conference Defining and Evaluating ‘Science for Sustainability’ AIRP-SD Project Paul Weaver & Leo Jansen"— Presentation transcript:

1 NZSSES/ICSER Conference Defining and Evaluating ‘Science for Sustainability’ AIRP-SD Project Paul Weaver & Leo Jansen pweaver@noos.fr jansenleo@hetnet.nl

2 NZSSES/ICSER Conference AIRP-SD Goals Develop an approach for ex ante, concomitant and ex post evaluation of sustainability-oriented RTD programmes Describe innovative RTD approaches Identify good and bad practices Assess transferability of practice Establish programme design guidelines

3 NZSSES/ICSER Conference Toward an evaluation architecture Lack of theory and practice suggests need to develop both through an iterative, heuristic procedure –begin with tentative hypotheses about the nature of the research processes that might support SD; test/refine these through the evaluation process itself Need for externally-specified evaluation criteria Depends on establishing a conceptual model of sustainability-oriented RTD

4 NZSSES/ICSER Conference AIRP-SD Procedure Establish conceptual model of sustainability research Select case study research programmes/projects Describe research outcomes, designs, contexts Evaluate outcomes, design, context separately Relate research outcomes to design Relate design to context Relate outcomes to context Revise conceptual model Recommendations for research management and design Identify good practice

5 NZSSES/ICSER Conference Derive conceptual model from: the nature and concept of sustainable development the nature of the socio-ecological systems of interest the nature of SD challenges to science and society

6 NZSSES/ICSER Conference SD challenges Orientation and ambition - paradigm change - transition - prescriptive - normative - vision-led Complexity of socio-ecological systems of interest, indeterminacy, irreversibility, risk, precaution Multiple stakeholders, high stakes, uncertainty, non-market values Need to communicate with non-scientists

7 NZSSES/ICSER Conference Evaluation objects (outcomes) Outcomes Contribution to strategic orientation Contribution to solution set (quantity/quality) Contribution to strategic management Contribution to social capital Contribution to scientific capital and capacities Contribution to influencing society

8 NZSSES/ICSER Conference Evaluation objects (D&P) Design and Process Management and finance model Procedure for initiating/defining programme Research model (methods, tools, procedures) Procedure for handling risk and uncertainty Procedure and basis for decision making Procedure for communication & dissemination

9 NZSSES/ICSER Conference Evaluation objects (context) Context Established social capital Established RTD management capital Established scientific/research capital Extent & urgency of unsustainability or vulnerability Understanding & awareness of (un) sustainability across society

10 NZSSES/ICSER Conference Sustainability principles Global and systemic approaches Knowledge sharing and mutual learning Broad participation Environmental heritage Precaution / Action to prevent risk Resilience

11 NZSSES/ICSER Conference Sustainability principles (cont.) Transparency and justification of decision making Appropriate scale-issue relation Inter-generational equity Intra-generational equity

12 NZSSES/ICSER Conference AIRP-SD working hypotheses Hypothesis I A wide set of generic research outcomes can be identified and evaluated on a set of externally specified sustainability goals and criteria Hypothesis II Research designs and processes that conform strongly with the principles of sustainable development are likely to contribute to strong research outcomes Hypothesis III Contexts where sustainability problems or awareness is high are likely to facilitate SD research. Strong scientific/social capital in relation to SD challenges will facilitate SD research and strong outcomes

13 NZSSES/ICSER Conference Hypothesis IV CONTEXT Research design and process Research outcomes Research context, design/process and outcomes are connected in a loop

14 NZSSES/ICSER Conference Nine case studies ALR ATSD CUTS ECO-CYCLE HABIFORUM MAHRE SEP STD ZERI

15 NZSSES/ICSER Conference Fact finding versus evaluation Separate tasks Data collection – factual information – What? How? Who? Evaluation – analytical, judgmental – Whether? How well? Evaluative questions shape the mindset and background for fact-finding

16 NZSSES/ICSER Conference Methodological issues Restricted time-frame for analysis; some outcomes yet to emerge: interim outcomes, process-orientation Ambiguities; e.g., financing model: detailed specification and differentiation Subjectivity: consistent definitions, inter- subjectivity and cross-checking Depth vs breadth: encourage evaluation to enable validation in due course

17 NZSSES/ICSER Conference Multi-level approach (outcomes)

18 NZSSES/ICSER Conference Evaluation of each object Evaluate each outcome using SD goals Evaluate each D&P feature using SD principles Evaluate each context feature using SD challenges Strength (strong, weak, neutral) Direction (positive, negative)

19 NZSSES/ICSER Conference Evaluation of interrelations Evaluate influence of each D&P feature on outcomes Evaluate influence of each D&P feature on each other (synergies) Evaluate influence of context (context dependency, transferability) of each D&P feature Evaluate any RTD induced change in context

20 NZSSES/ICSER Conference Data analysis

21 NZSSES/ICSER Conference Results: good practices Initiation –stakeholder inventory/analysis –broad participation –re-conceptualisation, scope/goals Finance –co-funding arrangements –dedicated funds for re-conceptualisation, stakeholder participation, communication –phased funding arrangements

22 NZSSES/ICSER Conference Results: good practices (cont.) Management –internal learning (iterative, adaptive) –openness, transparency, accountability –continuous monitoring and quality assurance –re-defined set of success criteria Research –vision-led, system-based, long-term oriented, inter/trans-disciplinary, iterative –multi-functional approaches/tools

23 NZSSES/ICSER Conference Conclusions Importance of context Importance of structure and process Importance of goal setting Importance of SD principles Synergy among design features - need for thorough integration Feedback - practice makes perfect

24 NZSSES/ICSER Conference Defining and Evaluating ‘Science for Sustainability’ AIRP-SD Project Paul Weaver & Leo Jansen pweaver@noos.fr jansenleo@hetnet.nl

Download ppt "NZSSES/ICSER Conference Defining and Evaluating ‘Science for Sustainability’ AIRP-SD Project Paul Weaver & Leo Jansen"

Similar presentations

Towards a Culture of Disaster Prevention and Risk Management Andean Programme for the Prevention and Mitigation of Disasters.

Towards a Culture of Disaster Prevention and Risk Management Andean Programme for the Prevention and Mitigation of Disasters.
Linking regions and central governments: Indicators for performance-based regional development policy 6 th EUROPEAN CONFERENCE ON EVALUATION OF COHESION.

Linking regions and central governments: Indicators for performance-based regional development policy 6 th EUROPEAN CONFERENCE ON EVALUATION OF COHESION.
J. David Tàbara Institute of Environmental Science and Technology Autonomous University of Barcelona Integrated Climate Governance.

J. David Tàbara Institute of Environmental Science and Technology Autonomous University of Barcelona Integrated Climate Governance.
Consultative Group of Experts OTHER INFORMATION CONSIDERED RELEVANT TO THE ACHIEVEMENT OF THE OBJECTIVE OF THE CONVENTION Jack Fitzgerald Workshop on the.

Consultative Group of Experts OTHER INFORMATION CONSIDERED RELEVANT TO THE ACHIEVEMENT OF THE OBJECTIVE OF THE CONVENTION Jack Fitzgerald Workshop on the.
Thematic evaluation on the contribution of UN Women to increasing women’s leadership and participation in Peace and Security and in Humanitarian Response.

Thematic evaluation on the contribution of UN Women to increasing women’s leadership and participation in Peace and Security and in Humanitarian Response.
West Balkan Summer School on IEA – relevant feedback Second annual NRC FLIS meeting, 12-13 Nov 2013 Risto Jordanovski Ministry of Environment and Physical.

West Balkan Summer School on IEA – relevant feedback Second annual NRC FLIS meeting, Nov 2013 Risto Jordanovski Ministry of Environment and Physical.
European Qualifications Framework for Lifelong learning (EQF)

European Qualifications Framework for Lifelong learning (EQF)
First Evaluation of Good Governance for Medicines Programme 2004-2012 Brief Summary of Findings.

First Evaluation of Good Governance for Medicines Programme Brief Summary of Findings.
Decision Making Tools for Strategic Planning 2014 Nonprofit Capacity Conference Margo Bailey, PhD April 21, 2014 Clarify your strategic plan hierarchy.

Decision Making Tools for Strategic Planning 2014 Nonprofit Capacity Conference Margo Bailey, PhD April 21, 2014 Clarify your strategic plan hierarchy.
1 ESS Approach to Quality The revised Code of Practice and the new Quality Assurance Framework UN Statistical Commission's Learning Centre on National.

1 ESS Approach to Quality The revised Code of Practice and the new Quality Assurance Framework UN Statistical Commission's Learning Centre on National.
Introduction to Research

Introduction to Research
IFSA 2004 Workshop 5 Combined micro-economic and ecological assessment tools for sustainable rural development in the context of Farming Systems Analysis.

IFSA 2004 Workshop 5 Combined micro-economic and ecological assessment tools for sustainable rural development in the context of Farming Systems Analysis.
THE ROLE OF GOVERNMENT IN DISASTER RISK MANAGEMENT Arandjelovac, 5 th June 2015.

THE ROLE OF GOVERNMENT IN DISASTER RISK MANAGEMENT Arandjelovac, 5 th June 2015.
Standards and Guidelines for Quality Assurance in the European

Standards and Guidelines for Quality Assurance in the European
The ISO 9000 family of standards

The ISO 9000 family of standards
CSR Project, 3 cr. Corporate Responsibility, C-module (15 cr.) or free-choise studies Introduction to Corporate responsibility, 1,5-3 cr. (depending on.

CSR Project, 3 cr. Corporate Responsibility, C-module (15 cr.) or free-choise studies Introduction to Corporate responsibility, 1,5-3 cr. (depending on.
Plan © Plan Assessing programme effectiveness at the global level in a large and complex organisation Presentation delivered to the conference on Perspectives.

Plan © Plan Assessing programme effectiveness at the global level in a large and complex organisation Presentation delivered to the conference on Perspectives.
Unit 1, Overview of instructional Design Models1 Welcome to: Instructional Design Module Instructor Dr. Ahmed Abdelraheem ILTD Sultan.

Unit 1, Overview of instructional Design Models1 Welcome to: Instructional Design Module Instructor Dr. Ahmed Abdelraheem ILTD Sultan.
Urban-Nexus – Integrated Urban Management David Ludlow and Michael Buser UWE Sofia 17-18 November 2011.

Urban-Nexus – Integrated Urban Management David Ludlow and Michael Buser UWE Sofia November 2011.
Narrowing the Gap between Evaluation and Developmental Science: Implications for Evaluation Capacity Building Tiffany Berry, PhD Research Associate Professor.

Narrowing the Gap between Evaluation and Developmental Science: Implications for Evaluation Capacity Building Tiffany Berry, PhD Research Associate Professor.

Similar presentations

Ads by Google