SIMO SIMulation and Optimization ”New generation forest planning system” 15.11.2005 Antti Mäkinen & Jussi Rasinmäki Dept. of Forest Resource Management.

Slides:



Advertisements
Similar presentations
Provenance-Aware Storage Systems Margo Seltzer April 29, 2005.
Advertisements

DOCUMENT TYPES. Digital Documents Converting documents to an electronic format will preserve those documents, but how would such a process be organized?
Chapter 10: The Traditional Approach to Design
Systems Analysis and Design in a Changing World, Fifth Edition
Chapter 13 Review Questions
1 XML Web Services Practical Implementations Bob Steemson Product Architect iSOFT plc.
DETAILED DESIGN, IMPLEMENTATIONA AND TESTING Instructor: Dr. Hany H. Ammar Dept. of Computer Science and Electrical Engineering, WVU.
SOFTWARE TESTING. INTRODUCTION  Software Testing is the process of executing a program or system with the intent of finding errors.  It involves any.
©Silberschatz, Korth and Sudarshan4.1Database System Concepts Lecture-1 Database system,CSE-313, P.B. Dr. M. A. Kashem Associate. Professor. CSE, DUET,
Tutorial 12: Enhancing Excel with Visual Basic for Applications
Traditional Approach to Design
Chapter 10 The Traditional Approach to Design
Chapter 9: The Traditional Approach to Design Chapter 10 Systems Analysis and Design in a Changing World, 3 rd Edition.
University of Leeds Department of Chemistry The New MCM Website Stephen Pascoe, Louise Whitehouse and Andrew Rickard.
DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):
Testing an individual module
Supplement 02CASE Tools1 Supplement 02 - Case Tools And Franchise Colleges By MANSHA NAWAZ.
BUSINESS DRIVEN TECHNOLOGY
Software Issues Derived from Dr. Fawcett’s Slides Phil Pratt-Szeliga Fall 2009.
DBMS1 Database Management System (DBMS) Introductory Concepts Week-1.
The Academy of Public administration under the President of the Republic of Uzbekistan APPLICATION MODERN INFORMATION AND COMMUNICATION TECHNOLOGY IN DECISION.
TIBCO Designer TIBCO BusinessWorks is a scalable, extensible, and easy to use integration platform that allows you to develop, deploy, and run integration.
LAYING OUT THE FOUNDATIONS. OUTLINE Analyze the project from a technical point of view Analyze and choose the architecture for your application Decide.
9 Feb 2004Mikko Mäkinen & Saija Ylönen Joint UNECE/Eurostat/OECD work session on statistical metadata (METIS) Geneva, 9-11 February 2004, Topic (ii): Metadata.
Database System Concepts, 5th Ed. ©Silberschatz, Korth and Sudarshan See for conditions on re-usewww.db-book.com Chapter 1: Introduction.
Irwin/McGraw-Hill Copyright © 2004 The McGraw-Hill Companies. All Rights reserved Whitten Bentley DittmanSYSTEMS ANALYSIS AND DESIGN METHODS6th Edition.
Database Design - Lecture 1
DBS201: DBA/DBMS Lecture 13.
6-1 DATABASE FUNDAMENTALS Information is everywhere in an organization Information is stored in databases –Database – maintains information about various.
Concept demo System dashboard. Overview Dashboard use case General implementation ideas Use of MULE integration platform Collection Aggregation/Factorization.
Adapting Legacy Computational Software for XMSF 1 © 2003 White & Pullen, GMU03F-SIW-112 Adapting Legacy Computational Software for XMSF Elizabeth L. White.
COMP 410 & Sky.NET May 2 nd, What is COMP 410? Forming an independent company The customer The planning Learning teamwork.
Event Driven Programming
ICT Technologies Session 2 4 June 2007 Mark Viney.
Session IV - Use of administrative data for data collection - Statistics Belgium Geneva, 31 October – 2 November.
©Ian Sommerville 2000 Software Engineering, 6th edition. Chapter 10Slide 1 Architectural Design l Establishing the overall structure of a software system.
SWE © Solomon Seifu CONSTRUCTION. SWE © Solomon Seifu Lesson 13-2 Testing.
Chapter 9 Moving to Design
RELATIONAL FAULT TOLERANT INTERFACE TO HETEROGENEOUS DISTRIBUTED DATABASES Prof. Osama Abulnaja Afraa Khalifah
Generic Approaches to Model Validation Presented at Growth Model User’s Group August 10, 2005 David K. Walters.
An Approach To Automate a Process of Detecting Unauthorised Accesses M. Chmielewski, A. Gowdiak, N. Meyer, T. Ostwald, M. Stroiński
Storing Organizational Information - Databases
SIMO SIMulation and Optimization ”New generation forest planning system” Antti Mäkinen Dept. of Forest Resource Management / University of Helsinki.
COMU114: Introduction to Database Development 1. Databases and Database Design.
McGraw-Hill/Irwin © 2008 The McGraw-Hill Companies, All Rights Reserved Chapter 7 Storing Organizational Information - Databases.
Semantic Web Technologies Research Topics and Projects discussion Brief Readings Discussion Research Presentations.
CSC 480 Software Engineering Lecture 18 Nov 6, 2002.
Introduction to Software Project Estimation I (Condensed) Barry Schrag Software Engineering Consultant MCSD, MCAD, MCDBA Bellevue.
Software Development Problem Analysis and Specification Design Implementation (Coding) Testing, Execution and Debugging Maintenance.
SIMO Python/XML Simulator Current situation 28/10/2005 SIMO Seminar Antti Mäkinen Dept. of Forest Resource Management / University of Helsinki.
© 2013, published by Flat World Knowledge Chapter 10 Understanding Software: A Primer for Managers 10-1.
Mantid Stakeholder Review Nick Draper 01/11/2007.
Faculty Advisor – Dr. Suraj Kothari Client – Jon Mathews Team Members – Chaz Beck Marcus Rosenow Shaun Brockhoff Jason Lackore.
Review of Parnas’ Criteria for Decomposing Systems into Modules Zheng Wang, Yuan Zhang Michigan State University 04/19/2002.
Adrian Jackson, Stephen Booth EPCC Resource Usage Monitoring and Accounting.
Software Engineering Issues Software Engineering Concepts System Specifications Procedural Design Object-Oriented Design System Testing.
Systems Development Lifecycle
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Software Architecture Patterns (3) Service Oriented & Web Oriented Architecture source: microsoft.
Systems Analysis and Design in a Changing World, Fourth Edition
Software Testing.
Software Testing.
Database System Concepts and Architecture
Software Testing Techniques
Physical Data Model – step-by-step instructions and template
Database Management System (DBMS)
Database Systems Chapter 1
Lecture 1: Multi-tier Architecture Overview
An Introduction to Software Architecture
Metadata The metadata contains
Presentation transcript:

SIMO SIMulation and Optimization ”New generation forest planning system” Antti Mäkinen & Jussi Rasinmäki Dept. of Forest Resource Management / University of Helsinki

Need for new planning system? Forestry databases maintained in Finland mostly collected either with National Forest Inventory compartment-wise inventory Current forest management planning packages are designed to suit these two data sets Stand volume, timber assortments and growth are predicted using single tree models In the future the data sources are much more variable, including data from several grain levels → Need for new planning tools

Aims of SIMO ”FLEXIBLE with respect to data it demands and models that it uses” ”ADAPTABLE to the planning problem” “EXTENDABLE for possible future needs” “provide decision support for different grain levels”

Aims of SIMO continued To produce a set of lightweight program modules, which the users can interface into their planning systems Modules should be adaptable to different planning tasks and needs Simulation parameters can be (easily) controlled by the user Simulations can be locally calibrated Uncertainty in the data can be taken into account

Aims of SIMO continued New models can be implemented by the user Possibility to utilize different data sources Planning system is not a ”black box” – user should know what happens inside the program Inconsistent or erroneus data can be handled, but the user will be informed precisely

SIMO software development The core elements of the planning system will be produced in this project (no user interfaces) All the products will be open-source code (MIT license) The users will handle the integration into their own systems At the moment the simulator module is well underway and other modules under construction

SIMO Simulator Simulator module consists of: simulator core (the simulator program) XML files (data, simulation control, simulation logic etc.) Model library (all the models, functions etc. used in the simulations) ”Business logic” and ”Application logic” separated Other modules will be produced and integrated into the system

Simulator core  Intakes simulation control instructions, model chains, model definitions and data in XML format  Processes the user defined model chains for each computing unit in the data  Calls the Model Library whenever some value needs to be calculated  Prints the resulting values into a result XML file  The programmatic component, contains the application logic

XML Files (eXtended Markup Language)  ”Syntax definition which can be used to express hierarchical data”  Platform independent, self-describing  In SIMO, XML is used for the ”business logic”:  Passing data in and out of simulator (Data XML)  Passing simulation instructions (Simulation XML)  Encoding the simulation logic (Model Chain XML)  Passing information of the models and variables to the simulator (Model XML and Variable XML)

data comp_unit value variable attr … … value variable attr stratum value variable attr … value variable attr … stratum tree … value variable attr …

model_chain evaluate_at task expression condition … model variable value expression condition task variable value … task expression condition model variable value

Model Library  Includes all models used in the simulator  Users can add new models to the library or create additional model libraries  Reports warnings and errors to the simulator  Risk level models not yet implemented

Missing modules  Optimizer module Finds the best alternative from the alternatives generated by the simulator Possibly many alternative optimizing methods?  Validator module Validates the XML files with XSD (Schema) files and by external rules Makes sure that the XML files are well-formed and contain all necessary elements

Strengths of SIMO XML Simulator  Virtually any kind of model can be used in the simulations and added to the model library  User can define the model chains freely for different kinds of simulations  User can define correction/rectification factors for the models, (eg. different factors for geographical areas)  Extensive warning and error reporting system (risk control coming later...)  Data levels are not confined to strict predifined standard

What can be calculated at the moment? Estimating forest variable development at both stand level & tree level is possible at the moment (300+ models implemented), but  Forestry operations not yet implemented in the simulator → ”real world” simulations not yet possible  Bucking models still not ready  Optimizing module still missing

How the simulation process works in SIMO? XML Files SIMULATOR MODEL LIBRARY Reporter Module IN: data, simulation control, modelchains, model definitions OUT: results IN: modelname, input variables OUT: model result, warnings & errors IN: XML data OUT: transformed XML, graphs SIMULATION PROCESS

What is missing? XML Files SIMULATOR MODEL LIBRARY Reporter Module Optimizer Module MODEL LIBRARY Validator Module

Reporting Module  Used for visualizing data & transforming the results from XML format to other formats  Intakes data and processing instructions in XML format  At the moment can plot different kinds of graphs of given variables  XML transformations to be implemented later...

Model risk management Two levels 1. Individual parameter values out of bounds 2. All individual parameter values acceptable, but is the specific combination of them acceptable? Case 1: already in the simulator Case 2: Suggestion 1. get the k nearest neighbours from the VMI data, 2. evaluate the model for the data point and the k nearest neighbours. 3. If the difference for the model estimate between the data point and the neighbours is too big, generate an event of ”unacceptable” model estimate

Isn’t that procedure too heavy computationally? Probably, not yet evaluated But what about if we store the risk evaluation results and use those primarily: 1. Is it safe to call ModelA with parameters (5, 6, 10) when we accept risk level X? 2. Has the risk been evaluated with parameter values (5,6,10) and risk level X before. If yes, get the answer from a table of risk evaluations 3. If not, get k nearest neighbours for data point (5,6,10), evaluate the model with (5,6,10) and k neighbours 4. Store the risk evaluation result and the mean model result for k neighbours for the data point (5,6,10) and risk level X

Open questions: When evaluating model result shall we compare it to: values derived directly from the nearest VMI permanent sample plots OR model estimates for the nearest VMI sample plots?

Software license for SIMO Types of Open Source licenses MIT & Co: “Do whatever you want” LGPL: “Everything you do to the original code must be open source, anything on top of that can be closed” GPL & Co: “Everything you do is open source, …well almost” GPL under the hood: "derivative work" or "mere aggregation“? Derivative work must be open source, but aggregation can be closed source

The case of MySQL Double licensing: open source GPL, commercial development with a commercial license that allows closed source

General software architecture Individual components that communicate over the network Validator Simulator – this is well underway Optimiser Reporter – simulation results to figures and other data formats than XML, or different XML format etc. Implications to licensing? What about if one of the components uses a sub component that is published under GPL?

Architecture continued TCP/IP based communication Security issues? secured traffic (SSL, SSH) inside firewall Scalable