Ifp University of Stuttgart Institute for Photogrammetry Combined Grammar for the Modeling of Building Interiors INDOOR3D – Cape Town Susanne Becker, Michael.

Slides:



Advertisements
Similar presentations
Three-Step Database Design
Advertisements

Comparison of Several Meta-modeling Tools 2 Yi Lu Computer Science Department McGill University
ICE1341 Programming Languages Spring 2005 Lecture #6 Lecture #6 In-Young Ko iko.AT. icu.ac.kr iko.AT. icu.ac.kr Information and Communications University.
Architecture Representation
Translator Architecture Code Generator ParserTokenizer string of characters (source code) string of tokens abstract program string of integers (object.
So What Does it All Mean? Geospatial Semantics and Ontologies Dr Kristin Stock.
A survey of techniques for precise program slicing Komondoor V. Raghavan Indian Institute of Science, Bangalore.
WFM 6202: Remote Sensing and GIS in Water Management © Dr. Akm Saiful IslamDr. Akm Saiful Islam WFM 6202: Remote Sensing and GIS in Water Management Akm.
Background information Formal verification methods based on theorem proving techniques and model­checking –to prove the absence of errors (in the formal.
CS 355 – Programming Languages
System Architecture Intelligently controlling image processing systems.
L-systems Presented by Luv Kohli COMP258 October 30, 2002 Images copyright © 1992 D. Fowler, P. Prusinkiewicz, and J. Battjes.
White Box Testing and Symbolic Execution Written by Michael Beder.
CS 330 Programming Languages 09 / 18 / 2007 Instructor: Michael Eckmann.
Logical Agents Chapter 7 Feb 26, Knowledge and Reasoning Knowledge of action outcome enables problem solving –a reflex agent can only find way from.
Bayesian Filtering for Location Estimation D. Fox, J. Hightower, L. Liao, D. Schulz, and G. Borriello Presented by: Honggang Zhang.
Course Instructor: Aisha Azeem
Meaningful Modeling: What’s the Semantics of “Semantics”? David Harel, Weizmann Institute of Science Bernhard Rumpe, Technische Universität Braunschweig.
1 Where do spatial context-models end and where do ontologies start? A proposal of a combined approach Christian Becker Distributed Systems Daniela Nicklas.
Image-Language Association: are we looking at the right features? Katerina Pastra Language Technology Applications, Institute for Language and Speech Processing,
10 December, 2013 Katrin Heinze, Bundesbank CEN/WS XBRL CWA1: DPM Meta model CWA1Page 1.
Department of Geoinformation Science Technische Universität Berlin 2009/07/29 On the Automatic Reconstruction of Building Information Models from Uninterpreted.
Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields Yong-Joong Kim Dept. of Computer Science Yonsei.
1. 2 Purpose of This Presentation ◆ To explain how spacecraft can be virtualized by using a standard modeling method; ◆ To introduce the basic concept.
–combines elements of computer science –database design –software design geography –map projections –geographic reasoning mathematics –mathematical topology.
APPLICATIONS OF CONTEXT FREE GRAMMARS BY, BRAMARA MANJEERA THOGARCHETI.
CS654: Digital Image Analysis Lecture 3: Data Structure for Image Analysis.
Situated Design of Virtual Worlds Using Rational Agents Mary Lou Maher and Ning Gu Key Centre of Design Computing and Cognition University of Sydney.
Taxonomies and Laws Lecture 10. Taxonomies and Laws Taxonomies enumerate scientifically relevant classes and organize them into a hierarchical structure,
Design Pattern Interpreter By Swathi Polusani. What is an Interpreter? The Interpreter pattern describes how to define a grammar for simple languages,
L-Systems and Procedural Plants CSE 3541 Matt Boggus.
SOFTWARE DESIGN.
-1- Philipp Heim, Thomas Ertl, Jürgen Ziegler Facet Graphs: Complex Semantic Querying Made Easy Philipp Heim 1, Thomas Ertl 1 and Jürgen Ziegler 2 1 Visualization.
Syntax Specification and BNF © Allan C. Milne Abertay University v
Some Probability Theory and Computational models A short overview.
Continuous Model Synthesis Paul Merrell and Dinesh Manocha In SIGGRAPH Asia 2008 발표 : 이성호.
Summer School „Modelling and Simulation with GroIMP“ / Tutorial for beginners University of Göttingen (Germany), September, 2010 Winfried Kurth Some.
Spatial Databases: Building Spatial DB Spring, 2015 Ki-Joune Li.
ISBN Chapter 3 Describing Semantics -Attribute Grammars -Dynamic Semantics.
Ground Truth Free Evaluation of Segment Based Maps Rolf Lakaemper Temple University, Philadelphia,PA,USA.
Spatial Databases - Introduction Spring, 2015 Ki-Joune Li.
Using RouteGraphs as an Appropriate Data Structure for Navigational Tasks SFB/IQN-Kolloquium Christian Mandel, A1-[RoboMap] Overview Goal scenario.
Programming Languages and Design Lecture 3 Semantic Specifications of Programming Languages Instructor: Li Ma Department of Computer Science Texas Southern.
Basic Parsing Algorithms: Earley Parser and Left Corner Parsing
1 / 48 Formal a Language Theory and Describing Semantics Principles of Programming Languages 4.
WIGOS Data model – standards introduction.
Chapter 10. The Explorer System in Cognitive Systems, Christensen et al. Course: Robots Learning from Humans On, Kyoung-Woon Biointelligence Laboratory.
Indoor Positioning System
Concepts and Realization of a Diagram Editor Generator Based on Hypergraph Transformation Author: Mark Minas Presenter: Song Gu.
1 Challenge the future Automatic extraction of Improved Geometrical Network Model from CityGML for Indoor Navigation Filippo Mortari.
Formal Verification. Background Information Formal verification methods based on theorem proving techniques and model­checking –To prove the absence of.
21/1/ Analysis - Model of real-world situation - What ? System Design - Overall architecture (sub-systems) Object Design - Refinement of Design.
SA-1 University of Washington Department of Computer Science & Engineering Robotics and State Estimation Lab Dieter Fox Stephen Friedman, Lin Liao, Benson.
Introduction to virtual engineering Óbuda University John von Neumann Faculty of Informatics Institute of Intelligent Engineering Systems Lecture 2. Description.
1 Double-Patterning Aware DSA Template Guided Cut Redistribution for Advanced 1-D Gridded Designs Zhi-Wen Lin and Yao-Wen Chang National Taiwan University.
MDD-Kurs / MDA Cortex Brainware Consulting & Training GmbH Copyright © 2007 Cortex Brainware GmbH Bild 1Ver.: 1.0 How does intelligent functionality implemented.
Grammars, L-Systems Jim Whitehead UC Santa Cruz School of Engineering courses.soe.ucsc.edu/courses/cmps265/Spring14/01 23 Apr 2014.
LECTURE 10 Semantic Analysis. REVIEW So far, we’ve covered the following: Compilation methods: compilation vs. interpretation. The overall compilation.
Procedural Skeletons: Kinematic Extensions to CGA-Shape Grammars Martin Ilčík, Stephan Fiedler Werner Purgathofer, Michael Wimmer Institute of Computer.
Segmentation of Building Facades using Procedural Shape Priors
? Shape Grammar and Image based 3D reconstruction of buildings
Chapter 3 – Describing Syntax
Programming Languages Translator
Provably Correct and Complete Transaction Rules for GIS
Conceptual Modeling SIE 510 GIS Applications Spring 2017.
INDOOR 3D MODEL RECONSTRUCTION TO SUPPORT
Spatial Databases - Introduction
N-Gram Model Formulas Word sequences Chain rule of probability
Spatial Databases - Introduction
Drawing from TR Nigel Davis
Presentation transcript:

ifp University of Stuttgart Institute for Photogrammetry Combined Grammar for the Modeling of Building Interiors INDOOR3D – Cape Town Susanne Becker, Michael Peter, Dieter Fritsch - (ifp) Damian Philipp, Patrick Baier, Christoph Dibak - (IPVS) Com’N’Sense

University of Stuttgart ifp 3D Indoor Models 2 © © © © © © cjwalsh.ie © © © www. cg.cis.upenn.edu

University of Stuttgart ifp 3D Indoor Models 3 ©  BIM world  3D GIS world  high geometric and semantic detail  modeled manually © isa2009/keynote.html © © Budroni & Böhm, 2009  mostly pure geometry models with limited geometric detail  focus on automatic derivation from observation data

University of Stuttgart ifp 3D Indoor Models 4  3D GIS world © isa2009/keynote.html ©  BIM world  high geometric and semantic detail  modeled manually © © Budroni & Böhm, 2009  mostly pure geometry models with limited geometric detail  focus on automatic derivation from observation data  Problems when erroneous or incomplete sensor data  Powerful means: formal grammars  Goal: fully automatic approach for grammar-supported indoor modeling based on observation data from low-cost sensors

University of Stuttgart ifp Formal Grammar 5  Powerful means for representing complex geometric structures using a set of formal rules  Compact representation of geometries and construction processes  Generative component: automated reconstruction of geometries  A formal grammar  defines a formal language as a set of sequences of symbols  symbols  alphabet  rules  syntax  Notation: G(V,T,P,F)  non-terminals V  terminals T  production rules P  id: lc rc : cond → succ : prob  axiom F (non-terminal defining the start point)

University of Stuttgart ifp Shape Grammar 1972 Stiny & Gips Enriched L-Systems Split Grammar 2003 Wonka et al. Müller, 2001 CGA Shape Grammar 2006 Müller et al. Facade Grammar 2009 Becker Indoor Grammar 2010 Gröger & Plümer Formal Grammars for modeling geometric structures 6 Lindenmayer- Systems Prusinkiewicz & Lindenmayer, 1990

University of Stuttgart ifp Formal Grammars Lindenmayer-Systems  Parallel rewriting systems over strings  Rewriting rules produce sequences of symbols  Sequences of symbols are interpreted and transferred to explicit geometry  Simple initial object is successively overwritten by more complicated structures 7 (Prusinkiewicz & Lindenmayer, 1990) 7  : F - - F - - F p : F  F + F - - F + F  Example 2: rule application axiom production rule ©  Example 1:

University of Stuttgart ifp Formal Grammars Lindenmayer-Systems  Application of L-Systems in urban modeling 8 (Müller, 2001)  Problems with modeling of buildings:  no growth process but iterative partitioning of space  geometric conditions (parallelism, rectangularity,...) difficult to integrate  long and intricate production rules

University of Stuttgart ifp Formal Grammars for modeling geometric structures 9 Lindenmayer- Systems Prusinkiewicz & Lindenmayer, 1990 Shape Grammar 1972 Stiny & Gips Enriched L-Systems Split Grammar 2003 Wonka et al. Müller, 2001 CGA Shape Grammar 2006 Müller et al. Facade Grammar 2009 Becker Indoor Grammar 2010 Gröger & Plümer

University of Stuttgart ifp Formal Grammars Shape Grammar 10 (Stiny und Gips, 1972)  Problem: complex rule applications  Example: axiom production rule rule application (1)(2)(3)  works not on symbols but on shapes:  alphabet consists of a set of shapes  rules directly work on these shapes

University of Stuttgart ifp Formal Grammars Split-Grammar 11 (Wonka et al., 2003)  Specified for the generation of building structures  Production rules are limited to split rules  G(T,V,R,I)  Shapes are treated as symbolic objects  Example:  regular, grid-like structures production rules rule applications START FFFF KS W W W W WIN

University of Stuttgart ifp Formal Grammars CGA Shape Grammar 12 (Müller et al., 2006)  Continued development of split grammar  Highly detailed building models in a pre-defined architectural style  Example: virtual Pompeji  Problem:  highly complex production rules depending on the level of detail  manual definition of rules

University of Stuttgart ifp Formal Grammars for modeling geometric structures 13 Lindenmayer- Systems Prusinkiewicz & Lindenmayer, 1990 Shape Grammar 1972 Stiny & Gips Enriched L-Systems Split Grammar 2003 Wonka et al. Müller, 2001 CGA Shape Grammar 2006 Müller et al. Facade Grammar 2009 Becker Indoor Grammar 2010 Gröger & Plümer

University of Stuttgart ifp 14 Cell Decomposition  Extraction and modeling of facade geometries from terrestrial LiDAR data Knowledge Inference  Detection of repetitive features and structures  Inference of rules Knowledge Propagation  Top-down prediction for completion  Generation of synthetic facades data driven knowledge based Formal Grammars Facade Grammar (Becker, 2009) Facade Grammar

University of Stuttgart ifp Formal Grammars Indoor Grammar 15 (Gröger & Plümer, 2010)  Generation of geometrically and topologically consistent 3D indoor models  G(N,T,S,P)  split rules are applied on 3D boxes and 2D rectangles  topology is explicitly modeled through constraints  Example: (a) (b) (c) (d) (e)(f) (g)

University of Stuttgart ifp Formal Grammars for modeling geometric structures 16 Lindenmayer- Systems Prusinkiewicz & Lindenmayer, 1990 Shape Grammar 1972 Stiny & Gips Enriched L-Systems Split Grammar 2003 Wonka et al. Müller, 2001 CGA Shape Grammar 2006 Müller et al. Facade Grammar 2009 Becker Indoor Grammar 2010 Gröger & Plümer now ifp, IPVS Combined Indoor Grammar

University of Stuttgart ifp Combined Indoor Grammar Design Decisions  Building characteristics  Public buildings are traversed by a system of hallways.  The system of hallways divides each floor into hallway-spaces and non-hallway-spaces.  Non-hallway-spaces can be further divided into smaller room units mostly arranged in a linear sequence parallel to the adjacent hallway. 17  Grammar concept  Hallway system (linear structures)  L-system  Room configurations (spatial partitioning)  split-grammar floorplan of ifp

University of Stuttgart ifp Combined Indoor Grammar L-System for Modeling Hallways 18  G hallways = (V, ω,P)  V : set of attributed symbols (modules),  ω : axiom (initial hallway segment)  P : production rules  related to the enriched L-system for modeling streets (Parish & Müller, 2001)  Idea: organize the setting of attributes, probabilities and the constraints induced by the geometric environment through external functions

University of Stuttgart ifp Combined Indoor Grammar Split-Grammar for Modeling Rooms 19  G rooms = (N,T,S,R)  N = {Space}  T = {…, space i, space j, …}  S = Space  R = {Split, Merge, Instantiation}       x y z x y  d

University of Stuttgart ifp Combined Indoor Grammar Split-Grammar for Modeling Rooms 20  Rule probabilities  a priori probability: P(R i )  relative frequency of occurrence  context aware probability: P(R j |R i )  conditional probability for modeling neighborhood relationships between rooms RiRi … RkRk RjRj …  Implementation through Markov Chain  nodes: rules  edges: neighborhood relationships or transitions  probability for a transition from R i to R j is given by

University of Stuttgart ifp Instantiation of Individual Grammars 21 a aaa abc c a b d  G indoor = (G hallways, G rooms )  G hallways  G rooms specialized rule system ?

University of Stuttgart ifp Instantiation of Individual Grammars 22  Grammar-based representation of a real floor plan  hallway system using an individual instance of the L-system G hallways floorplan of ifp

University of Stuttgart ifp floorplan of ifp Instantiation of Individual Grammars 23  Grammar-based representation of a real floor plan  hallway system using an individual instance of the L-system G hallways  room configurations in non-hallway spaces using an individual instance of the split Grammar G rooms floorplan of ifp Space 2 a Space 1 b c m j k i h g floorplan of ifp Space 1 Space 2 ;

University of Stuttgart ifp specialized rule system ? Instantiation of Individual Grammars 24 a aaa abc c a b d  G indoor = (G hallways, G rooms )  G hallways  G rooms specialized rule system !

University of Stuttgart ifp high low Instantiation of Individual Grammars Inverse Procedural Modeling  Set up of rules and attributes requires observation data 25 observation data grammar instance quality completeness, accuracy high low  1,  2,  3,  4,  5, d1, d2, d3, d4, d5  1,  2 d1, d2, d3  1,  2,  3,  4,  5, d1, d2, d3, d4, d5 Inverse procedural modeling © Peter et al., 2011 © Peter, 2013

University of Stuttgart ifp Grammar Application Procedural Modeling  An instance of an individual indoor grammar contains knowledge about characteristic indoor geometries and room arrangements  geometric properties: e.g. room size  topological properties: e.g. connectivity of rooms  semantic aspects: e.g. functional grouping of rooms  Use the grammar to generate reliable hypotheses about possible indoor geometries in unknown areas 26  1,  2,  3,  4,  5, d1, d2, d3, d4, d5 observation data observation data grammar instance grammar instance Inverse procedural modeling Procedural modeling hypotheses © Peter et al., 2013

University of Stuttgart ifp Grammar Application Results  Application scenario:  Generate hypotheses about indoor geometries for the 2 nd floor of university building using erroneous and incomplete trace data and grammar support 27 ©  Input data:  Traces: 250 odometry traces covering the hallways of the 2 nd floor  Grammar: high-level grammar automatically derived from a floor plan of the 1 st floor  3D building shell: LOD2 building model provided by city surveying office

University of Stuttgart ifp Grammar Application Results  Procedural modeling process  derive initial hallway segments (axiom)  apply L-system to the axiom  apply split grammar to non- hallway spaces  Comparison to ground trouth (131 rooms)  purely data-driven: 29 rooms  split grammar applied to the data-driven hallways: 92 rooms  split grammar applied to completed hallways through L-system: 116 rooms  average room width error: ~2m 28

University of Stuttgart ifp Conclusions and Outlook 29  Combined indoor grammar to support the reconstruction of building interiors from real sensor data  concepts of L-system and split grammar  different geometric and topological characteristics of hallways and rooms  Individual grammars can be derived automatically from observation data  Grammar can be integrated in continuous update and enhancement loop  Future work  link indoor grammar to facade grammar (step over to real 3D)  transfer the concept of split grammar from spaces to faces (model wall openings) © Peter, 2013© Becker, 2011

ifp University of Stuttgart Institute for Photogrammetry Thank you for your attention