Institute for vision and graphics university of siegen, germany High-Level User Interfaces for Transfer Function Design with Semantics Christof Rezk Salama.

Slides:



Advertisements
Similar presentations
Sauber et al.: Multifield-Graphs Multifield-Graphs: An Approach to Visualizing Correlations in Multifield Scalar Data Natascha Sauber, Holger Theisel,
Advertisements

International Telecommunication Union Workshop on Standardization in E-health Geneva, May 2003 Digital Imaging in Pathology for Standardization Yukako.
Face Recognition Sumitha Balasuriya.
7.1 Vis_04 Data Visualization Lecture 7 3D Scalar Visualization Part 2 : Volume Rendering- Introduction.
ENV 2006 CS4.1 Envisioning Information: Case Study 4 Focus and Context for Volume Visualization.
Functional and non-functional requirements for building Service-oriented assessment model Adelina Aleksieva-Petrova Milen Petrov 5th TENCompetence Open.
Reconstruction from Voxels (GATE-540)
Software Analysis at Philips Healthcare MSc Project Matthijs Wessels 01/09/2009 – 01/05/2010.
DTU Informatics Introduction to Medical Image Analysis Rasmus R. Paulsen DTU Informatics TexPoint fonts.
Image Retrieval: Current Techniques, Promising Directions, and Open Issues Yong Rui, Thomas Huang and Shih-Fu Chang Published in the Journal of Visual.
Data Mining Feature Selection. Data reduction: Obtain a reduced representation of the data set that is much smaller in volume but yet produces the same.
Towards a zoomable cell abstract cell natural coordinate system Data > D Protein Structures from PDB ? A IHGFBCDE > Images from scientific.
S.T.A.I.R.. General problem solving strategy that can be applied to a range problems.
REAL-TIME VOLUME GRAPHICS Christof Rezk Salama Computer Graphics and Multimedia Group, University of Siegen, Germany Eurographics 2006 Real-Time Volume.
© Fraunhofer MEVIS Toward Automated Validation of Sketch-based 3D Segmentation Editing Tools Frank Heckel 1, Momchil I. Ivanov 2, Jan H. Moltz 1, Horst.
D contour based local manual correction of liver segmentations1Institute for Medical Image Computing 3D contour based local manual correction.
Chapter 2 Data Models Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
Chapter 5: Linear Discriminant Functions
High-Quality Volume Graphics on Consumer PC Hardware
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Semester wrap-up …the final slides.. The Final  December 13, 3:30-4:45 pm  Closed book, one page of notes  Cumulative  Similar format and length to.
Project Life Cycle Jon Ivins DMU. Introduction n Projects consist of many separate components n Constraints include: time, costs, staff, equipment n Assets.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
Evaluating the Quality of Image Synthesis and Analysis Techniques Matthew O. Ward Computer Science Department Worcester Polytechnic Institute.
Presented by Zeehasham Rasheed
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
Semester wrap-up …the final slides.. The Final December 15, 3:30-6:30 pm Close book, one page of notes Cumulative Similar format to midterm (probably.
Biomedical Image Analysis and Machine Learning BMI 731 Winter 2005 Kun Huang Department of Biomedical Informatics Ohio State University.
1. Human – the end-user of a program – the others in the organization Computer – the machine the program runs on – often split between clients & servers.
REAL-TIME VOLUME GRAPHICS Christof Rezk Salama Computer Graphics and Multimedia Group, University of Siegen, Germany Eurographics 2006 Real-Time Volume.
Abstraction IS 101Y/CMSC 101 Computational Thinking and Design Tuesday, September 17, 2013 Carolyn Seaman University of Maryland, Baltimore County.
2 1 Chapter 2 Data Models Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
Microprocessor-based systems Curse 7 Memory hierarchies.
BACKGROUND LEARNING AND LETTER DETECTION USING TEXTURE WITH PRINCIPAL COMPONENT ANALYSIS (PCA) CIS 601 PROJECT SUMIT BASU FALL 2004.
Jonathan M Chye Technical Supervisor : Mr Matthew Bett 2010.
REAL-TIME VOLUME GRAPHICS Christof Rezk Salama Computer Graphics and Multimedia Group, University of Siegen, Germany Eurographics 2006 Real-Time Volume.
Abstraction IS 101Y/CMSC 101 Computational Thinking and Design Tuesday, September 17, 2013 Marie desJardins University of Maryland, Baltimore County.
Software Engineering Principles. SE Principles Principles are statements describing desirable properties of the product and process.
© Fraunhofer MEVIS Meeting of the Working Group VCBM, 3. September 2013, Vienna Frank Heckel Fraunhofer MEVIS, Bremen, Germany | Innovation Center Computer.
Developing Business/IT Solutions Chapter 12 McGraw-Hill/IrwinCopyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved.
Image-Based Rendering of Diffuse, Specular and Glossy Surfaces from a Single Image Samuel Boivin and André Gagalowicz MIRAGES Project.
An Enhanced Splatting Method Graphics and Visualization Group Department of Computer Science The University of Auckland Peter Kulka & Richard Lobb.
REAL-TIME VOLUME GRAPHICS Christof Rezk Salama Computer Graphics and Multimedia Group, University of Siegen, Germany Eurographics 2006 Real-Time Volume.
MedIX – Summer 07 Lucia Dettori (room 745)
REAL-TIME VOLUME GRAPHICS Klaus Engel Siemens AG, Erlangen, Germany Eurographics 2006 Real-Time Volume Graphics [05] Transfer Functions.
- Laboratoire d'InfoRmatique en Image et Systèmes d'information
Design and Implementation of Geometric and Texture-Based Flow Visualization Techniques Robert S. Laramee Markus Hadwiger Helwig Hauser.
Presenting and Analysing your Data CSCI 6620 Spring 2014 Thesis Projects: Chapter 10 CSCI 6620 Spring 2014 Thesis Projects: Chapter 10.
Approach Outline Polygonal-Functional Hybrids for Computer Animation and Games The modern world of computer graphics is mostly dominated by polygonal models.
Visual Parameter Exploration in GPU Shader Space Peter Mindek 1, Stefan Bruckner 2,1, Peter Rautek 3, and M. Eduard Gröller 1 1 Institute of Computer Graphics.
CS507 Information Systems. Lesson # 11 Online Analytical Processing.
What is the question? 1) What is the question? Are there any words you do not understand, or want to clarify? What are you asked to find or show? Can you.
1 Presentation Methodology Summary B. Golden. 2 Introduction Why use visualizations?  To facilitate user comprehension  To convey complexity and intricacy.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
1 C.A.L. Bailer-Jones. Machine Learning. Data exploration and dimensionality reduction Machine learning, pattern recognition and statistical data modelling.
PostGraduate Research Excellence Symposium (PGReS) 2015
Tutorial 7 Real-Time Volume Graphics
Computer Graphics.
Image Processing.
Volume Visualization Chap. 10 November 20 , 2008 Jie Zhang Copyright ©
IIS for Image Processing
Tutorial 7 Real-Time Volume Graphics
Knut Kröger & Reiner Creutzburg
Transfer Function Transfer functions make volume data visible
Volume Visualization Chap. 10 December 3 , 2009 Jie Zhang Copyright ©
Pattern Recognition CS479/679 Pattern Recognition Dr. George Bebis
GENERAL VIEW OF KRATOS MULTIPHYSICS
Analysis models and design models
Chapter 5 Architectural Design.
Presentation transcript:

institute for vision and graphics university of siegen, germany High-Level User Interfaces for Transfer Function Design with Semantics Christof Rezk Salama (Univ. Siegen, Germany) Maik Keller (Univ. Siegen, Germany) Peter Kohlmann (TU Vienna, Austria)

christof rezk-salama, institute for vision and graphics, university of siegen Volume Visualization Volume visualization techniques are mature from the technical point of view. Real-time volume graphics on commodity PC hardware Multidimensional transfer functions/classification Gradient estimation and local illumination on-the-fly Memory management and compression for large volumes Even global illumination techniques. Is the volume rendering problem solved? If you ask the computer scientist, hell probably say yes. If you ask the users, they will most likely say no

christof rezk-salama, institute for vision and graphics, university of siegen Questions Why are volume rendering applications so hard to use for non- experts? Are volume rendering applications easy to use for us, the experts ? What features must appropriate user interfaces provide?

christof rezk-salama, institute for vision and graphics, university of siegen The Mental Model Example taken from: Donald A. Norman The Psychology of Everyday Things

christof rezk-salama, institute for vision and graphics, university of siegen Volume Visualization Transfer Function Design: Mapping of scalar data to optical properties (emission/absorption) Color table: Example: 1D TF for 12 bit Data, 4096 values x RGBA = DOF Editors based on geometric primitives 1D Transfer Functions 2D Transfer Functions

christof rezk-salama, institute for vision and graphics, university of siegen User Intention Examples: Fade out the soft tissue Sharpen the blood vessels Enhance the contrast Question: What actions are necessary? Even the expert, who programmed the user interface, does not know this! Mental model is inappropriate or missing! Semantics are missing (leads to gulf of execution) Result in trial-and-error

christof rezk-salama, institute for vision and graphics, university of siegen Application Abstraction Levels Low-Level Parameters (Color Table) High-Level Parameters (Primitive Shapes) Semantic Level Visibility Sharpness Contrast User All previous approaches aim at reducing the complexity, the degrees of freedom. None of the prevous approaches tries to provide an appropriate mental model!

christof rezk-salama, institute for vision and graphics, university of siegen Semantic Models Restrict ourselves to one specific application scenario. Example: CT angiography from neuroradiology The visualization task will be performed manually for multiple data sets. Visualization expert and medical doctor! Evaluate statistical information about the results: Which parameter modifications are necessary to make the blood vessels sharper? Use dimensionality reduction (PCA) to create a semantic model

christof rezk-salama, institute for vision and graphics, university of siegen Bone Step 1: Create a template for the TF Brain/Soft TissueSkin/CavitiesBlood vessels Developing a Semantic Model

christof rezk-salama, institute for vision and graphics, university of siegen Step 2: Adapt the template to reference data Developing a Semantic Model

christof rezk-salama, institute for vision and graphics, university of siegen Step 2: Adapt the template to reference data Developing a Semantic Model

christof rezk-salama, institute for vision and graphics, university of siegen Step 2: Adapt the template to reference data Developing a Semantic Model Step 3: Dimensionality reduction Reference Transfer Functions Principal Component Analysis Semantics Semantic Model

christof rezk-salama, institute for vision and graphics, university of siegen High-Level User Interface High-Level Control Transfer FunctionSemantic Model

christof rezk-salama, institute for vision and graphics, university of siegen Semantic Model

christof rezk-salama, institute for vision and graphics, university of siegen Prototype Implementation Applicable to anything that can be described by a parameter vector Take care of the scale! PCA for entire parameter vector is not appropriate Small details might be missed Our solution: Split transfer function into entities (=structures, groups of primitives with same scale) Perform PCA separately for each entity Reassemble the transfer function from the different entities

christof rezk-salama, institute for vision and graphics, university of siegen Results CTA: intracranial aneurysms: 512 x 512 x 100ml non-ionic contrast dye 20 data sets for training / 5 data sets for evaluation MR brain surgery: 256 x 256 x (noisy, lower dynamic range ~10bit) 10 data sets Evaluation of the model: Analytically: Stability of the eigenvectors (dot product > 0.9) Stable for >12 data sets (regardless of individual choice) User Study: Labels removed from the user interface Most semantics were correctly identified by non-expert users

christof rezk-salama, institute for vision and graphics, university of siegen Conclusion User Interface Design Strategies: Reducing DOF is not enough. Good user interfaces must provide an appropriate mental model Not an attempt to create a single user interfaces for any visualization tasks Create semantic models for examination tasks as specific as necessary Building block for software assistants for medical diagnosis and therapy planning

christof rezk-salama, institute for vision and graphics, university of siegen Acknowledgements Bernd Tomandl MD, Neuroradiologie, Bremen Christopher Nimsky MD, Neurochirurgie, Erlangen