Volume Rendering Volumetric Presentation State Supplement 190 Public Comment Review Joe Luszcz, Philips Healthcare Chair, DICOM Working Group 11 January.

Slides:



Advertisements
Similar presentations
Today Composing transformations 3D Transformations
Advertisements

Joe Luszcz Philips Ultrasound January 4, 2011 DICOM N-Dimensional Presentation State Description and Call for Participation.
ND Presentation State What should it do? D. Sluis December 2, 2003, Open Discussion at WG11 Meeting, RSNA.
Ray tracing. New Concepts The recursive ray tracing algorithm Generating eye rays Non Real-time rendering.
Graphics Pipeline.
Direct Volume Rendering. What is volume rendering? Accumulate information along 1 dimension line through volume.
Texture Mapping. Texturing  process that modifies the appearance of each point on a surface using an image or function  any aspect of appearance can.
1 Computer Graphics Chapter 9 Rendering. [9]-2RM Rendering Three dimensional object rendering is the set of collective processes which make the object.
Color Image Processing
DICOM and CT/PET Fusion CT and PET slices stored as separate original image files –one slice per file (old objects) or multiple slices per file (new enhanced.
Real-Time Rendering SPEACIAL EFFECTS Lecture 03 Marina Gavrilova.
Splatting Josh Anon Advanced Graphics 1/29/02. Types of Rendering Algorithms Backward mapping Image plane mapped into data Ray casting Forward mapping.
(conventional Cartesian reference system)
Introduction to Volume Visualization Mengxia Zhu Fall 2007.
1 Angel: Interactive Computer Graphics 4E © Addison-Wesley 2005 Models and Architectures Ed Angel Professor of Computer Science, Electrical and Computer.
Direct Volume Rendering w/Shading via Three- Dimensional Textures.
ITUppsala universitet Data representation and fundamental algorithms Filip Malmberg
02/14/02(c) University of Wisconsin 2002, CS 559 Last Time Filtering Image size reduction –Take the pixel you need in the output –Map it to the input –Place.
Computer Graphics: Programming, Problem Solving, and Visual Communication Steve Cunningham California State University Stanislaus and Grinnell College.
10/5/04© University of Wisconsin, CS559 Fall 2004 Last Time Compositing Painterly Rendering Intro to 3D Graphics Homework 3 due Oct 12 in class.
1 Computer Graphics Week13 –Shading Models. Shading Models Flat Shading Model: In this technique, each surface is assumed to have one normal vector (usually.
Basics of Rendering Pipeline Based Rendering –Objects in the scene are rendered in a sequence of steps that form the Rendering Pipeline. Ray-Tracing –A.
COMP 175: Computer Graphics March 24, 2015
Technology and Historical Overview. Introduction to 3d Computer Graphics  3D computer graphics is the science, study, and method of projecting a mathematical.
Toward DICOM n-Dimensional Presentation State Joe Luszcz, Co-Chair DICOM Working Group 11.
Lecture 3 : Direct Volume Rendering Bong-Soo Sohn School of Computer Science and Engineering Chung-Ang University Acknowledgement : Han-Wei Shen Lecture.
Scientific Visualization Module 6 Volumetric Algorithms (adapted by S.V. Moore – slides deleted, modified, and added) prof. dr. Alexandru (Alex) Telea.
MIT EECS 6.837, Durand and Cutler Graphics Pipeline: Projective Transformations.
C O M P U T E R G R A P H I C S Guoying Zhao 1 / 14 C O M P U T E R G R A P H I C S Guoying Zhao 1 / 14 Going-through.
CSC 461: Lecture 3 1 CSC461 Lecture 3: Models and Architectures  Objectives –Learn the basic design of a graphics system –Introduce pipeline architecture.
Image-based Rendering. © 2002 James K. Hahn2 Image-based Rendering Usually based on 2-D imagesUsually based on 2-D images Pre-calculationPre-calculation.
1 Introduction to Computer Graphics with WebGL Ed Angel Professor Emeritus of Computer Science Founding Director, Arts, Research, Technology and Science.
Computer Graphics The Rendering Pipeline - Review CO2409 Computer Graphics Week 15.
1Computer Graphics Lecture 4 - Models and Architectures John Shearer Culture Lab – space 2
Advanced Computer Graphics Advanced Shaders CO2409 Computer Graphics Week 16.
Programming 3D Applications CE Displaying Computer Graphics Week 3 Lecture 5 Bob Hobbs Faculty of Computing, Engineering and Technology Staffordshire.
Computer Graphics: Programming, Problem Solving, and Visual Communication Steve Cunningham California State University Stanislaus and Grinnell College.
Review on Graphics Basics. Outline Polygon rendering pipeline Affine transformations Projective transformations Lighting and shading From vertices to.
Volume Visualization with Ray Casting
Course14 Dynamic Vision. Biological vision can cope with changing world Moving and changing objects Change illumination Change View-point.
1 Angel: Interactive Computer Graphics5E © Addison- Wesley 2009 Image Formation Fundamental imaging notions Fundamental imaging notions Physical basis.
CS559: Computer Graphics Final Review Li Zhang Spring 2010.
COMPUTER GRAPHICS CS 482 – FALL 2015 SEPTEMBER 29, 2015 RENDERING RASTERIZATION RAY CASTING PROGRAMMABLE SHADERS.
Volume Rendering Volumetric Presentation State Supplement 190 Public Comment Review Joe Luszcz, Philips Healthcare Chair, DICOM Working Group 11 January.
Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.
CDS 301 Fall, 2008 From Graphics to Visualization Chap. 2 Sep. 3, 2009 Jie Zhang Copyright ©
Chapter 1 Graphics Systems and Models Models and Architectures.
1 E. Angel and D. Shreiner: Interactive Computer Graphics 6E © Addison-Wesley 2012 Models and Architectures 靜宜大學 資訊工程系 蔡奇偉 副教授 2012.
Computer Graphics CC416 Lecture 04: Bresenham Line Algorithm & Mid-point circle algorithm Dr. Manal Helal – Fall 2014.
Presented by 翁丞世  View Interpolation  Layered Depth Images  Light Fields and Lumigraphs  Environment Mattes  Video-Based.
Volume Rendering Volumetric Presentation State Supplement 190 DICOM Working Group 11 Letter Ballot March 24, 2016.
Supplement 189: Parametric Blending Presentation State Storage.
Three Dimensional Viewing
Rendering Pipeline Fall, 2015.
Volume Visualization Chap. 10 November 20 , 2008 Jie Zhang Copyright ©
3D Graphics Rendering PPT By Ricardo Veguilla.
The Graphics Rendering Pipeline
Models and Architectures
Models and Architectures
Models and Architectures
Introduction to Computer Graphics with WebGL
Real-Time Volume Graphics [06] Local Volume Illumination
Volume Rendering (2).
Models and Architectures
Models and Architectures
Texture Mapping 고려대학교 컴퓨터 그래픽스 연구실.
Adding Surface Detail 고려대학교 컴퓨터 그래픽스 연구실.
Adding Surface Detail 고려대학교 컴퓨터 그래픽스 연구실.
Presentation transcript:

Volume Rendering Volumetric Presentation State Supplement 190 Public Comment Review Joe Luszcz, Philips Healthcare Chair, DICOM Working Group 11 January 15, 2016

Supplement 190 Defines the second “Volumetric Presentation State” (VPS) IOD o Similar to Planar MPR VPS, specifies geometric transformation of volume data to a 2D view of volume data o Replaces MPR-specific content with Volume Rendering specifications o Leverages concepts from the Planar MPR VPS Volume Rendering VPS Public Comment Review2

What is Public Comment? The specification being described is a draft standard currently out for Public Comment All participant organizations in DICOM have the opportunity to review and comment Looking for your comments (pro and con) on the work so appropriate changes and corrections can be made Volume Rendering VPS Public Comment Review3

Presentation States vs. Layout Volume Rendering VPS Public Comment Review4 Four associated Volumetric Presentation State Instances

Volumetric Presentation State Scope One VPS defines only one view geometry One VPS may define animation from the initial view geometry Separate DICOM objects or ad hoc conventions are used to define layout of multiple views o Multiple VPS objects required to describe multiple views on one display screen (e.g., 3 orthogonal MPRs and one volume rendering). o Hanging Protocol or Structured Display object may formalize the layout of multiple views on one display o A hint is provided by a “display collection UID” in each related VPS Volume Rendering VPS Public Comment Review5

Exact Match vs. Reasonable Consistency Application of a Volumetric Presentation State is not expected to be exactly reproducible on different systems, and an exact match of volume presentation on multiple devices cannot be guaranteed Reasonable consistency is provided by specification of inputs, geometric descriptions of spatial views, type of processing to be used, color mapping and blending, input fusion, and many generic rendering parameters, producing what is expected to be a clinically acceptable result. Volume Rendering VPS Public Comment Review6

Standardization Challenges Volume Rendering VPS Public Comment Review7 Sup 190

New Volume Rendering SOP Classes Specifies three new VPS SOP Classes: o Volume Rendering VPS SOP Class Single volume input Single display transformation o Segmented Volume Rendering VPS SOP Class Single volume input Multiple croppings allowed with separate display transformations o Multiple Volume Rendering VPS SOP Class Multiple volume inputs Multiple croppings allowed for each input volume input, with separate display transformations Volume Rendering VPS Public Comment Review8

Volume Rendering SOP Class Most basic SOP Class Used primarily for grayscale or colorized volume render view of single volume Volume Rendering VPS Public Comment Review9

Volume Rendering SOP Class Example Volume Rendering VPS Public Comment Review10

Volume Rendering SOP Class Volume Rendering VPS Public Comment Review11

Segmented Volume Rendering SOP Class Intermediate complexity SOP Class Used primarily for grayscale render view of a single volume with one or more colorized segmentations Volume Rendering VPS Public Comment Review12

Segmented Volume Rendering SOP Class Example Volume Rendering VPS Public Comment Review13

Segmented Volume Rendering SOP Class Volume Rendering VPS Public Comment Review14

Multiple Volume Rendering SOP Class Most advanced SOP Class Used for specifying a volume render view of two or more “fused” volume datasets of the same or different modality Examples: o Ultrasound color flow (tissue + flow) o CT/Ultrasound invasive procedure o CT/PET fusion Volume Rendering VPS Public Comment Review15

Multiple Volume Rendering SOP Class Volume Rendering VPS Public Comment Review16

Multiple Volume Rendering SOP Class Volume Rendering VPS Public Comment Review17

Leverages Planar MPR VPS Same basic concepts as Planar MPR VPS o Geometry based on a Reference Coordinate System o Includes modules from Supplement 156: VPS Identification to label the presentation VPS Relationship to specify volume inputs VPS Cropping to specify croppings that are applied to each input Clinical Description to specify a clinical context of the view (anatomy, view name, etc.) Graphic Annotation for placing graphics on 2D output view Volume Graphic Annotation for placing graphics within the volume space to be rendered Presentation Animation for animating the initial view Volume Rendering VPS Public Comment Review18

What is Volume Rendering? Data visualization method used to display a 2D projection of a volume dataset Generally consists of the following steps: o Segmentation o Gradient Computation o Resampling o Classification o Shading o Compositing Significant latitude given to implementation- specific decisions on implementing each step Volume Rendering VPS Public Comment Review19

Segmentation Separating the volume data into groups that will share a particular color palette. In-scope: Segmentation objects are specified as cropping inputs to the Volumetric Presentation State. Volume Rendering VPS Public Comment Review20

Gradient Computation Finding edges or boundaries between different types of tissue in the volumetric data. Typically used to determine “surface normals” for use in the shading operation Gradient Computation used is an implementation decision outside the scope of the Volumetric Presentation State. Volume Rendering VPS Public Comment Review21

Resampling Resampling volumetric data creates new samples along an imaginary ray behind each pixel in the output two-dimensional view Generally uses some interpolation of the values of voxels in the neighborhood of each sample In-Scope: The geometry specifying the output view is specified in the Render Geometry module of the VPS The interpolation method used is an implementation decision outside the scope of the Volumetric Presentation State. Volume Rendering VPS Public Comment Review22

Classification Assigns a color and opacity to each ray sample In-scope: Classification parameters are specified in the Render Display module of the VPS Volume Rendering VPS Public Comment Review23

Shading Application of a lighting model to ray samples indicating the effect of ambient, diffuse, and specular light on each sample In-scope: Basic shading parameters are specified in the Render Shading module of the VPS. There is considerable research and development activity in this area as vendors strive to create the most “natural” looking image presentations Volume Rendering VPS Public Comment Review24

Compositing Accumulation of samples on each ray into the final value of the pixel corresponding to that ray The specific algorithms used are outside the scope of the Volumetric Presentation State. Volume Rendering VPS Public Comment Review25

New Modules for Volume Rendering VPS Render Geometry Render Shading Render Display Volume Rendering VPS Public Comment Review26

Render Geometry Module Specifies the render view (or initial render view if animation is used) Includes o Projection: Orthographic or Perspective o Viewpoint Position Look-at point Up direction o Field of View (X left, X right, Y top, Y bottom, D near, D far ) o Compositing method (AveIP, MinIP, MaxIP, Render) Volume Rendering VPS Public Comment Review27

Orthographic Field of View Geometry Volume Rendering VPS Public Comment Review28

Perspective Field of View Geometry Volume Rendering VPS Public Comment Review29

Render Shading Module Provides basic lighting parameters, assuming a single white light source at infinity for diffuse and specular lighting Includes o Shading Style (single-sided vs. double-sided) o Reflection Intensities Ambient Diffuse Specular o Light Direction o Shininess Subject to extension by the rendering application Volume Rendering VPS Public Comment Review30

Render Display Module Each VPS input has separate RGB and Alpha (opacity) lookup tables (i.e., Classification) Inputs are grouped into “Volume Streams” o Segmented Volume Render VPS has one Volume Stream o Multiple Volume Render VPS has multiple Volume Streams Within each Volume Stream, inputs are blending using fixed “B over A” blending to produce a single RGBA output Volumes output from multiple Volume Streams are RGBA Composited prior to volume rendering Volume Rendering VPS Public Comment Review31

Alpha vs. Opacity Alpha and Opacity are treated as identical concepts The same specification of Alpha/Opacity is used for both o Compositing of multiple volumes prior to rendering (blending of volumes) o Compositing of samples on each ray contributing to a pixel in the output view (ray casting) No separate blending and ray casting opacity specifications Volume Rendering VPS Public Comment Review32

Rendering Pipeline Volume Rendering VPS Public Comment Review 33

RGBA Compositing In the reference pipeline, the volume dataset is composited (i.e., converted to RGBA) prior to volume rendering Same flexible compositing structure used for Planar MPR, consisting of o Weighting Tables that consider Alpha inputs from both channels in determining the weighting factors for each RGBA input to the Compositor Function o Compositor Function that combines each RGBA component using the relationship: C out = (C 1 * Weight 1 ) + (C 2 * Weight 2 ) Volume Rendering VPS Public Comment Review34

RGBA Compositor Structure Volume Rendering VPS Public Comment Review35

Volume Rendering Component Inputs to Volume Rendering component are o Single, blended, RGBA volume dataset o Render Geometry parameters o Render Shading parameters Certain rendering steps are left to the application, including o Gradient Computation o Resampling / interpolation o Compositing o More advanced (proprietary) algorithms Volume Rendering VPS Public Comment Review36

Presentation Animation Two new animation styles are added o Flythrough: The viewpoint moves along a pre-defined curve and the view is re-rendered at each step. Effect is that of “flying through” the volume space while viewing the anatomy. o Swivel: The viewpoint remains fixed while the volume data rotates back and forth around a “swivel axis” Volume Rendering VPS Public Comment Review37

Flythrough Animation A set of discrete points defining a curve is provided Viewpoint look at point moves along the curve at a specified velocity (mm/sec) Viewpoint position is adjusted at each step to maintain the original distance to look at point Viewpoint up direction maintained according to the cross-product V originalLook X V originalUp = V look X V up Volume Rendering VPS Public Comment Review38

Swivel Animation Swivel axis defined as the axis parallel to Viewpoint Up Direction intersecting the Viewpoint Look At Point The rendered volume rotates back and forth in the specified angular range at a specified rotational frequency Currently, no guidance is provided on a need for smooth direction changes (e.g., sinosoid rotational velocity vs. constant) Volume Rendering VPS Public Comment Review39

Output Final View may be either o Grayscale (P-Values) o Color (PCS-Values) As with Planar MPR, may include links to a “secondary capture” of the presentation at the source device o For quality assurance o For clinical integrity Volume Rendering VPS Public Comment Review40

Next Steps Public Comment period officially ends January 29 Volume Rendering VPS Public Comment Review41