A Multiresolution Volume Rendering Framework for Large-Scale Time- Varying Data Visualization Chaoli Wang 1, Jinzhu Gao 2, Liya Li 1, Han-Wei Shen 1 1.

Slides:



Advertisements
Similar presentations
Abstract There is significant need to improve existing techniques for clustering multivariate network traffic flow record and quickly infer underlying.
Advertisements

Multi-variate, Time-varying, and Comparative Visualization with Contextual Cues Jon Woodring and Han-Wei Shen The Ohio State University.
LOD Map – A Visual Interface for Navigating Multiresolution Volume Visualization Chaoli Wang and Han-Wei Shen The Ohio State University Presented at IEEE.
SC05 Time-Varying Visualization Workshop Toward Effective Visualization of Ultra-scale Time-Varying Data Han-Wei Shen Associate Professor The Ohio State.
Fast Algorithms For Hierarchical Range Histogram Constructions
Visibility Culling using Hierarchical Occlusion Maps Hansong Zhang, Dinesh Manocha, Tom Hudson, Kenneth E. Hoff III Presented by: Chris Wassenius.
A Hardware-Assisted Hybrid Rendering Technique for Interactive Volume Visualization Brett Wilson Kwan-Liu Ma University of California, Davis Patrick S.
Fast Algorithm for Nearest Neighbor Search Based on a Lower Bound Tree Yong-Sheng Chen Yi-Ping Hung Chiou-Shann Fuh 8 th International Conference on Computer.
Image Indexing and Retrieval using Moment Invariants Imran Ahmad School of Computer Science University of Windsor – Canada.
Software Architecture of High Efficiency Video Coding for Many-Core Systems with Power- Efficient Workload Balancing Muhammad Usman Karim Khan, Muhammad.
Haptic Rendering using Simplification Comp259 Sung-Eui Yoon.
Evaluation of Data-Parallel Splitting Approaches for H.264 Decoding
Reji Mathew and David S. Taubman CSVT  Introduction  Quad-tree representation  Quad-tree motion modeling  Motion vector prediction strategies.
Image Sequence Coding by Split and Merge Patrice Willemin, Todd R. Reed and Murat Kunt Presented by: Idan Shatz.
Distributed Interactive Ray Tracing for Large Volume Visualization Dave DeMarle Steven Parker Mark Hartner Christiaan Gribble Charles Hansen.
Spatial and Temporal Data Mining
Mark Duchaineau Data Science Group April 3, 2001 Multi-Resolution Techniques for Scientific Data Visualization.
DDDDRRaw: A Prototype Toolkit for Distributed Real-Time Rendering on Commodity Clusters Thu D. Nguyen and Christopher Peery Department of Computer Science.
1 An Evaluation of Multi-resolution Storage for Sensor Networks D. Ganesan, B. Greenstein, D. Perelyubskiy, D. Estrin, J. Heidemann ACM SenSys 2003.
Page 1 CS Department Parallel Design of JPEG2000 Image Compression Xiuzhen Huang CS Department UC Santa Barbara April 30th, 2003.
Memory Efficient Acceleration Structures and Techniques for CPU-based Volume Raycasting of Large Data S. Grimm, S. Bruckner, A. Kanitsar and E. Gröller.
Introduction to Parallel Rendering: Sorting, Chromium, and MPI Mengxia Zhu Spring 2006.
1 An Empirical Study on Large-Scale Content-Based Image Retrieval Group Meeting Presented by Wyman
Fundamentals of Multimedia Chapter 8 Lossy Compression Algorithms (Wavelet) Ze-Nian Li and Mark S. Drew 건국대학교 인터넷미디어공학부 임 창 훈.
Fast Isosurface Visualization on a High-Resolution Scalable Display Wall Adam Finkelstein Allison Klein Kai Li Princeton University Sponsors: DOE, Intel,
Spatial Indexing I Point Access Methods. Spatial Indexing Point Access Methods (PAMs) vs Spatial Access Methods (SAMs) PAM: index only point data Hierarchical.
Importance-Driven Time-Varying Data Visualization Chaoli Wang, Hongfeng Yu, Kwan-Liu Ma University of California, Davis.
GPU-based Visualization Algorithms Han-Wei Shen Associate Professor Department of Computer Science and Engineering The Ohio State University.
RACE: Time Series Compression with Rate Adaptivity and Error Bound for Sensor Networks Huamin Chen, Jian Li, and Prasant Mohapatra Presenter: Jian Li.
Sort-Last Parallel Rendering for Viewing Extremely Large Data Sets on Tile Displays Paper by Kenneth Moreland, Brian Wylie, and Constantine Pavlakos Presented.
Cloud Imagery and Motion Mark Anderson, Scott Cornelsen, and Tom Wilkerson Space Dynamics Laboratory Utah State University, Logan, UT
A Parallelisation Approach for Multi-Resolution Grids Based Upon the Peano Space-Filling Curve Student: Adriana Bocoi Advisor: Dipl.-Inf.Tobias Weinzierl.
1/45 A Fast Rendering Method for Clouds Illuminated by Lightning Taking into Account Multiple Scattering Yoshinori Dobashi (Hokkaido University) Yoshihiro.
Efficient Volume Visualization of Large Medical Datasets Stefan Bruckner Institute of Computer Graphics and Algorithms Vienna University of Technology.
So far we have covered … Basic visualization algorithms Parallel polygon rendering Occlusion culling They all indirectly or directly help understanding.
ICPP 2012 Indexing and Parallel Query Processing Support for Visualizing Climate Datasets Yu Su*, Gagan Agrawal*, Jonathan Woodring † *The Ohio State University.
(Short) Introduction to Parallel Computing CS 6560: Operating Systems Design.
Semi-regular 3D mesh progressive compression and transmission based on an adaptive wavelet decomposition 21 st January 2009 Wavelet Applications in Industrial.
Random-Accessible Compressed Triangle Meshes Sung-eui Yoon Korea Advanced Institute of Sci. and Tech. (KAIST) Peter Lindstrom Lawrence Livermore National.
Pipelined and Parallel Computing Data Dependency Analysis for 1 Hongtao Du AICIP Research Mar 9, 2006.
Mark Rast Laboratory for Atmospheric and Space Physics Department of Astrophysical and Planetary Sciences University of Colorado, Boulder Kiepenheuer-Institut.
The Haar + Tree: A Refined Synopsis Data Structure Panagiotis Karras HKU, September 7 th, 2006.
Click to edit Master title style HCCMeshes: Hierarchical-Culling oriented Compact Meshes Tae-Joon Kim 1, Yongyoung Byun 1, Yongjin Kim 2, Bochang Moon.
Efficient Local Statistical Analysis via Integral Histograms with Discrete Wavelet Transform Teng-Yok Lee & Han-Wei Shen IEEE SciVis ’13Uncertainty & Multivariate.
VAPoR: A Discovery Environment for Terascale Scientific Data Sets Alan Norton & John Clyne National Center for Atmospheric Research Scientific Computing.
FlowGraph: A Compound Hierarchical Graph for Flow Field Exploration Jun Ma, Chaoli Wang, Ching-Kuang Shene Michigan Technological University Presented.
PMR: Point to Mesh Rendering, A Feature-Based Approach Tamal K. Dey and James Hudson
Indexing Correlated Probabilistic Databases Bhargav Kanagal, Amol Deshpande University of Maryland, College Park, USA SIGMOD Presented.
MEAD: Volume Visualization David Porter, U. Minnesota/LCSE Data Pipeline A3D HVR Tiled Commas Output Windows & Unix Formats & Frameworks linking to MEAD.
Large Scale Time-Varying Data Visualization Han-Wei Shen Department of Computer and Information Science The Ohio State University.
An Evaluation of Partitioners for Parallel SAMR Applications Sumir Chandra & Manish Parashar ECE Dept., Rutgers University Submitted to: Euro-Par 2001.
Electronic visualization laboratory, university of illinois at chicago Visualizing Very Large Scale Earthquake Simulations (SC 2003) K.L.Ma, UC-Davis.
3/16/04James R. McGirr1 Interactive Rendering of Large Volume Data Sets Written By : Stefan Guthe Michael Wand Julius Gonser Wolfgang Straβer University.
CSE554Contouring IISlide 1 CSE 554 Lecture 5: Contouring (faster) Fall 2015.
CSE554Contouring IISlide 1 CSE 554 Lecture 3: Contouring II Fall 2011.
CSE554Contouring IISlide 1 CSE 554 Lecture 5: Contouring (faster) Fall 2013.
Packet Size optimization for Supporting Coarse-Grained Pipelined Parallelism Wei Du Gagan Agrawal Ohio State University.
3D Object Representations 2009, Fall. Introduction What is CG?  Imaging : Representing 2D images  Modeling : Representing 3D objects  Rendering : Constructing.
ITree: Exploring Time-Varying Data using Indexable Tree Yi Gu and Chaoli Wang Michigan Technological University Presented at IEEE Pacific Visualization.
Tinoosh Mohsenin 2, Houshmand Shirani-mehr 1, Bevan Baas 1 1 University of California, Davis 2 University of Maryland Baltimore County Low Power LDPC Decoder.
Electronic visualization laboratory, university of illinois at chicago Sort Last Parallel Rendering for Viewing Extremely Large Data Sets on Tile Displays.
1 Supporting a Volume Rendering Application on a Grid-Middleware For Streaming Data Liang Chen Gagan Agrawal Computer Science & Engineering Ohio State.
CSE 554 Lecture 5: Contouring (faster)
On the Death of SciVis Han-Wei Shen
3D Object Representations
Lattice Histograms: A Resilient Synopsis Structure
Quad-Tree Motion Modeling with Leaf Merging
Yu Su, Yi Wang, Gagan Agrawal The Ohio State University
Finite Element Surface-Based Stereo 3D Reconstruction
Time-varying volume visualization and compression
Presentation transcript:

A Multiresolution Volume Rendering Framework for Large-Scale Time- Varying Data Visualization Chaoli Wang 1, Jinzhu Gao 2, Liya Li 1, Han-Wei Shen 1 1 The Ohio State University 2 Oak Ridge National Laboratory

Introduction Large-scale numerical simulation –Richtmyer-Meshkov Instability (RMI) LLNL 2,048 * 2,048 * 1,920 grid 960 (8 * 8 * 15) nodes of the IBM-SP system 7.5 GB per time step, output 274 time steps Goal –Data exploration –Quick overview, detail on demand Approach –Multiresolution data representation –Error-controlled parallel rendering

Challenge Compact hierarchical data representation Allow specifying different spatial and temporal resolutions for rendering Long chains of parent-child node dependency Data dependency among processors Balance the workload for parallel rendering

Algorithm Overview The algorithm flow for large-scale time-varying data visualization

Wavelet-Based Time Space Partitioning Tree The WTSP tree –Space-time hierarchical data structure to organize time-varying data –An octree (spatial hierarchy) of binary trees (temporal hierarchy) –Originate from the TSP tree [Shen et al. 1999] –Borrow the idea of the wavelet tree [Guthe et al. 2002]

Wavelet-Based Time Space Partitioning Tree WTSP tree construction –Two-stage block-wise wavelet transform and compression process –Build a spatial hierarchy in the form of an octree for each time step –Merge the same octree nodes across time into binary time trees

Hierarchical Spatial and Temporal Error Metric se ( T ) = Σ i =0..7 MSE ( T, T i ) + MAX { se ( T i )| i =0..7 } te ( T ) = MSE ( T, T l ) + MSE ( T, T r ) + MAX { te ( T l ), te ( T r )} Based on MSE calculation Compare the error of each block with its children

Alleviate data dependency EVERY-K scheme Storing Reconstructed Data for Space-Time Tradeoff h o = 6, h t = 4 k o = 2, k t = 2

WTSP Tree Partition and Data Distribution Eliminate dependency among processors Distribution units h o = 6, h t = 4 k o = 2, k t = 2

WTSP Tree Partition and Data Distribution Space-filling curve traversal –Neighboring blocks of similar spatial-temporal resolution should be evenly distributed to different processors –Space-filling curve preserves locality, always visits neighboring blocks first –Traverse the volume to create a one-dimensional ordering of the blocks

WTSP Tree Partition and Data Distribution Error-guided bucketization –Data blocks with similar spatial and temporal errors should be distributed to different processors –Create buckets with different spatial-temporal error intervals

WTSP Tree Partition and Data Distribution Error-guided bucketization –Bucketize the distribution units when performing hierarchical space-filling curve traversals –Distribute units in each bucket in a round-robin fashion

WTSP tree traversal –User specifies time step and tolerances of both spatial and temporal errors –Traverse octree skeleton and the binary time trees for each encountered octree node –A sequence of data blocks is identified in back-to-front order for rendering Run-Time Rendering

Data block reconstruction –Get low-pass filtered subblock from its parent node –Decode high-pass filtered wavelet coefficients –Perform inverse 3D wavelet transform –Reduce reconstruction time from O ( c 1 h o + c 2 h o h t ) to O ( c 1 k o + c 2 k o k t ), where c 1 = time to perform an inverse 3D wavelet transform c 2 = time to perform an inverse 1D wavelet transform h o = the height of the octree h t = the height of the time tree k o = # of levels in an octree node group k t = # of levels in a time tree node group Run-Time Rendering

Parallel Volume Rendering –Each processor renders the data blocks identified by the WTSP tree traversal and assigned to it during the data distribution stage –Cache reconstructed data for subsequent frames –Screen tiles partition –Image composition

Results data (type)RMI (byte) range (threshold)[0, 255] (0) volume (size)1024 * 1024 * 960 * 32 (30 GB) block (size)64 * 64 * 32 (128 KB) tree depth6 (octree) and 6 (time tree) wavelet transformHaar with lifting (both space and time) Data sets and wavelet transforms data (type)SPOT (float) range (threshold)[0.0, ] (0.005) volume (size)512 * 512 * 256 * 30 (7.5 GB) block (size)32 * 32 * 16 (64 KB) tree depth6 (octree) and 6 (time tree) wavelet transformDaubechies 4 (space) and Haar (time)

Results Testing environment –A PC cluster consisting of GHz Pentium 4 processors connected by Dolphin networks Performance –Software raycasting –96.53% parallel CPU utilization, or a speedup of times for 32 processors

Results Data distribution with EVERY-K scheme ( k o = 2, k t = 2) SPOT data set RMI data set

Results Rendering balance result SPOT data set RMI data set

Results The timing result with output image resolution data setRMISPOT ( se, te, t )(50, 10, 29)(0.05, 0.01, 23) number of blocks6,2184,840 wavelet reconstruction15.637s4.253s software raycasting10.810s2.715s image composition0.118s0.070s overhead3.093s1.719s total time29.658s8.757s difference time2.043s0.241s

Results Rendering of RMI data set at selected time steps 1 st 5368 th th 1,31732 th 1,625

Results Rendering of SPOT data set at selected time steps 1 st 2,55812 th 2,74321 th 2,39230 th 2,461

Results Multiresolution volume rendering RMI data set, 11 th time step SPOT data set, 5 th time step

Conclusion & Future Work Multiresolution volume rendering framework for large-scale time-varying data visualization –Hierarchical WTSP tree data representation –Data partition and distribution scheme –Parallel volume rendering algorithm Future work –Utilize graphics hardware for wavelet reconstruction and rendering speedup –Incorporate optimal feature-preserving wavelet transforms for feature detection

Acknowledgements Funding agencies –NSF ITR grant ACI –NSF Career Award CCF –DOE Early Career Principal Investigator Award DE- FG02-03ER25572 Data sets –Mark LLNL –John NCAR Testing environment –Jack Dongarra and Clay UTK –Don Stredney and Dennis OSC