MEAD: Volume Visualization David Porter, U. Minnesota/LCSE Data Pipeline A3D HVR Tiled Commas Output Windows & Unix Formats & Frameworks linking to MEAD.

Slides:

Advertisements

Similar presentations

Network II.5 simulator ..

Advertisements

2.02F Publishing Animated Videos 2.02 Develop Computer Animations.

Why ROOT?. ROOT ROOT: is an object_oriented frame work aimed at solving the data analysis challenges of high energy physics Object _oriented: by encapsulation,

Adobe Flash CS4 – Illustrated Unit E: Optimizing and Publishing a Movie.

® Page 1 Intel Compiler Lab – Intel Array Visualizer HDF Workshop VI December 5, 2002 John Readey

Multi-Layer Switching Layers 1, 2, and 3. Cisco Hierarchical Model Access Layer –Workgroup –Access layer aggregation and L3/L4 services Distribution Layer.

Distributed Multimedia Systems

Objective Understand web-based digital media production methods, software, and hardware. Course Weight : 10%

CS 104 Introduction to Computer Science and Graphics Problems Operating Systems (4) File Management & Input/Out Systems 10/14/2008 Yang Song (Prepared.

Analysis of compressed depth and image streaming on unreliable networks Pietro Zanuttigh, Andrea Zanella, Guido M. Cortelazzo.

Parallel Rendering Ed Angel

Connecting HPIO Capabilities with Domain Specific Needs Rob Ross MCS Division Argonne National Laboratory

Adaptive Streaming and Rendering of Large Terrains: a Generic Solution WSCG 2009 Raphaël Lerbour Jean-Eudes Marvie Pascal Gautron THOMSON R&D, Rennes,

Chapter 10 Chapter 10: Managing the Distributed File System, Disk Quotas, and Software Installation.

A Multiresolution Volume Rendering Framework for Large-Scale Time- Varying Data Visualization Chaoli Wang 1, Jinzhu Gao 2, Liya Li 1, Han-Wei Shen 1 1.

Loupe /loop/ noun a magnifying glass used by jewelers to reveal flaws in gems. a logging and error management tool used by.NET teams to reveal flaws in.

MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 7 Configuring File Services in Windows Server 2008.

2. Introduction to the Visual Studio.NET IDE 2. Introduction to the Visual Studio.NET IDE Ch2 – Deitel’s Book.

High Performance in Broad Reach Games Chas. Boyd

Linux Operations and Administration

Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.

ROOT: A Data Mining Tool from CERN Arun Tripathi and Ravi Kumar 2008 CAS Ratemaking Seminar on Ratemaking 17 March 2008 Cambridge, Massachusetts.

Chep06 1 High End Visualization with Scalable Display System By Dinesh M. Sarode, S.K.Bose, P.S.Dhekne, Venkata P.P.K Computer Division, BARC, Mumbai.

Cyclone User + Cyclone Publisher Software Publish Panoramic Views Any User + FREE Viewer Software Web Connection Any User + FREE Viewer Software Publish.

Getting to Know TiVo: The Home Media Engine (HME SDK) Eric M. Upchurch CS 525 Spring 2008.

INSTALLING MICROSOFT EXCHANGE SERVER 2003 CLUSTERS AND FRONT-END AND BACK ‑ END SERVERS Chapter 4.

DISTRIBUTED DATA FLOW WEB-SERVICES FOR ACCESSING AND PROCESSING OF BIG DATA SETS IN EARTH SCIENCES A.A. Poyda 1, M.N. Zhizhin 1, D.P. Medvedev 2, D.Y.

1 High level view of HDF5 Data structures and library HDF Summit Boeing Seattle September 19, 2006.

10/13/2015 ©2006 Scott Miller, University of Victoria 1 Content Serving Static vs. Dynamic Content Web Servers Server Flow Control Rev. 2.0.

Gregory Fotiades.  Global illumination techniques are highly desirable for realistic interaction due to their high level of accuracy and photorealism.

CHAPTER TEN AUTHORING.

Syzygy Design overview Distributed Scene Graph Master/slave application framework I/O Device Integration using Syzygy Scaling down: simulators and other.

CMAQ Runtime Performance as Affected by Number of Processors and NFS Writes Patricia A. Bresnahan, a * Ahmed Ibrahim b, Jesse Bash a and David Miller a.

1 John Magee 9 November 2012 CS120 Lecture 17: The World Wide Web and HTML Web Publishing.

WRF Domain Wizard The WRF Preprocessing System GUI Jeff S Smith Paula McCaslin and Mark Govett AMS 2008 Presentation.

ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.

Mark Rast Laboratory for Atmospheric and Space Physics Department of Astrophysical and Planetary Sciences University of Colorado, Boulder Kiepenheuer-Institut.

A High performance I/O Module: the HDF5 WRF I/O module Muqun Yang, Robert E. McGrath, Mike Folk National Center for Supercomputing Applications University.

Chapter 10 Chapter 10: Managing the Distributed File System, Disk Quotas, and Software Installation.

Framework for MDO Studies Amitay Isaacs Center for Aerospace System Design and Engineering IIT Bombay.

Interactive Rendering With Coherent Ray Tracing Eurogaphics 2001 Wald, Slusallek, Benthin, Wagner Comp 238, UNC-CH, September 10, 2001 Joshua Stough.

IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.

GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou

*Partially funded by the Austrian Grid Project (BMBWK GZ 4003/2-VI/4c/2004) Making the Best of Your Data - Offloading Visualization Tasks onto the Grid.

Computer Graphics II University of Illinois at Chicago Volume Rendering Presentation for Computer Graphics II Prof. Andy Johnson By Raj Vikram Singh.

—————————— CACI Products Company - ——————————————————— COMNET III —————————————— 1-1 Day 1 - COMNET Program Operation, Network Topology.

Program 2 due 02/01  Be sure to document your program  program level doc  your name  what the program does  each function  describe the arguments.

VMware vSphere Configuration and Management v6

Center for Computational Visualization University of Texas, Austin Visualization and Graphics Research Group University of California, Davis Molecular.

SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.

LCSE – NCSA Partnership Accomplishments, FY01 Paul R. Woodward Laboratory for Computational Science & Engineering University of Minnesota October 17, 2001.

Hands-On Microsoft Windows Server 2008 Chapter 7 Configuring and Managing Data Storage.

Adobe Flash Professional CS5 – Illustrated Unit E: Optimizing and Publishing a Movie.

Understanding your FLOW-3D simulations better with EnSight June 2012.

1 Supporting a Volume Rendering Application on a Grid-Middleware For Streaming Data Liang Chen Gagan Agrawal Computer Science & Engineering Ohio State.

1 RIC 2009 Symbolic Nuclear Analysis Package - SNAP version 1.0: Features and Applications Chester Gingrich RES/DSA/CDB 3/12/09.

Objective % Select and utilize tools to design and develop websites.

How Alluxio (formerly Tachyon) brings a 300x performance improvement to Qunar’s streaming processing Xueyan Li (Qunar) & Chunming Li (Garena)

Chapter 11: File System Implementation

Network Load Balancing

In-situ Visualization using VisIt

Tamas Szalay, Volker Springel, Gerard Lemson

Objective % Select and utilize tools to design and develop websites.

2.02G Publishing Animated Videos

2.02F Publishing Animated Videos

Hadoop Technopoints.

Objective Understand web-based digital media production methods, software, and hardware. Course Weight : 10%

New Round of Regional data collections Deltares

Chapter-1 Computer is an advanced electronic device that takes raw data as an input from the user and processes it under the control of a set of instructions.

MapReduce: Simplified Data Processing on Large Clusters

Presentation transcript:

MEAD: Volume Visualization David Porter, U. Minnesota/LCSE Data Pipeline A3D HVR Tiled Commas Output Windows & Unix Formats & Frameworks linking to MEAD

Data Pipeline Hydro-code: WRF/COMMAS ROMS Raw Fields (U,V,W,…) Formats: (HDF5, WRF, cdump) Data Post-Processing: A3D Block-Tree Hierarchies Derived Fields (Humidity, Vorticity) Volume Visualization: HVR Raster Data: (Images, Movies)

A3D: More Than Just Compression, Conversion, Scaling Reads in raw 3D fields onto a stack Tiled cdump, BoF, HDF4,  HDF5, netCDF? Performs calculations on this stack fields +-*/, d/dx, spatial filters, map from sigma-coords. (mm5) Produces statistical reductions power spectra,structure functions, histograms,radial & vertical profiles BoF, BoB, SoF, SoB filescross-correlations as well as Block Tree hierarchies for visualization. Energy Spectra(k) MLT coefficients(Z) MM5 simulation

Block Tree Hierarchy: Basic Idea Illustration: A 2 level hierarchy in 2D 16x16 array is split into 4 tiles Each tile is sampled at a stride of 2x2 8x8 array of info in each node of tree

3D Block-Tree A 3D mipmap Browse even the largest data sets at interactive speeds. Full size of data only limited by disk. Trees can be both logically and spatially irregular. Highest resolution need not span entire domain. Block size tuned to both hardware and application. = 128x128x

HVR Organize voxel data into a Block-Tree hierarchy Stage large volumes of data on disk Data compression: 1 byte per voxel & Tree Pruning Control rendering quality vs. speed via tree traversal DCOM rendering server: HVR-SERVER Use key framing to specify complex path in space and time Interactive GUI driven: HVR-GUI Tree hierarchy + key framing facilitate remote rendering Root of Block-Tree hierarchy ideal for local key framing needs Key framing software delineates division of labor between Local and remote resources & work. Optimized use of network bandwidth

Rendering Tolerances Tolerances based on Angle subtended by voxel Color map index error Absolute resolution (For speed only) 2D illustration Quad-tree hierarchy Each tile might be 256x256

Tolerance: Based on Angle Subtended Viewpoint If a voxel at a given resolution subtends to great an angle, then scan down to finer resolution.

Tolerance: Based on Max. Error in Value Nodes have bound on error Const color  no error Stop at nodes w/ no error

Remote Rendering: Routines Local HVR-GUI HVR-SERVER MOVIE PLAYER Remote HVR-SERVER

Remote Rendering: Data Local Finder Bricks Key Frame Parameters Color & Alpha LUT Low-Mid Sized Movies Remote Block-Tree Hierarchy Key Frame Parameters Color & Alpha LUT Low-Mid Sized Movies Power Wall Movies TinyKB- SmallMB MediumGB LargeTB+

Example: Tiled COMMAS PC-cluster simulation produces “tiled output” Titan cluster Logistics: 10 3 files randomly distributed across ~10 2 nodes Tiles are collected to post-processing hosts SCP to LCSE PC-rendering cluster Logistics: cdump files redistributed across nodes A3D reads tiled cdumps and produces derived scalar volume data in block tree format. Fields: W, vorticity, cloud water (*.hv files) Logistics: hv files redistributed to rendering cluster HVR produces images & movies Logistics: Need data a base: MySQL

COMMAS: 96x96x36 (4x4 tiles)

COMMAS: 250x250x72 (5x5 tiles)

Porting to Unix WindowsUnixOpenGL WGLGLUT DCOMCORBA? Condor? GUI: MFCFLTK? XML? Command line? Subroutine? Your framework?

Data Formats I’m looking for a few good data sets. WRF ROMS In a few relevant formats netCDF HDF5 Data Sets Please …

Frameworks I’m looking for a few good frameworks Connecting a few relevant centers APIs Please …

Web Link Downloads of volume rendering apps for your PC Downloads of software under GNU GPL Many volume rendered movies User Guide to the Graphical user interface: hvr_gui Description of the Hierarchical Volume Rendering server hvr_server Software for producing volume data in Block Tree format

LCSE MEAD Milestones (Q1)Simplified code (COMMAS) running w/ SHMOD HVR Vol Vis of WRF datasets via data postproc w/ a3d (Q2)Simplified code with dynamic load balancing HVR vis of ROMS data. (Q3)Simplified code running in fault tolerant mode (Q4)Simplified code running on TeraGrid HVR vis of data on TeraGrid.