Synthetic satellite imagery Louie Grasso Cooperative Institute for Research in the Atmosphere NOAA/NESDIS CoRP 15-16 August 2006.

Slides:



Advertisements
Similar presentations
GPU Virtualization Support in Cloud System Ching-Chi Lin Institute of Information Science, Academia Sinica Department of Computer Science and Information.
Advertisements

Severe Weather Applications with GOES-R: What will severe weather look like through the “eyes” of GOES-R? Dan Lindsey NOAA/NESDIS/STAR/RAMMB Fort Collins,
NOAA-CoRP Symposium, Aug 15-18, 2006 Radiative Transfer Modeling for Simulating GOES-R imagery Manajit Sengupta 1 Contributions from: Louie Grasso 1, Jack.
32-bit 1) 1997: AIX operating system, 196 Mbytes of ram, few hundred Mbytes of disk space, RAMS-3b. 2) 1998: Linux operating system, 512 Mbytes of ram,
SDI (Satellite Data Ingestor) 2015 McIDAS Users Group Meeting June 8, 2015.
Joe Sienkiewicz 1, Michael Folmer 2 and Hugh Cobb 3 1 NOAA/NWS/NCEP/OPC 2 University of Maryland/ESSIC/CICS 3 NOAA/NWS/NCEP/NHC/ Tropical Analysis and.
GOES-R Synthetic Imagery over Alaska Dan Lindsey NOAA/NESDIS, SaTellite Applications and Research (STAR) Regional And Mesoscale Meteorology Branch (RAMMB)
Introduction and Methodology Daniel T. Lindsey*, NOAA/NESDIS/STAR/RAMMB Louie Grasso, Cooperative Institute for Research in the Atmosphere
Synthetic Satellite Imagery: A New Tool for GOES-R User Readiness and Cloud Forecast Visualization Dan Lindsey NOAA/NESDIS, SaTellite Applications and.
GOES-R Proving Ground Product Development at CIRA Project Overview The GOES-R Satellite Proving Ground project engages the National Weather Service in.
An Update of CIRA’s GOES-R and JPSS Proving Ground Activities Ed Szoke 1,2, Dan Bikos 1, Renate Brummer 1, Hiro Gosden 1, Steve Miller 1, Curtis Seaman.
Incorporation of TAMDAR into Real-time Local Modeling Tom Hultquist Science & Operations Officer NOAA/National Weather Service Marquette, MI.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
An Example of the use of Synthetic 3.9 µm GOES-12 Imagery for Two- Moment Microphysical Evaluation Lewis D. Grasso (1) Cooperative Institute for Research.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
Comparing High-End Computer Architectures for Business Applications Presentation: 493 Track: HP-UX Dr. Frank Baetke HP.
MURI Hardware Resources Ray Garcia Erik Olson Space Science and Engineering Center at the University of WI - Madison.
Poster 1.66 An Update on CIRA’s GOES-R Proving Ground Activities Ed Szoke 1,2, Renate Brummer 1, Hiro Gosden 1, Steve Miller 1, Mark DeMaria 3, Dan Lindsey.
Block1 Wrapping Your Nugget Around Distributed Processing.
GOES-R ABI PROXY DATA SET GENERATION AT CIMSS Mathew M. Gunshor, Justin Sieglaff, Erik Olson, Thomas Greenwald, Jason Otkin, and Allen Huang Cooperative.
CMAQ Runtime Performance as Affected by Number of Processors and NFS Writes Patricia A. Bresnahan, a * Ahmed Ibrahim b, Jesse Bash a and David Miller a.
Batch Scheduling at LeSC with Sun Grid Engine David McBride Systems Programmer London e-Science Centre Department of Computing, Imperial College.
The GOES-R Algorithm Working Group (AWG) program requests a high quality of proxy data for algorithm developments, testing and assessments. The central.
GOES-R ABI New Product Development Donald W. Hillger NOAA/NESDIS, SaTellite Applications and Research (STAR) Regional And Mesoscale Meteorology Branch.
6/26/01High Throughput Linux Clustering at Fermilab--S. Timm 1 High Throughput Linux Clustering at Fermilab Steven C. Timm--Fermilab.
Jack Dostalek Louie Grasso Manajit Sengupta Mark DeMaria Synthetic GOES-R and NPOESS Imagery of Mesoscale Weather Events Overview This poster contains.
Achieving Scalability, Performance and Availability on Linux with Oracle 9iR2-RAC Grant McAlister Senior Database Engineer Amazon.com Paper
Experience with the Thumper Wei Yang Stanford Linear Accelerator Center May 27-28, 2008 US ATLAS Tier 2/3 workshop University of Michigan, Ann Arbor.
GOES-R ABI Synthetic Imagery at 3.9 and 2.25 µm 24Feb2015 Poster 2 Louie Grasso, Yoo-Jeong Noh CIRA/Colorado State University, Fort Collins, CO
Advanced Baseline Imager (ABI) will be flown on the next generation of NOAA Geostationary Operational Environmental Satellite (GOES)-R platform. The sensor.
On the use of Synthetic Satellite Imagery to Evaluate Numerically Simulated Clouds Lewis D. Grasso (1) Cooperative Institute for Research in the Atmosphere,
Hurricane Intensity Estimation from GOES-R Hyperspectral Environmental Suite Eye Sounding Fourth GOES-R Users’ Conference Mark DeMaria NESDIS/ORA-STAR,
Cooperative Institute for Meteorological Satellite Studies University of Wisconsin - Madison ABI and AIRS Retrievals in McIDAS-V Kaba Bah.
Near-Real-Time Simulated ABI Imagery for User Readiness, Retrieval Algorithm Evaluation and Model Verification Tom Greenwald, Brad Pierce*, Jason Otkin,
January 7, 2015 Walter Wolf, Jaime Daniels, and Lihang Zhou NOAA/NESDIS, Center for Satellite Applications and Research (STAR) Shanna Sampson, Tom King,
ATmospheric, Meteorological, and Environmental Technologies RAMS Parallel Processing Techniques.
Active Storage Processing in Parallel File Systems Jarek Nieplocha Evan Felix Juan Piernas-Canovas SDM CENTER.
Modeling GOES-R µm brightness temperature differences above cold thunderstorm tops Introduction As the time for the launch of GOES-R approaches,
A Statistical Assessment of Mesoscale Model Output using Computed Radiances and GOES Observations Manajit Sengupta 1, Louie Grasso 1, Daniel Lindsey 2.
Comparison Synthetic and Observed GOES-13 Imagery of hurricane Earl Lewis Grasso a Daniel T. Lindsey b Clark Evans c a Cooperative Institute for Research.
Update on the Northwest Regional Modeling System 2015 Cliff Mass and David Ovens University of Washington.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Dan Lindsey Louie Grasso Manajit Sengupta Mark DeMaria Synthetic GOES-R Imagery Development and Uses Introduction Synthetic GOES-R ABI imagery has been.
Final Implementation of a High Performance Computing Cluster at Florida Tech P. FORD, X. FAVE, K. GNANVO, R. HOCH, M. HOHLMANN, D. MITRA Physics and Space.
Introduction to Database Systems1 External Sorting Query Processing: Topic 0.
Computing Issues for the ATLAS SWT2. What is SWT2? SWT2 is the U.S. ATLAS Southwestern Tier 2 Consortium UTA is lead institution, along with University.
External Sorting. Why Sort? A classic problem in computer science! Data requested in sorted order –e.g., find students in increasing gpa order Sorting.
3-5/10/2005, LjubljanaEWGLAM/SRNWP meeting NWP related Slovak Hydrometeorological Institute 2005.
Computer Performance. Hard Drive - HDD Stores your files, programs, and information. If it gets full, you can’t save any more. Measured in bytes (KB,
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
GOES-R ABI AS A WARNING AID Louie Grasso, Renate Brummer, and Robert DeMaria CIRA, Fort Collins, CO Dan Lindsey, Don Hillger, NOAA/NESDIS/RAMMB, Fort Collins,
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Combining GOES Observations with Other Data to Improve Severe Weather Forecasts.
A. FY12-13 GIMPAP Project Proposal Title Page version 26 October 2011 Title: WRF Cloud and Moisture Verification with GOES Status: New GOES Utilization.
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
12/19/01MODIS Science Team Meeting1 MODAPS Status and Plans Edward Masuoka, Code 922 MODIS Science Data Support Team NASA’s Goddard Space Flight Center.
IPPP Grid Cluster Phil Roffe David Ambrose-Griffith.
Title of the Poster Supervised By: Prof.*********
True-Color Imagery for GOES-R: Creating a Green Band for ABI
NL Service Challenge Plans
Introduction.
Progress Report I: Simulation of GOES Radiances for OSSE
Multi-Scale Spatiotemporal Mining of Atmospheric Data
Andy Wang COP 5611 Advanced Operating Systems
Synthetic GOES-R Imagery of Agricultural Burning and Forest Wildfires
Preparation for use of the GOES-R Advanced Baseline Imager (ABI)
Haiyan Meng and Douglas Thain
Generation of Cloud Products from NOAA’s Operational Satellite Imagers
Andy Wang COP 5611 Advanced Operating Systems
External Sorting.
The Gamma Operator for Big Data Summarization on an Array DBMS
Presentation transcript:

Synthetic satellite imagery Louie Grasso Cooperative Institute for Research in the Atmosphere NOAA/NESDIS CoRP August 2006

Introduction Motivation 32-bit GOESR and NPOESS. 64-bit cluster. Simulations and synthetic imagery Summary.

Motivation 1)Better understand satellite imagery. That is, synthetic satellite imagery can be used with model output to understand the imagery. 2)Synthetic satellite data can be used to aid in algorithm development. 3)Synthetic imagery can be used for NWPmodel verification.

32-bit 1) 1997: AIX operating system, 196 Mbytes of ram, few hundred Mbytes of disk space, RAMS-3b. 2) 1998: Linux operating system, 512 Mbytes of ram, 500 Mbytes of disk space, RAMS-429. Wow! Just think what I can do now. 3) Upgrades! 1 Gbyte of ram  2 Gbytes of ram  3.3 Gbytes of ram. Standard Linux Kernel  Bigman Kernel  Experimental Kernel. Disk space increased to 100 Gbytes. RAMS-43. Oh boy! Just think what I can do now. 4) 32-bit cluster, 20 dual processor nodes, 2 Gbytes of ram, few hundred Gbytes of disk space. Test RAMS-43. Gee-wee what a fast machine! Just think what I can do now.

GOESR and NPOESS 1) Run RAMS43 and use output to make synthetic GOESR-ABI and NPOESS VIIRS images for three mesoscale weather events. 2) 200 Gbytes of disk space should be plenty—I was in for a surprise! 3) 32-bit 4 Gbyte ram too restrictive. GOESR-ABI has 2 km footprint, but I had to use 4 km horizontal grid spacings. NPOESS VIIRS has a horizontal footprint near 400 m, but I had to use 1 km horizontal grid spacings. 4) Horizontal extent of domain too small to produce a realistic looking synthetic satellite image. 5) Must move to 64-bit cluster: A whole new world!

64-bit 1) Test RAMS43. (a) Reproduce a 32-bit run, (b) Exceed 4 GB of ram. 2) Repeat (6), this time do runs in parallel. 3) More ram added: 8GB  16GB  32GB. 32GB is hardware limit. 4) More disk space added: 500GB  1TB  2.5TB raid  to 10TB raid. 5) Each time more ram was added, I re-ran the same job to take advantage of the extra memory by increasing the horizontal domain. 6) The first time I submitted a 25 GB job, a lot of time went by before the model wrote out the initial data. I thought something was wrong, so I did what any good scientist would do—kill the job! 7) Fifteen minutes passed before RAMS43 wrote out 15 GB of initial data. I had no idea the files would be this large.

Simulations Grid 1Grid 2Grid 3Grid 4 8 May x66192x162502x x Feb x66192x162502x522992x902 1 Oct x66192x162932x x1002 Table 1: Number of x and y points for each grid in each simulation. Start grids 1-3 Stop grids 1-3 Start grid 4 Stop grid 4 8 May z20 z17 z20 z 12 Feb z19 z17 z19 z 1 Oct z00 z 3 Oct18z 2 Oct00z 3 Oct Table 2: Start and stop times for each grid in each simulation.

Synthetic 2 km ABI Bands May Severe Weather Case (19 UTC) 3.9 µm 6.2 µm 7.0 µm 7.3 µm 8.5 µm 9.6 µm µm 11.2 µm 12.3 µm 13.3 µm

GOES-12 at 10.7µm GOES-R at µm NPOESS VIIRS at µm 4 km 2 km 400 m Synthetic GOES-12, GOES-R, and NPOESS-VIIRS imagery. 2 Oct 2002 Hurricane Lili 12 February 2003 Lake effect snow 8 May 2003 Severe weather

Summary Motivation 32-bit GOESR and NPOESS. 64-bit cluster. Simulations and synthetic imagery