Exploding Earth Observation Data Example: New Zealand is about 270,00 km 2. 25 Landsat Path/Rows – TM/ETM+ – 30m resolution – ~220 images each – ~30 years.

Slides:



Advertisements
Similar presentations
An Australian Geoscience Data Cube
Advertisements

MODIS The MODerate-resolution Imaging Spectroradiometer (MODIS ) Kirsten de Beurs.
ElectroScience Lab Studies of Radio Frequency Interference in SMOS Observations IGARSS 2011 Joel T. Johnson and Mustafa Aksoy Department of Electrical.
Tablet Computers Georgia 4- H Cotton Boll and Consumer Judging 2013.
Application of Parallel Computing to the Simulation of Chaotic Dynamics AndrewKostousov, Ural State University.
Major Challenges Facing Canada and the World
Linear Programming Special Cases Alternate Optimal Solutions No Feasible Solution Unbounded Solutions.
1 PSC update July 3, 2008 Ralph Roskies, Scientific Director Pittsburgh Supercomputing Center
Advanced Scientific Visualization Paul Navrátil 28 May 2009.
PHYC Environmental Physics Climate, Climate Change Nuclear Power and the Alternatives.
An Approach to Active Spatial Data Mining Wei Wang Data Mining Lab, UCLA March 24, 1999.
Given Connections Solution
CEOS System Engineering Toolset (CSET) CSET is a Software Framework + Suite of Tools (Apps) that leverages a Common Architecture, Unified Data Model, Common.
University of Zimbabwe Department of Geography and Environmental Science (DGES) Dr. Amon Murwira Phone:
Tablet Computers Georgia 4- H Cotton Boll and Consumer Judging 2013.
Indrani Kommareddy, David Roy & Junchang Ju Geographic Information Science Center of Excellence South Dakota State University, USA Web-enabled Landsat.
Historical Flood Mapping from Satellite Imagery Norman Mueller National Earth Observation Group.
Presented by High-Performance Visualization of Geographic Data Budhendra Bhaduri Alexandre Sorokine Geographic Information Science and Technology Computational.
ICTs for e-Environment: adapting to climate change and resource depletion Richard Labelle ICT Strategist & ITU-D Consultant The Aylmer.
EU 2nd Year Review – Jan – WP9 WP9 Earth Observation Applications Demonstration Pedro Goncalves :
Breathing New Life Into An Old Laptop. Give an Old Laptop New Life with Cheap (or Free) Projects Picture frame Wireless Bridge File Server Printer server.
“SEMI-AUTOMATED PARALLELISM USING STAR-P " “SEMI-AUTOMATED PARALLELISM USING STAR-P " Dana Schaa 1, David Kaeli 1 and Alan Edelman 2 2 Interactive Supercomputing.
Using the Google Public Data Explorer as a Learning Tool in the University Geography Classroom Thomas J. Pingel and Devin Moeller Department of Geography.
BISQUE: Enabling Cloud and Grid Powered Image Analysis Ramona Walls iPlant Collaborative
U.S. Department of the Interior U.S. Geological Survey Web and Mobile Application Updates GFSAD30 March 2015 Meeting Justin Poehnelt, Student Developer.
Global Land Cover Facility The Global Land Cover Facility (GLCF) is a member of the Earth Science Information Partnership (ESIP) Federation providing data,
Energy Use of Subway Networks in the Sustainability era 1 Sybil Derrible, Ph.D. Candidate, Department.
Large Scientific Databases. Large scientific datasets are those which are systematically collected and organized and which stretch the technical capabilites.
“OnEarth” WMS Server WMS Global Mosaic Lucian Plesea Jet Propulsion Laboratory California Institute of Technology.
Teaching With Maps Teaching and learning soil science with maps in the field –began in 2005 Students study maps while in the field and learn how to connect.
1 Buses and types of computer. Paul Strickland Liverpool John Moores University.
Jonas Eberle 25th March Automatization of information extraction to build up a crowd-sourced reference database for vegetation changes Jonas Eberle,
The climate and climate variability of the wind power resource in the Great Lakes region of the United States Sharon Zhong 1 *, Xiuping Li 1, Xindi Bian.
Public Relations Interim Image Archive Goal: Provide and INTERIM image archive solution for Public Relations 2 to 4 TB of images currently spread across.
Department of Computer Science & Engineering Green Client/Server Software to Save Energy in Network Devices Axel Vigo, Mentor: Miguel Jimeno, Advisor:
Lab 14 Department of Computer Science and Information Engineering National Taiwan University Lab14 – Camera 2014/12/30 1 /14.
EVLA Data Processing PDR Scale of processing needs Tim Cornwell, NRAO.
CHAPTER 2: BASIC OF OPEN SOURCE OPERATING SYSTEM Part 2 (Linux installation)
1 NAC-Slide: Displaying Very Large NAC Images Robert Wagner Mentor: Mark Robinson School of Earth and Space Exploration, ASU 17 April 2010.
Status of Spatial Quality Activities in Uruguay, South America Carlos López Vázquez Centro de Cálculo, Faculty of Engineering
Engineering Excellence Trustworthy Computing Microsoft Confidential IT – A Key Tool in Addressing Environmental Challenges IT has an important role to.
Using the National Land Cover Database and LIDAR to reveal urban abandonment in Detroit Emily Thompson, Kirsten de Beurs Department of Geography and Environmental.
Version 1.1 Improving our knowledge of metaheuristic approaches for cell suppression problem Andrea Toniolo Staggemeier Alistair R. Clark James Smith Jonathan.
World Comparison Graphs By Zak Abdulwasi. Questions For Internet user graph 1.What country has the largest column? What are the reasons that you think.
Image Processing A Study in Pixel Averaging Building a Resolution Pyramid With Parallel Computing Denise Runnels and Farnaz Zand.
Qualities of an Aligned Lesson Aligning Content and Process.
The Hungarian ClusterGRID Project Péter Stefán research associate NIIF/HUNGARNET
Cropland mapping in South America
Observation vs. Inferences The Local Environment.
The Digital Portfolio Add samples of student work directly from the Gradebook into the Digital Portfolio Keep track of several different formats: Written.
Application for Morphological Image Processing Dan Campbell 12/13/06 University of Wisconsin – Madison Departments of Computer Engineering and Computer.
Filtering of map images by context tree modeling Pavel Kopylov and Pasi Fränti UNIVERSITY OF JOENSUU DEPARTMENT OF COMPUTER SCIENCE FINLAND.
PAGE 1 Solving Urban Challenges with Data Innovate UK, ESRC and NERC are to invest up to £7.5m in collaborative R&D projects (with a proportion available.
Accelerating K-Means Clustering with Parallel Implementations and GPU Computing Janki Bhimani Miriam Leeser Ningfang Mi
DataGrid France 12 Feb – WP9 – n° 1 WP9 Earth Observation Applications.
Google will Unveil Own Tablet. With the ongoing Google I/O developers conference this week will surely come a lot of surprises from the Internet giant,
Geography tools. Maps Hand held tools Computer based tools: Mapquest and Google Earth.
CNES DATA CUBE ERWANN poupart
Classifying LANDSAT images: Beginner’s edition (Jun20, 2017)
Seasons Globe Lab Inquiry
Computer Information Technology – Section 1-1
Super-Resolution Image Reconstruction
The Seasons and Earth’s Tilt
The Seasons and Earth’s Tilt
Do it now – PAGE 11 You will find your do it now task in your workbook – look for the start button! Wednesday, 21 November 2018.
Planet Lab Demo IP Address Map
Summary - end of term Lab Monday: 4 April return of assignments Lecture exam: 5 April, projects by end of term: April 6 Lecture evaluation.
INTRODUCTION TO GEOGRAPHY
The Image The pixels in the image The mask The resulting image 255 X
Method vs Perspective Geographic Method: using geographic information to describe the earth Geographic Perspective: a geographic grid through which information.
Presentation transcript:

Exploding Earth Observation Data Example: New Zealand is about 270,00 km Landsat Path/Rows – TM/ETM+ – 30m resolution – ~220 images each – ~30 years (mostly since 1999): – July 1999 – December 2012 – Total number of images for New Zealand alone > – Each image is ~ 1GB when processed. – Total amount of New Zealand data to process: 6000 GB  6TB. – Create 8-day dataset  another 7.5TB. Large increase in the number of freely available datasets. Projects quickly are becoming larger. Processing capabilities: Small Linux server (5 computers) with 4 processors each. Kirsten de Beurs, Department of Geography and Environmental Sustainability > 3 x data points

What if we want to investigate the US or North America? Conterminous United States: ~ 750 tiles (vs. 25 for New Zealand). North America: ~2500 tiles  100 times as much as New Zealand. 100 x 6TB  600TB just to process. Another 750TB to create results. Not possible on our current processing capabilities. Processing capabilities: Small Linux server (5 computers) with 4 processors each. Kirsten de Beurs, Department of Geography and Environmental Sustainability

Solutions? Google Earth Engine? Fox lab (Temple) Alternative: Parallelize all lab computers? DGES owns more than 100 already… most are used less than 12 hours per day. All are connected to our data servers. How do we do this? Is it feasible? Who can design this? Help?!? OU super computer? It does not seem reasonable to move that much data to the super computer. Processes can be carried out by pixel … Kirsten de Beurs, Department of Geography and Environmental Sustainability