Zhi Hong （洪智） School of Computer Software, Tianjin University, Tianjin 300350, China.

Slides:



Advertisements
Similar presentations
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALToolKit.
Advertisements

Enabling Outreach with Virtual Observatories Mark Voit – NVO Outreach Coordinator.
Institute for Gravitational Research
LIBRA: Lightweight Data Skew Mitigation in MapReduce
Design Guidelines for Maximizing Lifetime and Avoiding Energy Holes in Sensor Networks with Uniform Distribution and Uniform Reporting Stephan Olariu Department.
CS144: Spatial Index. Example Dataset Grid File (2 points per bucket)
Query Processing of Massive Trajectory Data based on MapReduce Qiang Ma, Bin Yang (Fudan University) Weining Qian, Aoying Zhou (ECNU) Presented By: Xin.
Effectively Indexing Uncertain Moving Objects for Predictive Queries School of Computing National University of Singapore Department of Computer Science.
Coherency Sensitive Hashing (CSH) Simon Korman and Shai Avidan Dept. of Electrical Engineering Tel Aviv University ICCV2011 | 13th International Conference.
Relevance Feedback-Based Image Retrieval Interface Incorporating Region and Feature Saliency Patterns as Visualizable Image Similarity Criteria Speaker.
Video/Image Fingerprinting & Search Naren Chittar CS 223-B project, Winter 2008.
Describing Visual Air Quality Is A Complex Issue Depending On: characteristics of observer optical characteristics of target illumination of scene optical.
Astro-DISC: Astronomy and cosmology applications of distributed super computing.
Data provenance in astronomy Bob Mann Wide-Field Astronomy Unit University of Edinburgh
Improving web image search results using query-relative classifiers Josip Krapacy Moray Allanyy Jakob Verbeeky Fr´ed´eric Jurieyy.
© Spinnaker Labs, Inc. Google Cluster Computing Faculty Training Workshop Open Source Tools for Teaching.
1 Sangmi Pallickara Working with Big Data in the Geosciences - Finding the Needle in the Haystack Sangmi Pallickara Computer Science Department Colorado.
COMPUTER MODELS FOR SKY IMAGE ANALYSIS OF THE INASAN ZVENIGOROD OBSERVATORY Sergei Pirogov ( Institute of Astronomy, Russian Academy of Sciences) VIIth.
PAGE: A Framework for Easy Parallelization of Genomic Applications 1 Mucahid Kutlu Gagan Agrawal Department of Computer Science and Engineering The Ohio.
Face Detection And Recognition For Distributed Systems Meng Lin and Ermin Hodžić 1.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.
1 The Terabyte Analysis Machine Jim Annis, Gabriele Garzoglio, Jun 2001 Introduction The Cluster Environment The Distance Machine Framework Scales The.
SpatialHadoop:A MapReduce Framework
Strasbourg astronomical Data Centre (DS) Françoise GENOVA.
ICPP 2012 Indexing and Parallel Query Processing Support for Visualizing Climate Datasets Yu Su*, Gagan Agrawal*, Jonathan Woodring † *The Ohio State University.
FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University.
HPDC 2013 Taming Massive Distributed Datasets: Data Sampling Using Bitmap Indices Yu Su*, Gagan Agrawal*, Jonathan Woodring # Kary Myers #, Joanne Wendelberger.
Efficient OLAP Operations for Spatial Data Using P-Trees Baoying Wang, Fei Pan, Dongmei Ren, Yue Cui, Qiang Ding William Perrizo North Dakota State University.
Astronomy, Petabytes, and MySQL MySQL Conference Santa Clara, CA April 16, 2008 Kian-Tat Lim Stanford Linear Accelerator Center.
CS-498 Computer Vision Week 8, Day 3 Thresholding and morphological operators My thesis? 1.
SAGA: Array Storage as a DB with Support for Structural Aggregations SSDBM 2014 June 30 th, Aalborg, Denmark 1 Yi Wang, Arnab Nandi, Gagan Agrawal The.
The Integrated Project of Digital Seismological Observation Network Centre in IGP, CEA Institute of Geophysics China Earthquake Administration 2006,7,22.
CCGrid, 2012 Supporting User Defined Subsetting and Aggregation over Parallel NetCDF Datasets Yu Su and Gagan Agrawal Department of Computer Science and.
A New Spatial Index Structure for Efficient Query Processing in Location Based Services Speaker: Yihao Jhang Adviser: Yuling Hsueh 2010 IEEE International.
Conclusions Presenter: Manolis Koubarakis Extended Semantic Web Conference 2012.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
What can we see in the sky?. IN THE SKY WE CAN SEE MUCH MORE!
Z Knight W.M. Keck Observatories Research Supervisor: Al Conrad Home Institution: University of Hawai'i at Hilo A Graphical User Interface for NIRC2 Asteroid.
Title Authors Introduction Text, text, text, text, text, text Background Information Text, text, text, text, text, text Observations Text, text, text,
Image Processing A Study in Pixel Averaging Building a Resolution Pyramid With Parallel Computing Denise Runnels and Farnaz Zand.
SPIHT algorithm combined with Huffman encoding Wei Li, Zhen Peng Pang, Zhi Jie Liu, 2010 Third International Symposium on Intelligent Information Technology.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Company Fitness Challenge Super Computer Services, Inc. Your Name.
XRD data analysis software development. Outline  Background  Reasons for change  Conversion challenges  Status 2.
Image from
Robust Segmentation of Freight Containers in Train Monitoring Videos Qing-Jie Kong*, Avinash Kumar**, Narendra Ahuja**,Yuncai Liu* **Department of Electrical.
The First Release of AST3 point source catalog from Dome A, Antarctica in 2012 MA Bin, WEI Peng, SHANG Zhaohui, LIU Qiang, HU Yi (NAOC) 973 课题二
Measurement of Transverse Emittance in ASTA John Nocita Amber Johnson John Diamond August 8, 2013.
The CORNISH data reduction pipeline. Architecture - Overview AIPS Tasks Obit Tasks ObitTalk / Python Control Scripts MySQL Database Book-keeping Raw Data.
Elasticity in SciDB DBMS Team Members Gunjan Sharma(MT15015) Hiya popli(MT15020)
Managing Massive Trajectories on the Cloud
NRAO VLA Archive Survey
Massive Spatial Query on the Kepler Architecture
Pathology Spatial Analysis February 2017
1.01 Investigate graphic types and file formats.
Christian Böhm, Bernhard Braunmüller, Florian Krebs, and Hans-Peter Kriegel, University of Munich Epsilon Grid Order: An Algorithm for the Similarity.
Lossy Compression of DNA Microarray Images
SpatialHadoop: A MapReduce Framework for Spatial Data
Dynamic Indexing in SpatialHadoop
Selectivity Estimation of Big Spatial Data
Storage Systems for Managing Voluminous Data
Outline. A 2010 Mapping of the Constructed Surface Area Density for China Preliminary Results.
Real-World File Structures
Source：Multimedia Tools and Applications, Vol. 77, No. 20, pp , Oct
The Image The pixels in the image The mask The resulting image 255 X
Improving Deduplication by Accelerating Remainder Calculations
Big Earth Data Cloud Service Platform：Architecture & Service
An Iterative Method for Lossless Data Embedding in BMP Images
Presentation transcript:

Zhi Hong （洪智） School of Computer Software, Tianjin University, Tianjin , China

Outline Background Related Work AQUAdex Indexing Method Experimental Result Conclusion & Future Work

Background The problem of increasingly massive data sets an ocean of data available only a cup of that is really usefully for a specific demand In the field of astronomy China-VO accumulated over 100TB of observation data a standard file type: FITS (ASCII metadata) Time Series Image

Related Work Hadoop SciDB Hadoop-GIS SDS/Q PostgresRAW Starcatalog

Querying for Time Series Images Direct Indexing AQUAdex

Sky Partitioning with HEAPlix B D C A E

Experimental Results Indexing building overhead Within acceptable range Only a one-time thing Easily expendable

Experimental Results Partition level N Image size Target size

Experimental Results Query Performance

Conclusion & Future Work AQUAdex, an spatial indexing and querying method of astronomy image files is presented. Speed up the query up to 9X faster by partitioning the sky into pixels. Adaptability

Thank you! Feedback… - Astronomers ? - CS researchers ? Zhi China-VO /11/18

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.