Proximity Spider Project by Ganesh Naikare Project Advisor: Professor Scott Spetka.

Slides:



Advertisements
Similar presentations
Large Scale Computing Systems
Advertisements

WEB & MOBILE CLOUD APP With Bootstrap, Backbone, Pusher, AWS, Slim Gabriele Mittica –
Adding scalability to legacy PHP web applications Overview Mario A. Valdez-Ramirez.
13 October 2010 UGFIDD Unstructured Geospatial File Indexer and Distributed Dissemination 1.
Presentation Outline  Project Aims  Introduction of Digital Video Library  Introduction of Our Work  Considerations and Approach  Design and Implementation.
A reactive location-based service for geo-referenced individual data collection and analysis Xiujun Ma Department of Machine Intelligence, Peking University.
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
Benchmarking XML storage systems Information Systems Lab HS 2007 Final Presentation © ETH Zürich | Benchmarking XML.
Gas Tracker 9000 Semester Project EEL 6788 Spring 2010 Chris Giles EEL April-2010 University of Central Florida.
Web Search – Summer Term 2006 V. Web Search - Page Repository (c) Wolfgang Hürst, Albert-Ludwigs-University.
Open Source Databases and GIS
Development of mobile applications using PhoneGap and HTML 5
Building Web Applications with SQL Azure David Robinson Senior Program Manager SQL Azure
Hadoop Team: Role of Hadoop in the IDEAL Project ●Jose Cadena ●Chengyuan Wen ●Mengsu Chen CS5604 Spring 2015 Instructor: Dr. Edward Fox.
ResourceFull Authors: Matt Kaye (EE ‘12) Nitin Puri (SSE ‘12) Advisor: Dr. Alejandro Ribeiro Special Thanks.
Advances in Technology and CRIS Nikos Houssos National Documentation Centre / National Hellenic Research Foundation, Greece euroCRIS Task Group Leader.
Processing and Analyzing Large log from Search Engine Meng Dou 13/9/2012.
MEAN Stack c0nrad. Overview Day 1: – MEAN Stack – NodeJS Mini Cat Fact Spammer – MongoDB Cat Profiles – Express Catbook API (Facebook for cats) Day 2:
A Metadata Catalog Service for Data Intensive Applications Presented by Chin-Yi Tsai.
Panagiotis Antonopoulos Microsoft Corp Ioannis Konstantinou National Technical University of Athens Dimitrios Tsoumakos.
Distributed Indexing of Web Scale Datasets for the Cloud {ikons, eangelou, Computing Systems Laboratory School of Electrical.
The IRI Climate Data Library: translating between data cultures Benno Blumenthal International Research Institute for Climate Prediction Columbia University.
Storage and Retrieval of Large RDF Graph Using Hadoop and MapReduce Mohammad Farhan Husain, Pankil Doshi, Latifur Khan, Bhavani Thuraisingham University.
A seminar on “Mobile Version of The Website”
Complex Data Transformations in Digital Libraries with Spatio-Temporal Information B. Martins, N. Freire, J. Borbinha Instituto Superior Técnico, Technical.
MySQL spatial indexing for GIS data in a web 2.0 internet application Brian Toone Samford University
Grid Computing & Semantic Web. Grid Computing Proposed with the idea of electric power grid; Aims at integrating large-scale (global scale) computing.
1/22/08 RTR Project Presentation to TPTF RTR Project Michael Daskalantonakis & Brian Cook.
Benchmarking Visualization Platform. The Platform Brief description.
13 October 2010 UGFIDD Unstructured Geospatial File Indexer and Distributed Dissemination 1.
Philadelphia, May 2–4, Philadelphia, May 2–4, Benjamin Lewis, Senior GIS Analyst,
Data Interoperability at the IRI: translating between data cultures Benno Blumenthal International Research Institute for Climate Prediction Columbia University.
CISC 849 : Applications in Fintech Namami Shukla Dept of Computer & Information Sciences University of Delaware iCARE : A Framework for Big Data Based.
Big Data Analytics Platforms. Our Team NameApplication Viborov MichaelApache Spark Bordeynik YanivApache Storm Abu Jabal FerasHPCC Oun JosephGoogle BigQuery.
ERDDAP The Next Generation of Data Servers Bob Simons DOC / NOAA / NMFS / SWFSC / ERD Monterey, CA Disclaimer: The opinions expressed.
A Portrait of the Semantic Web in Action Jeff Heflin and James Hendler IEEE Intelligent Systems December 6, 2010 Hyewon Lim.
Ronen Vaisenber, Zohrab Basmajian, Phong Pham, Keith Mogensen, Arjun Satish Mentors: Prof. Sharad Mehrotra, Prof. Ramesh Jain.
Scalable Verifiable Encrypted Search Encrypted Search with Third Party Support and Protection From Dishonest Data Stores.
CS422 Principles of Database Systems Introduction to NoSQL Chengyu Sun California State University, Los Angeles.
CPSC 8985 Fall 2015 P10 Web Crawler Mike Schmidt.
MarkLogic The Only Enterprise NoSQL Database Presented by: Aashi Rastogi ( ) Sanket Patel ( )
Abstract MarkLogic Database – Only Enterprise NoSQL DB Aashi Rastogi, Sanket V. Patel Department of Computer Science University of Bridgeport, Bridgeport,
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Our experience with NoSQL and MapReduce technologies Fabio Souto.
Microsoft Ignite /28/2017 6:07 PM
Large Scale Semantic Data Integration and Analytics through Cloud: A Case Study in Bioinformatics Tat Thang Parallel and Distributed Computing Centre,
Google App Engine. Contents Overview Getting Started Databases Inter-app Communications Modes.
Neo4j: GRAPH DATABASE 27 March, 2017
CS122B: Projects in Databases and Web Applications Spring 2017
CS 405G: Introduction to Database Systems
Currently Available FAA Google Visualization Tools
CS122B: Projects in Databases and Web Applications Winter 2017
MongoDB Er. Shiva K. Shrestha ME Computer, NCIT
Tracking and Booking Taxi
Presentation 2 Web Design.
NOSQL.
The Improvement of PaaS Platform ZENG Shu-Qing, Xu Jie-Bin 2010 First International Conference on Networking and Distributed Computing SQUARE.
Accessing Spatial Information from MaineDOT
NOSQL databases and Big Data Storage Systems
Geographic Information Systems
°.
Introduction to Spark.
Web Application Architectures
CS122B: Projects in Databases and Web Applications Spring 2018
Overview of big data tools
Spatial and temporal data management
Web Application Architectures
You’ve Got Documents! A MongoDB Jump Start
Cloud Computing for Data Analysis Pig|Hive|Hbase|Zookeeper
Web Technologies Computing Science Thompson Rivers University
Web Application Architectures
Presentation transcript:

Proximity Spider Project by Ganesh Naikare Project Advisor: Professor Scott Spetka

Outline Requirement Overview Challenges Existing Solutions Design Comparison Conclusion

Requirement Overview Web based application to use vast geospatial information Millions of records associated with geospatial information can be added and processed. Real-time geospatial operation capability and responsive nature of an application Application should be accessible via any computer, laptops, mobile devices.

Challenges Growing data size hinders performance in relational database technologies No inbuilt support for geospatial operations. Use of API for geospatial operations add up to the response time of an application and has limitations on their use. Need of database which performs well even with large data set and has inbuilt geospatial operations capability.

Existing Solutions Google Maps API – Usage limitations Bigtable by Google (fully-managed cloud NoSQL database service) – Not public until May 2015 Hadoop or Big Data – Good performance for large datasets but still need external solution for Lack of support for Spherical geometry in distance calculations.

Design Design Goals 99.99% Availability Easy to use interface accessible via mobile devices as well on mobile devices Fast response time Scalable design Low complexity

Project Modules Web Interface Google Maps API (for showing locations using pins on a map) Business Logic module Data access service – To translate programming language MongDB queries Database – Data storage, indexing & Geospatial operation engine.

Frameworks Used Spring Framework – Java Application Framework (Inversion of Control) SpringData MongoDB – To convert Criteria queries to MongoDB scripts Bootstrap – Responsive design HTML, CSS and JS Framework

Geospatial Operations Logic

MongoDB’s 2dSphere Index – Works with GeoJSON objects { type: " ", coordinates: } coordinates in longitude, latitude order. Point LineString Polygon MultiPoint MultiLineString MultiPolygon GeometryCollection Data Type Point - { type: "Point", coordinates: [ 40, 5 ] }

Geospatial Operations Logic MongoDB’s 2dSphere Index – Works with GeoJSON objects { type: " ", coordinates: } coordinates in longitude, latitude order. Point LineString Polygon MultiPoint MultiLineString MultiPolygon GeometryCollection Data Type Point - { type: "Point", coordinates: [ 40, 5 ] }

Spherical Geometry Support Circle circle = new Circle(point, radiusDistance); Criteria criteria = Criteria.where("location").withinSphere(circle); The above criteria gets translated into following query db.places.find( { loc: { $geoWithin: { $centerSphere: [ [ -74, ], 100 / ] } } } ) These three queries use radians for distance distance to radians: divide the distance by the radius of the sphere (e.g. the Earth)

Use Cases Searching for a location of particular interest

Use Cases Searching for a location of particular interest

Use Cases Adding a business/POI on the map

Performance Comparison

Conclusion Performance gain of NoSQL database increases with increasing data set as compared to relational database, allowing faster access. MongoDB Provides advantage of 2dSphere indexes and geospatial operations over other databases Schema less document database provisions storage of data different size, number, content in same collection. This makes application easily scalable.

Thank You Any Questions?