Don’t Copy Data! Instead, Share it at Scale. Mark Korver Geospatial Lead – WWPS Solution Architecture.

Slides:



Advertisements
Similar presentations
Creating HIPAA-Compliant Medical Data Applications with Amazon Web Services Presented by, Tulika Srivastava Purdue University.
Advertisements

Concurrent Web Map Cache Server Zao Liu, Marlon Pierce, Geoffrey Fox Community Grids Laboratory Indiana University.
CHANGING THE WAY IT WORKS Cloud Computing 4/6/2015 Presented by S.Ganesh ( )
Gold Sponsors Bronze Sponsors Silver Sponsors Taking SharePoint to the Cloud Aaron Saikovski Readify – Software Solution Specialist.
Cloudifying Source Code Repositories: How much does it cost? LADIS 2009 Big Sky, Montana Michael Siegenthaler Hakim Weatherspoon Cornell University.
Amazon Web Services (aws) B. Ramamurthy. Introduction  Amazon.com, the online market place for goods, has leveraged the services that worked for their.
Amazon CloudFront An introductory discussion. What is Amazon CloudFront? 5/31/20122© e-Zest Solutions Ltd. Amazon CloudFront is a web service for content.
Cloud Computing Imranul Hoque. Today’s Cloud Computing.
Distributed Storage March 12, Distributed Storage What is Distributed Storage?  Simple answer: Storage that can be shared throughout a network.
Esri UC 2014 | Technical Workshop | Automating Cache Workflows and Tile Usage Heat Maps Eric J. Rodenberg.
NSDI and Cyberinfrastructure Doug Nebert April 2010.
Mercator/Coronelli ArcGIS Server 9.3 Data Management GIS Web Services Mapping Application Developer Tools Spatial Analysis Publishing to Clients Image.
Module 8: Concepts of a Network Load Balancing Cluster
Nikolay Tomitov Technical Trainer SoftAcad.bg.  What are Amazon Web services (AWS) ?  What’s cool when developing with AWS ?  Architecture of AWS 
Cloud Computing Economics Ville Volanen
Supervisor: Hadi Salimi Abdollah Ebrahimi Mazandaran University Of Science & Technology January,
Proxy servers By Akshit Y10. What is a proxy server O A proxy server is a computer that offers a computer network service to allow clients to make indirect.
Internet GIS. A vast network connecting computers throughout the world Computers on the Internet are physically connected Computers on the Internet use.
C LIENT /S ERVER AND P EER TO P EER National 4/5 Computing Science.
Near-realtime Software. September 22, 2009GONG H-alpha Review2 Laminate From Wikipedia: A laminate is a material constructed by uniting two or more layers.
Cloud Computing.
IT 210 The Internet & World Wide Web introduction.
Tips for working with disconnected web mapping apps Andy Gup, Javier Abadia.
Lecture 15 – Amazon Network as a Service. Recall IaaS Server as a Service Storage as a Service Network as a Service.
Cloud based storage. Cloud Storage Storage accessed by a web service API It is a block storage, it exposes its storage to clients as Raw storage that.
Cloud Computing. What is Cloud Computing? Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable.
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
CustomerSegment and workloads Your Datacenter Active Directory SharePoint SQL Server.
Software Architecture
MIT Consistent Hashing: Load Balancing in a Changing World David Karger, Eric Lehman, Tom Leighton, Matt Levine, Daniel Lewin, Rina Panigrahy.
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 2.
Slide 1 Physical Architecture Layer Design Chapter 13.
Cloudifying Source Code Repositories: How much does it cost? 1 Hadi Salimi, Distributed Systems Labaratory, School of Computer Engineering, Iran University.
1 NAT & RTP Proxy Date: 2009/7/2 Speaker: Ni-Ya Li Advisor: Quincy Wu.
Deploying a VGI application in one day Tom Brenneman.
A Survey on Network Storage Ning Zong Haibin Song Richard Alimi Richard Yang.
The VAO is operated by the VAO, LLC. What is cloud computing and how can scientists use it? Matthew J. Graham, Caltech.
Offline Web Apps - an offline web application is a list of URLs for HTML, CSS, JavaScript, images, or any other kind of resource. Most browsers have offline.
1 WWW. 2 World Wide Web Major application protocol used on the Internet Simple interface Two concepts –Point –Click.
ITGS Network Architecture. ITGS Network architecture –The way computers are logically organized on a network, and the role each takes. Client/server network.
HADOOP DISTRIBUTED FILE SYSTEM HDFS Reliability Based on “The Hadoop Distributed File System” K. Shvachko et al., MSST 2010 Michael Tsitrin 26/05/13.
Internet Applications (Cont’d) Basic Internet Applications – World Wide Web (WWW) Browser Architecture Static Documents Dynamic Documents Active Documents.
Vignesh Ravindran Sankarbala Manoharan. Infrastructure As A Service (IAAS) is a model that is used to deliver a platform virtualization environment with.
Cloud Computing ILAS project DONE BY:. Table of content INTRODUCTION. ◦ Cloud computing in general ◦ What are the things that worked during the implementation.
© Copyright 2015 EMC Corporation. All rights reserved. EMC Isilon Scale-out NAS For Syncplicity.
Cloud Computing: Pay-per-Use for On-Demand Scalability Developing Cloud Computing Applications with Open Source Technologies Shlomo Swidler.
CloudBerry Explorer for S3. CB Explorer Free to use Browse and manage files PowerShell functions Open and edit files  CloudBerry Explorer is an easy.
Distributed Storage Middleware To build a distributed web storage service for small files; To provides RESTFUL interface to access files and directories.
© 2010 IBM Corporation What’s New in RSA 8.0 Beta 1 – Tools for the IBM Compute Cloud March, 2010.
High-Availability ArcGIS for Server and Application Architecture in Amazon David McGuire.
Fault – Tolerant Distributed Multimedia Streaming Web Application By Nirvan Sagar – Srishti Ganjoo – Syed Shahbaaz Safir
Amazon Web Services (aws)
Amazon Network as a Service
From Algorithm to System to Cloud Computing
Everything you need to know!
Exceedra + Azure Mark Rendle Principal Software Architect
Amazon AWS Solution Architect Associate Exam Dumps For Full Exam Info Visit This Link:
AWS Certified Big Data - Specialty Dumps PDF AWS Certified Big Data - Specialty WANT TO PASS.
Comparison of LAN, MAN, WAN
Jinyang Li’s Research Distributed Systems Wireless Networks
Massively Parallel Processing in Azure Comparing Hadoop and SQL based MPP architectures in the cloud Josh Sivey SQL Saturday #597 | Phoenix.
The Plant Database.
Building a Database on S3
AWS Cloud Computing Masaki.
In BI, One Size Does Not Fit All
Edge Recorder Client
Outline Review of Quiz #1 Distributed File Systems 4/20/2019 COP5611.
Ch 9 – Distributed Filesystem
Client/Server and Peer to Peer
Your computer is the client
Presentation transcript:

Don’t Copy Data! Instead, Share it at Scale. Mark Korver Geospatial Lead – WWPS Solution Architecture

Data Copies are Expensive Storage cost Network cost Compute cost Cost to update distributed copies

Overcoming A World of Silos

What makes Cloud Storage Different? Not silo’d in a datacenter You can provision (in real-time) granular access to it ( or Not ). You can off-load network egress cost.

What Costs Remain? Storage cost (but just one copy for all) Network cost (paid by requester) Compute cost (no ftp servers necessary) Cost to update distributed copies

Shared Ortho Image Sample Architecture

Think URLs not Copies

Simple Storage Service (S3)

Many S3 Clients

Requester Pays Bucket

Many Views of Same Data

DEMO Cloudy Tile Mapping (No Pre-tiling Required) 48TB of NAIP Orthos

S3 can store both Static and Cache data. Amazon S3