Distributed Storage in Automated Data Transfer

Slides:



Advertisements
Similar presentations
Recent Developments in Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab Computer Science Department.
Advertisements

Global MP3 Geoffrey Beers Deborah Ford Mike Quinn Mark Ridao.
Secure Cyber Incident Information Sharing UTSA Team Leads Dr. Ram Krishnan, Assistant Professor, ECE Dr. Ravi Sandhu, Executive Director, ICS April 30,
Hydra Partners Meeting March 2012 Bill Branan DuraCloud Technical Lead.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
Funding Networks Abdullah Sevincer University of Nevada, Reno Department of Computer Science & Engineering.
© 2009 Research In Motion Limited Methods of application development for mobile devices.
Dogan Seber, PhD San Diego Supercomputer Center University of California, San Diego I. DLESE Library II. DISCOVER OUR EARTH Earth Science Resources for.
Amplifier Design and Modeling Doug Bouler: CURENT REU Dr. Daniel Costinett: Mentor Final CURENT Presentation 7/18/2014 Knoxville, TN.
Tools for Publishing Environmental Observations on the Internet Justin Berger, Undergraduate Researcher Jeff Horsburgh, Faculty Mentor David Tarboton,
The GEON Integrated Data Viewer (IDV) and IRIS DMC Services: CyberInfrastructure Support for Seismic Data Visualization and Interpretation Charles Meertens.
The Evaluation and Development of an Efficient Cooling System for High Performance Computing Applications Raaghul Senthilkumar and Ronik Sheth CURENT,
C LIENT /S ERVER AND P EER TO P EER National 4/5 Computing Science.
Welcome to the Minnesota SharePoint User Group. Introductions / Overview Project Tracking / Management / Collaboration via SharePoint Multiple Audiences.
Mobile Mapping Systems (MMS) for infrastructural monitoring and mapping are becoming more prevalent as the availability and affordability of solutions.
Selected Topics on Databases n Multi-User Databases –more than one user processes the database at the same time n System Architectures for Multi-User Environments.
DATA COMMUNICATION DONE BY: ALVIN SAMPATH CARLVIN SAMPATH.
TERMINALFOUR SiteManager Introduction January, 2014.
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
Project Builder and MediaMatrix: Redefining Access in the Digital Age Dean Rehberger and Michael Fegan MERLOT August 7-10, 2006 New Orleans, LA.
Making the Grid “Smarter”: Technology and Behavior Modification Brian Hardison Pi Beta Phi Elementary School Abstract From my time at CURENT, my goal was.
EXPOSE GOOGLE APP ENGINE AS TASKTRACKER NODES AND DATA NODES.
Cloud Distributed Computing Platform 2 Content of this lecture is primarily from the book “Hadoop, The Definite Guide 2/e)
Chapter © 2006 The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/ Irwin Chapter 7 IT INFRASTRUCTURES Business-Driven Technologies 7.
WINDOWS XP PROFESSIONAL AUTOMATING THE WINDOWS XP INSTALLATION Bilal Munir Mughal Chapter-2 1.
T L = 0.5 Fig. 6. dq-axis stator voltage of mathematical model. Three Phase Induction Motor Dynamic Modeling and Behavior Estimation Lauren Atwell 1, Jing.
Creating a System to Test Single Photon Avalanche Diodes Introduction Single Photon Avalanche Diodes (SPADs) are optical sensing amplifiers which make.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Wide Area Data Sharing with Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab Computer Science.
Creating a System to Test Single Photon Avalanche Diodes Alex Chan Young Scholars Program Farragut High School July, 16,2014 Knoxville, Tennessee.
INTRODUCTION TO DBS Database: a collection of data describing the activities of one or more related organizations DBMS: software designed to assist in.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Stability Analysis on WECC Systems with Wind Penetration and Composite Load Model Introduction The growing complexity of generation and load pattern in.
Energy Use and Thermal Comfort in the Workplace Jasmine Park 1, Dr. Xiaojing Xu 2, Dr. Chien-fei Chen 2 1 Farragut High School, 2 University of Tennessee,
A Technical Overview Bill Branan DuraCloud Technical Lead.
Organizational Dashboard Roll up all information at various levels within the country or organization on your dashboard. Customizable your dashboards to.
Scheduling MPI Workflow Applications on Computing Grids Juemin Zhang, Waleed Meleis, and David Kaeli Electrical and Computer Engineering Department, Northeastern.
Flywheels and Power System Stability Michael Breuhl Mentors: Horacio Silva Dr. Héctor Pulgar-Painemal.
I n regulated power industry utility wants to do demand response. Designing a Model to Obtain Residents’ Response for the Financial Incentives in a Demand.
An Architectural Approach to Managing Data in Transit Micah Beck Director & Associate Professor Logistical Computing and Internetworking Lab Computer Science.
Microsoft ® Official Course Module 6 Managing Software Distribution and Deployment by Using Packages and Programs.
Logistical Networking: Buffering in the Network Prof. Martin Swany, Ph.D. Department of Computer and Information Sciences.
The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.
Interaction and Animation on Geolocalization Based Network Topology by Engin Arslan.
Candace Pang1 and Elizabeth Price2; Mentors: Dr. Chien-fei Chen3, Dr
WEB APPLICATION Diagram Template
EDUKNOWLEDGE A Framework for Educational Purposes
3D Animation of Power System Data
Spark Presentation.
The Improvement of PaaS Platform ZENG Shu-Qing, Xu Jie-Bin 2010 First International Conference on Networking and Distributed Computing SQUARE.
Using Earth SySTEM and GLOBE
Power System Generation Expansion Plan
Jeremy Till1, Shutang You2, Yilu Liu2
XSEDE’s Campus Bridging Project
Error Detection in the Frequency Monitoring Network (FNET)
3D Animation of Power System Data
Title of Poster Site Visit 2017 Introduction Results
Information Technology Ms. Abeer Helwa
Last.Backend is a Continuous Delivery Platform for Developers and Dev Teams, Allowing Them to Manage and Deploy Applications Easier and Faster MICROSOFT.
Large Scale Distributed Computing
Visualizing the Attracting Structures Results and Conclusions
Title of Poster Site Visit 2018 Introduction Results
Client/Server and Peer to Peer
Mark Quirk Head of Technology Developer & Platform Group
STATEL an easy way to transfer data
Gaurab KCa,b, Zachary Mitchella,c and Sarat Sreepathia
1Peyton Spencer, 2Yang Liu, 2Dr. Kai Sun
Norbert Bigirimana1, Dr. Hantao Cui2, Dr. Kevin Tomsovic2
Sharifa Sharfeldden1, Peter Pham2, Dr. Daniel Costinett2
Presentation transcript:

Distributed Storage in Automated Data Transfer Daniel Hong1, Jeremy Rogers2, Dr. Micah Beck2 Farragut High School1,, University of Tennessee2 Introduction Distributed storage is the use of multiple storages servers in different locations to store files, scientific data, and other forms of media. Distributed storage provides an effective way to spread files evenly across an area (ex. The world, country, state). Proper utilization of distributed storage can be used to take advantage of a network’s full capacity, and distributed storage can also be used for other purposes. The REDDNET project aims to develop an effective way of managing files on distributed servers through tools such as the Logistical Distribution Network (LoDN) and the Logistical Runtime System (LoRS). Fig. 1: A map of REDDNET organizations and servers Research Topic For the project, the automation of data transfer was explored as well as different applications of distributed storage for scientific purposes. Geospatial data was an example of a download from distributed storage servers which was automated through LoDN. Methods to transfer data to isolated edge servers, which are not connected to the global LoDN server but support similar file transfers, were also explored in this project. Fig. 2: Visualization of a download through LoDN Results The files downloaded through the Java program accurately reflected the previews shown on the GloVis web interface. A series of identifiers (corresponding to locations on the map) which represented the state of Tennessee were fed into the program, and scaled-down results (shown below) were automatically downloaded. Methodology A tool was written in Java to grab files from the GloVis project (Global Visualization) sponsored by the United States Geological Survey and the National Aeronautics and Space Administration. These files contain geospatial photographs that scientists can use to find different The Java tool utilized the new DateTime API to schedule tasks at a given time, and user-given inputs are downloaded at regular intervals. The framework which was written for the download could also be applied to different types of data (not just geospatial). Acknowledgements: This work was supported primarily by the Engineering Research Center Program of the National Science Foundation and the Department of Energy under NSF Award Number EEC-1041877 and the CURENT Industry Partnership Program.