Internet2 Distributed Storage Infrastructure Update Micah Beck andTerry Moore Univ. of Tennessee, Knoxville Bert Dempsey Univ. of North Carolina, Chapel.

Slides:



Advertisements
Similar presentations
Recent Developments in Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab Computer Science Department.
Advertisements

National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
A distributed architecture for crystallography data, metadata, and applications John C. Bollinger Indiana University Molecular Structure Center, Bloomington,
Internet2 Distributed Storage Infrastructure Update Micah Beck I2-DSI Project Director Research Associate Professor Innovative Computing Laboratory Univ.
Internet2 Distributed Storage Infrastructure (I2-DSI) TERENA-NORDUnet Networking Conference June, Lund, Sweden Leif Abrahamsson, Ellemtel
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
Tom Lewis Director, Academic & Collaborative Applications University of Washington.
Internet2 Distributed Storage Infrastructure Update Micah Beck Univ. of Tennessee, Knoxville Bert Dempsey Univ. of North Carolina, Chapel Hill Web Caching.
Application of GRID technologies for satellite data analysis Stepan G. Antushev, Andrey V. Golik and Vitaly K. Fischenko 2007.
Web development  World Wide Web (web) is the Internet system for hypertext linking.  A hypertext document (web page) is an online document. It contains.
The Internet Useful Definitions and Concepts About the Internet.
1 Internet Protocols and Network Performance Issues Carey Williamson iCORE Professor Department of Computer Science University of Calgary.
Collaborative Digital Preservation with LOCKSS Gail McMillan Digital Library and Archives, University Libraries Virginia Polytechnic Institute and State.
Internet Resources Discovery (IRD) IBM DB2 Digital Library Thanks to Zvika Michnik and Avital Greenberg.
Context-aware Trellis (caT) Principal Investigator: Richard Furuta Center for the Study of Digital Libraries and the Department of Computer Science Texas.
SESSION 9 THE INTERNET AND THE NEW INFORMATION NEW INFORMATIONTECHNOLOGYINFRASTRUCTURE.
Using the WWW in Teaching and Learning Barbara Watson Andrew Stansfield IT Service.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
1 Enabling Secure Internet Access with ISA Server.
A.V. Bogdanov Private cloud vs personal supercomputer.
1998 Fall Internet2 Project Meeting San Francisco September.
DuraCloud Managing durable data in the cloud Michele Kimpton, Director DuraSpace.
DATA COMMUNICATION DONE BY: ALVIN SAMPATH CARLVIN SAMPATH.
DAY TO DAY USAGE OF THE NETWORK for academic and administrative support (How we make it work) Presented by: Donnie Mize, Network Manager, FTCC Wanda Jones,
Technology Overview. Agenda What’s New and Better in Windows Server 2003? Why Upgrade to Windows Server 2003 ?  From Windows NT 4.0  From Windows 2000.
The Internet2 Distributed Storage Infrastructure Project Innovative Computing Laboratory, Tennessee –Micah Beck –Terry Moore.
The Internet  Internet Hardware connected together Creates a massive worldwide network  Hardware Computers Communication lines  Interlinked collection.
Norman Wiseman JISC Head of Programmes Presentation to JISC Authentication Concertation Day March 1999 International Authentication Activities Joint Information.
San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center National Partnership for Advanced.
Technology Choices for the JSTOR Online Archive Presented by Chang Feng Department of Computer Engineering and Computer Science, University of Missouri-Columbia,
What is Internet2? Ted Hanss, Internet2 5 March
Internet2: A Tutorial Part 3 of 4 17 th Brazilian Symposium on Computer Networks Paul Love, Internet2 Chair, I2 Topology WG
CIS 250 Advanced Computer Applications Internet/WWW Review.
Internet2 Middleware Initiative. Discussion Outline  What is Middleware why is it important why is it hard  What are the major components of middleware.
Logistical Networking Micah Beck, Research Assoc. Professor Director, Logistical Computing & Internetworking (LoCI) Lab Computer.
1 Mobile Management of Network Files Alex BassiMicah Beck Terry Moore Computer Science Department University of Tennessee.
Internet 2 Applications Update Ted Hanss 8 October 1997 Washington D.C. Ted Hanss 8 October 1997 Washington D.C.
Applications Plenary Ted Hanss Director, Applications Development I2 Member Meeting - DC - 28 April 99
Hussein Suleman University of Cape Town Department of Computer Science Digital Libraries Laboratory February 2008 Data Curation Repositories:
Millman—Nov 04—1 An Update on Digital Libraries David Millman Director of Research & Development Academic Information Systems Columbia University
DuraCloud Open technologies and services for managing durable data in the cloud Michele Kimpton, CBO DuraSpace.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
Storage Why is storage an issue? Space requirements Persistence Accessibility Needs depend on purpose of storage Capture/encoding Access/delivery Preservation.
Chapter 3 Selecting the Technology. Agenda Internet Technology –Architecture –Protocol –ATM IT for E-business –Selection Criteria –Platform –Middleware.
Harokopio University of Athens – Department of Informatics and Telematics HAROKOPIOUNIVERSITY A Distributed Architecture for Building Federated Digital.
IS Infrastructure Managing Infrastructure and Services Copyright © 2016 Curt Hill.
An Architectural Approach to Managing Data in Transit Micah Beck Director & Associate Professor Logistical Computing and Internetworking Lab Computer Science.
Network Services. Domain Controllers: – Used for Account management (e.g. user accounts, group accounts Register Hardware like Printers and PC Authentication.
Internet2 Distributed Storage Infrastructure Status Micah Beck, Chair Network Storage WG Innovative Computing Laboratory University of Tennessee, Knoxville.
Internet2. Yesterday’s Internet  Thousands of users  Remote login, file transfer  Applications capitalize on underlying technology.
© 2012 IBM Corporation IBM Linear Tape File System (LTFS) Overview and Demo.
Collection-Based Persistent Archives Arcot Rajasekar, Richard Marciano, Reagan Moore San Diego Supercomputer Center Presented by: Preetham A Gowda.
 Internet Hardware connected together Creates a massive worldwide network  Hardware Computers Communication lines  Interlinked collection of smaller.
Internet2 Applications & Engineering Ted Hanss Director, Applications Development.
St. Petersburg, 2016 Openstack Disk Storage vs Amazon Disk Storage Computing Clusters, Grids and Cloud Erasmus Mundus Master Program in PERCCOM Author:
Course: Cluster, grid and cloud computing systems Course author: Prof
Organizations Are Embracing New Opportunities
RESTful Sevices Distributed Objects Presented by: Shivank Malik
The Data Grid: Towards an architecture for Distributed Management
StratusLab Final Periodic Review
StratusLab Final Periodic Review
Evolution of Internet.
E-commerce | WWW World Wide Web - Concepts
DNS.
E-commerce | WWW World Wide Web - Concepts
Scheduled Accomplishments
Unit# 5: Internet and Worldwide Web
PRESENTER GUIDANCE: These charts provide data points on how IBM BaaS mid-market benefits a client with the ability to utilize a variety of backup software.
Internet Protocols IP: Internet Protocol
Presentation transcript:

Internet2 Distributed Storage Infrastructure Update Micah Beck andTerry Moore Univ. of Tennessee, Knoxville Bert Dempsey Univ. of North Carolina, Chapel Hill Coalition for Networked Information 26 & 27 April 1999, Washington, DC

I2-DSI Participants zUT Knoxville / ICL yMicah Beck yTerry Moore yMartin Swany yJudi Talley zUNC Chapel Hill /SILS yBert Dempsey yPaul Jones (MetaLab) yDebra Weiss yZhiwei Xiao z GigaPOP and Campus Site Managers z UCAID/Internet2 yNetwork Storage Working Group yTed Hanss Applications Director yAnn O’Beay Corp. Relations Director z NC Networking Initiative z Digital Library Federation

I2-DSI Model: Replicated Services zClients access nearby server zEveryone gets performance zLocal resources implement a global service

I2-DSI Service Architecture zReplication yRsynch, Omnicast, AFS/DFS Novell Replication zResolution ySonar DNS, Distributed Director zDelegation yCache prefetch general users replicated core delegated server local users

Current Server Deployment

Infrastructure Expansion zStorageTek y3-4 PC/Linux Servers y700GB disk, tape backup (hot!) zNovell y6 PC/NetWare Servers y100GB disk ySmaller institutions or departments

Infrastructure Development Efforts zProximity Resolution xMartin Swany: SonarDNS xGeoff Carpenter, German Goldszmidt: Narwhal (IBM) zReplication Mechanisms and Modeling yBert Dempsey & students: xDebra Weiss: Batch rsync + multicast xZhiwei Xiao: Network metrics and modeling zChannel Representation and Server xLeif Abrahamsson, Christophe Achouiantz, Patrik Johansson (Ellemtel)

I2-DSI Applications Workshop Chapel Hill, NC March 4 &5, 1999 z10 applications yIndiana: Digital music and media library yUNC-CH: Instructional Management System ySan Jose State: Art history images yVanderbilt: zoomable medical images yViagenie: Network docs database yColumbia: Earth sciences environment yUNC-CH: Virtual Laboratories yOhio Supercomputer Center: High Volume Datasets yCalTech: Globally Interconnected Databases yUniv. of Kent: National Software Archive yRed Hat: pan-Linux source distribution

I2-DSI Applications Workshop Chapel Hill, NC March 4 &5, 1999 z4 technologies xMinnesota: Scalable Video xIBM Research: Multicast, Filter and Store xMoscow Ctr. for New Info. Tech. in Med. Ed.: Semantic Text Analysis xIBM Research: Service Resolution Proxy  zSpecial issue of the Journal of Network and Computer Applications (Academic Press)

Application Management Partner MetaLab.unc.edu zThe site formerly known as SunSITE.unc.edu zFearless Leader Paul Jones z“A cool, tall glass of sweet tea on a hot day.” z 2 M HTTP & 1/3 M FTP file transfers daily zCollections policy yteaching, research, or public service yuse technology in innovative and unique ways ynon-commercial or not-for-profit

The Need for Channel Representation Standards Origin Server proxy Replicated Server Standard-based Web traffic Replication of source files Web clients locally interpreted files Replicated Server replicated files

Conclusions zA server platform is in place zInfrastructure development yService abstractions (search, computation) yPublication and replication protocols yPortable representation and API yHeterogeneous servers zSix months to show results from initial application development efforts