April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox.

Slides:

Advertisements

Similar presentations

Planning Collaborative Spaces in Libraries

Advertisements

WDL Technical Architecture Working Group (TAWG) June 2010 Achievements and Recommendations Co-chaired by Noha Adly, Bibliotheca Alexandrina Babak Hamidzadeh,

The Incentives to Preserve Digital Materials: Roles, Scenarios, and Economic Decision-making Brian Lavoie Research Scientist OCLC Research CNI Spring Task.

Supporting education and research JISC Virtual Research Environment Call Town Meeting 19 th July 2004.

Joint Information Systems Committee Supporting Higher and Further Education Portals and the JISC Information Environment Strategy Chris Awre Programme.

University of St Andrews School of Computer Science Experiences with a Private Cloud St Andrews Cloud Computing co-laboratory James W. Smith Ali Khajeh-Hosseini.

Where next…. Stakeholder workshop, 29 Jan To the end of the project.

A centre of expertise in data curation and preservation SoA Annual Conference::York::August 2008 Funded by: This work is licensed under the Creative Commons.

Libraries for Future Generations Martha Anderson Director National Digital Information Infrastructure and Preservation Program The Library of Congress.

University of Pennsylvania Department of Electrical and Systems Engineering ESE Senior Design DEMO TIMES Thursday, April 21 rd, :30 am – 12:00 pm.

Integrated Digital Event Web Archive and Library (IDEAL) and Aid for Curators Archive-It Partner Meeting Montgomery, Alabama Mohamed Farag & Prashant Chandrasekar.

Background Oklahoma Connecting to Collections Initiative March 1, 2008 – February 28, 2010 $40,000 Connecting to Collections Planning Grant from the Institute.

Progress towards Europeana in the UK Nick Poole, Chief Executive, Collections Trust.

CRS harnessing ICT in the Great Lakes Cassava Initiative (GLCI) Project and Beyond Shaun Ferris- Senior Technical Advisor for Agriculture Jonathan Schofield-

Anna Maria Tammaro Pietro Gozetti Academic staff expectations on DSpace services: results of a survey at the University of Parma's Art and Humanities Faculty.

D igital L ibraries Digital Dreams, or Digital Realities?

1 Institute of Museum and Library Services Update Coalition for Networked Information Spring Task Force Meeting April 4-5, 2005.

Cultures and Memories. Sharing Heritage Grant requests of £3,000 to £10,000 First World War: then and now Grant requests of £3,000 to £10,000 Our Heritage.

Preserving the Unpreservable: Form, Content, Copyright and the Archiving of Born-Digital Newspapers Lisa Lynch Concordia University Paul Fontaine McGill.

The capture and preservation of websites at the National Library of New Zealand Gillian Lee Alexander Turnbull Library.

Promoting archives by creating digital collections with Islandora TCART MN Archives Symposium October 24 th, 2014 Pam Sukalski, Daardi Sizemore, Linda.

Kyle Rimkus Digital Projects Librarian Cheryl Gowing Director, Information Management & Systems September 22, 2010 University of Miami Digital Initiatives.

Local Tools and Local Data for Community Health OASIS and HealthLandscape Mark A. Carrozza, MA Health Foundation of Greater Cincinnati.

The Danish National Archives’ project "The West Indies – Sources of History”

CLARIN-NL Second Open Call Jan Odijk CLARIN-NL Call 2 Info-session Amsterdam, 26 Aug 2010.

1 The NSDL: A Case Study in Interoperability William Y. Arms Cornell University.

CHAMPions of Cultural Heritage Laura Childs AF ISR Agency/A9Y CHAMP Communications Coordinator AIA Trustee.

The Western Waters Digital Library: Building a Resource Through Multi- State Collaboration and Technology Dawn Paschal Assistant Dean, Digital Library.

Proposition: Digital Collections Are Easier to Find and Use through DLF Aquifer’s American Social History Online Katherine Kott, Aquifer Director Library.

CNI Fall Task Force, December 2007 International Internet Preservation Consortium Abbie Grotke IIPC Communications Officer Library of Congress & George.

DIVISION OF LIBRARY SERVICES Research Data Management at CSU.

Caught in the Web: Web Archiving at U of A Libraries Geoff Harder and Kenton Good Digital Preservation Seminar | March 5, 2010 | University of Alberta.

Relationships July 9, Producers and Consumers SERI - Relationships Session 1.

28 th March 2007CCP4 Developers Meeting BIOXHIT/CCP4(i) Database Wanjuan Yang & Peter Briggs.

Improving Records Management at Contoso Corporation (Concurrency Corporation)

Toleva, Petya Regional Archaeological Museum Plovdiv Priorities of the Archaeological Museum in Plovdiv - promotion and preservation of the local Cultural.

Netarkivet RESAW seminar, Dec 2-3, 2013 Day 1. Who are we today □Birgit N. Henriksen, head of digital preservation, KB □Bjarne Andersen, head of digital.

Challenges and Opportunities for Academic Libraries Collaborative Imperatives to Support Collections, Digital Initiatives, and New Services for a Changing.

Connecting different ethnomusicological archives with ethnoArc Maurice Mengel Music Archive of the Ethnological Museum, National Museum in Berlin (EMEM)

EVIA Digital Archive New Tools William G. Cowan Mike Durbin Digital Library Program EVIA Digital Archive DLP Brown Bag 20 September 2006.

CSCE 548 Secure Software Development Security Operations.

Workshop 3: International Council on Archives (ICA) AtoM Wednesday 9 September 1:00pm – 2:30pm Presenter: Anna Monson Purpose: Explore the feasibility.

1 IBM Academic Initiative Introduction for Pamplin School of Business Virginia Tech – October 13, 2011 “IBM Academic Skills Cloud and Computing Education.

1 Data.gov Initiative Implementation Acceleration Discussion Architecture and Infrastructure Committee Meeting March 19, 2009 Mike Carleton and Sonny Bhagowalia.

DELOS Network of Excellence on Digital Libraries Yannis Ioannidis University of Athens, Hellas Digital Libraries: Future Research Directions for a European.

Client-Side Preservation Techniques for ORE Aggregations Michael L. Nelson & Sudhir Koneru Old Dominion University, Norfolk VA OAI-ORE Specification Roll-Out.

CourseWork Integration and Futures Bruce Vincent Stanford University

Lancashire Cultural Services An introduction for the Communities Overview & Scrutiny Committee Ian Watson Head of Cultural Services 23 July 2009.

NDLTD Toward Universal Accessibility of ETDs: Building the NDLTD Union Archive Hussein Suleman, Edward A. Fox,

Fedora Commons Overview and Background Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.

Digital Preservation Initiatives in the United States A Summary Deanna B. Marcum.

The world’s libraries. Connected. CONTENTdm ® Digital Collection Management Solutions Learn what to consider when outsourcing your library’s digitization.

Enabling Building Efficiency: The NYC Urban Technology Innovation Center TIMOTHY CROSS, COLUMBIA ENGINEERING IEEE INNOVATION DAY POLYTECHNIC INSTITUTE.

EVIA Digital Archive Technical Overview EVIA Digital Archive DLP Brown Bag: 7 December 2005.

Using Transactional Web Archives To Handle Server Errors

Travel Choices accreditation

It’s all about the dpisd dr plan

? What is Institutional Repository for Rutgers University

CERN-UNESCO School on Digital Libraries

Flexible Extensible Digital Object Repository Architecture

Flexible Extensible Digital Object Repository Architecture

Dial us yahoo customer service support number

Dr Justine Reilly, Sporting Heritage

Regional Health Information Exchange: Getting There

Graph Query Portal Amit Dayal David Brock

What is Direct Marketing ?

Portals and the JISC Information Environment Strategy

ABCPhD Doctoral Program in architecture, built environment and construction engineering ABCPhD Call4Scholarship 34 RESEARCH TOPIC: Automation, Robotics.

University of Michigan School of Information

Consultation with stakeholders & User participation

Presentation transcript:

April 28, 2015 Stanford IIPC 2015 GA Archiving Transactions Towards Uninterruptible Web Service Zhiwu Xie, Prashant Chandrasekar, Edward A Fox

2 Outline Motivation Technical background System architecture Demo Future work

Web Archiving Current State Stakeholders Cultural heritage organizations Academia Coverage Wide but shallow 3

Web Archiving Current State Approach Crawler-based archiving Value proposition Comprehensive public good: preserve the history, collect research data, … 4

Wider Participation? “Free rider” “What’s in it for me?” 5

Expand the Value Proposition Ask what the web archiving can do for the potential stakeholders and participants 6

What Matters to a Website? 7

How Can Web Archiving Help? 8

Web Archiving Approaches Crawler-base User-drive Transactional 9

SiteStory 10

Uninterruptable Web Service (UWS) Turn SiteStory into a web infrastructure component that improves website availability Mask server errors from the end user Gain precious time for webmasters to recover from application server failures without disrupting the majority of their users’ web experience 11

UWS Architecture 12

Demonstration 13

Future Work Moving UWS functions to application servers Improving performance 14

Acknowledgements Partially funded by the Web Archiving Incentive Award by Mellon Foundation via Columbia University 15

Questions? Zhiwu Xie Prashant Chandrasekar Edward A Fox 16