WP3 Budapest SEP-2002 EDG Timestamping John Ryan, Brian Coghlan Trinity College Dublin.

Slides:



Advertisements
Similar presentations
(1) Select (2) Depress Tutorial for Edit model tool.
Advertisements

Databasteknik Databaser och bioinformatik Data structures and Indexing (II) Fang Wei-Kleiner.
Physical DataBase Design
7.1 Advanced Operating Systems Versioning File Systems Someone has typed: rm -r * However, he has been in the wrong directory. What can be done? Typical.
Introduction to SPICE Jose Luis Vázquez European Space Astronomy Centre European Space Agency.
1 Chapter 11: File-System Interface  File Concept  Access Methods  Directory Structure  File System Mounting  File Sharing  Protection  Chapter.
Chapter 10: File-System Interface
Chapter 11 File-System Interface
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 10: File-System Interface.
OS2-1 Chapter 2 Computer System Structures. OS2-2 Outlines Computer System Operation I/O Structure Storage Structure Storage Hierarchy Hardware Protection.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition File-System Interface.
1 Operating Systems Chapter 7-File-System File Concept Access Methods Directory Structure Protection File-System Structure Allocation Methods Free-Space.
CPSC 231 Managing Files of Records (D.H.) 1 Learning Objectives Concept of key - primary and secondary keys. Sequential versus direct access. RRN Use of.
CrossGrid Task 3.3 Grid Monitoring Trinity College Dublin (TCD) Brian Coghlan Paris MAR-2002.
DataGrid WP3 MAR-2002 Timestamps. We would like the information system to associate each measurement with the time it was made We would like to handle.
2015/6/301 TransCAD Managing Data Tables. 2015/6/302 Create a New Table.
File Concept l Contiguous logical address space l Types: Data: numeric, character, binary Program: source, object (load image) Documents.
File Concept §Contiguous logical address space §Types: l Data: Numeric Character Binary l Program.
DISK STORAGE INDEX STRUCTURES FOR FILES Lecture 12.
Doc.: IEEE /0560r0 Submission May 2009 Allan Thomson, Cisco SystemsSlide 1 Time Features Date: Authors:
Modern Navigation Thomas Herring MW 11:00-12:30 Room
1 Wireless Warehouse Management System Compsee’s M.A.T. Mobile Application Terminal.
Company Confidentialftflow.ppt;November 11 '981 Allegro Project Phase 1: (File Transfer & Web Registration Flow)
Accounting Update Dave Kant Grid Deployment Board Nov 2007.
1 Lecture 7: Data structures for databases I Jose M. Peña
CMS Project Ozarks Technical Community College Joint project of: Jason Huddleston, Asst. Coord. Internet Services & Network Security Karyn O’Dell, Coordinator.
Chapter 10 File System Interface
Navigation and Ancillary Information Facility NIF Leapseconds and Spacecraft Clock Kernels LSK and SCLK November 2014.
Chapter 2: Working with Data in a Project
A summary of the report written by W. Alink, R.A.F. Bhoedjang, P.A. Boncz, and A.P. de Vries.
Chapter 13 File Structures. Understand the file access methods. Describe the characteristics of a sequential file. After reading this chapter, the reader.
MongoDB An introduction. What is MongoDB? The name Mongo is derived from Humongous To say that MongoDB can handle a humongous amount of data Document.
Purpose Intended Audience and Presenter Contents Proposed Presentation Length Intended audience is all distributor partners and VARs Content may be customized.
Oregon Feature Code. Oregon File Member Setup Done at the district level Runs the physical file information for the district Shouldn’t be too concerned.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 10: File-System Interface.
CODD’s 12 RULES OF RELATIONAL DATABASE
File Systems Long-term Information Storage Store large amounts of information Information must survive the termination of the process using it Multiple.
Chapter 10: File-System Interface Silberschatz, Galvin and Gagne ©2005 Operating System Concepts – 7 th Edition, Jan 1, 2005 Chapter 10: File-System.
July 30, 2001Systems Architecture II1 Systems Architecture II (CS ) Lecture 8: Exploiting Memory Hierarchy: Virtual Memory * Jeremy R. Johnson Monday.
Chapter 11 File Systems and Directories. 2 File Systems File: A named collection of related data. File system: The logical view that an operating system.
Operating Systems COMP 4850/CISG 5550 File Systems Files Dr. James Money.
Grid Operations Centre LCG Accounting Trevor Daniels, John Gordon GDB 8 Mar 2004.
Grid-wide Intrusion Detection Stuart Kenny*, Brian Coghlan Trinity College Dublin.
Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 11: File-System Interface File Concept Access Methods Directory Structure.
Silberschatz and Galvin  Operating System Concepts Module 10: File-System Interface File Concept Access :Methods Directory Structure Protection.
A little hardware; a little software CS 139 – 08/29/07.
INFSO-RI Enabling Grids for E-sciencE Grid-wide Intrusion Detection Stuart Kenny*, Brian Coghlan Dept. of Computer Science Trinity.
Chapter 11 File Systems and Directories. 2 File Systems (Chapter 11.1) File: 1. A named collection of related data. 2.smallest amount of information that.
NTFS Filing System CHAPTER 9. New Technology File System (NTFS) Started with Window NT in 1993, Windows XP, 2000, Server 2003, 2008, and Window 7 also.
TCP/IP Protocol Suite 1 Chapter 17 Upon completion you will be able to: Domain Name System: DNS Understand how the DNS is organized Know the domains in.
Operating Systems Files, Directory and File Systems Operating Systems Files, Directory and File Systems.
LCG Accounting Update John Gordon, CCLRC-RAL 10/1/2007.
CSE Operating System Principles File Systems.
1 Query Processing Part 1: Managing Disks. 2 Main Topics on Query Processing Running-time analysis Indexes (e.g., search trees, hashing) Efficient algorithms.
Lecture : chapter 9 and 10 file system 1. File Concept A file is a collection of related information defined by its creator. Contiguous logical address.
SEG Technical Standards Committee Meeting
Module 10: File-System Interface
Chapter 11: File-System Interface
Time Features Date: Authors: May 2009 Month Year
OGSA Data Architecture Scenarios
Disk storage Index structures for files
A Web-Based Data Grid Chip Watson, Ian Bird, Jie Chen,
Chapter 10: File-System Interface
Files Management – The interfacing
Indexing 4/11/2019.
Module 10: File-System Interface
Time Features Date: Authors: May 2009 Month Year
File System Performance
Lecture 4: File-System Interface
WP3 Workshop 16/01/2002 Timestamps.
Presentation transcript:

WP3 Budapest SEP-2002 EDG Timestamping John Ryan, Brian Coghlan Trinity College Dublin

Contents EDG timestamping: overview Decisions made for TB1.2 Issues Future

EDG Timestamping Universal Time (UT/UT0/UT1/UT2): based on rotation of earth on its axis TAI (aka atomic time): based on caesium resonance Coordinated Universal Time is derived: UTC = TAI – leapseconds UTC kept within 0.9s of UT1 IERS (Paris) decides introduces +/- leapseconds, very irregularly

EDG Timestamping c consumes information Ia(ta) The problem: c a produces information Ia with timestamp ta Ia(ta) Sites a & c are corrected for leap seconds, b is not ba b consumes information Ia(ta) When b utilises Ia(ta) it must first convert to binary, this value is now incorrect, by as much as 32 seconds, but at least 1

EDG Timestamping Solution: all sites get leapsecond info, from same information source Uses R-GMA Obtains data from USNO ftp site. Publishes info via DBProducerServlet Timestamp class uses this info to correctly convert between formats

Timestamp obj Application Consumer Servlet (Local Cache) Leap Second data EDG Timestamping SQL-DB DB Producer Leapsecond sensor DB Producer Servlet U.S.N.O.

Decisions Made for TB1.2 Epoch: ASCII: UTC [date string] == 1-JAN-1972 binary: TAI [second count] == 1-JAN-1958 Binary fraction-of-second format Count of pS Accuracy/resolution info Preserved in ASCII if defined in binary Preserved in binary if defined in ASCII

Issues: CRON Scripts None in CVS tree yet Need scripts to: obtain leapsecond info from USNO NOT DONE populate cache files NOT DONE randomize the timing of these actions NOT DONE Must be able to be set up by LCFG

Future: Timestamp Formats TB1.2 ASCII format: does not preserve record of use of leapseconds CAN use lots of space on disk T12:46: Z r.00001a bits … 112 bits before fractional secs excluding T, Z, r and a: can be implied excluding accuracy and resolution excluding record of use of leapseconds

Future: Timestamp Formats TB1.2 binary format: Count of pS long[2] if accuracy & resolution NOT used long[4] if accuracy & resolution are used Fractional parts are fixed-format Issues : 4 longs use lots of space on disk does not preserve record of use of leapseconds cannot distinguish between EDG & UNIX time

Future: Timestamp Formats We propose to : add optional record of use of leapseconds last_leapsecond_update (L) field add to EDG ASCII and binary timestamps allows missed updates to be recognized add EDG packed binary timestamp format(s) particularly for secondary storage packed types use less space

Future: Timestamp Formats EDG packed binary timestamp formats: distinct EDG formats extensible typing using format type field automatic recognition of EDG formats include resolution & accuracy fields include last_leapsecond_update field preserves record of use of leapseconds default packed format = Long[2] counting pS

Future: Timestamp Formats Things to think about: Leapseconds may be dispensed with OGSA may define their own timestamp

EDG Timestamping THE END