CAA/CFA Review | Andrea Laruelo | ESTEC | May 19 2011 CFA Development Status CAA/CFA Review ESTEC, May 19 th 2011 European Space AgencyAndrea Laruelo.

Slides:



Advertisements
Similar presentations
Software engineering tools for web development Jim Briggs 1CASE.
Advertisements

17th February, 2000 by Maciej Korzeniowski (CERN-IT-IA-MI) 1 Oracle Discoverer Product Presentation  This is an ad hoc query and analysis tool for.
COURSE: COMPUTER PLATFORMS
Operating-System Structures
1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France
1 The IIPC Web Curator Tool: Steve Knight The National Library of New Zealand Philip Beresford and Arun Persad The British Library An Open Source Solution.
GForge: A collaborative development environment Presentation by: Geoff Gerfin.
CASE Tools CIS 376 Bruce R. Maxim UM-Dearborn. Prerequisites to Software Tool Use Collection of useful tools that help in every step of building a product.
“DOK 322 DBMS” Y.T. Database Design Hacettepe University Department of Information Management DOK 322: Database Management Systems.
Chapter 9: Moving to Design
Jun Peng Stanford University – Department of Civil and Environmental Engineering Nov 17, 2000 DISSERTATION PROPOSAL A Software Framework for Collaborative.
Presented by Mina Haratiannezhadi 1.  publishing, editing and modifying content  maintenance  central interface  manage workflows 2.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Chapter 5 UNDERSTANDING AND DESIGNING ACCOUNTING DATA.
Adam Jansen Digital Archivist Washington State Archives ISB Presentation Status Report for Digital Archives.
Configuration Management System
October 30, 2008 Extensible Workflow Management for Simmod ESUG32, Frankfurt, Oct 30, 2008 Alexander Scharnweber (DLR) October 30, 2008 Slide 1 > Extensible.
Hands-On Microsoft Windows Server 2008 Chapter 5 Configuring, Managing, and Troubleshooting Resource Access.
Chapter 9 Elements of Systems Design
Distributed Software evelopment Adrien Olivier(AO) Dominik Rojković(DR) Hassan Aziz Khan(HSK) Petar Butković(PB) Petar Dučić(PD) Rashid Khan(RK)
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
2 nd SUMOVER Workshop: Code Management Systems. 2nd SUMOVER Workshop - Code Management WP2: Software management systems Surveyed a number of systems –Source.
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
MaterialsHub - A hub for computational materials science and tools.  MaterialsHub aims to provide an online platform for computational materials science.
Toward the Next Generation of Ingres Administration Tools UKIUA 2010 June 8, 2010.
DATABASE MANAGEMENT SYSTEMS IN DATA INTENSIVE ENVIRONMENNTS Leon Guzenda Chief Technology Officer.
Data Management BIRN supports data intensive activities including: – Imaging, Microscopy, Genomics, Time Series, Analytics and more… BIRN utilities scale:
9 Systems Analysis and Design in a Changing World, Fourth Edition.
9 Systems Analysis and Design in a Changing World, Fourth Edition.
OSIsoft High Availability PI Replication
Online Software 8-July-98 Commissioning Working Group DØ Workshop S. Fuess Objective: Define for you, the customers of the Online system, the products.
SWGData and Software Access - 1 UCB, Nov 15/16, 2006 THEMIS SCIENCE WORKING TEAM MEETING Data and Software Access Ken Bromund GST Inc., at NASA/GSFC.
Science ESAC Cluster Final Archive Pedro Osuna Head of the Science Archives and VO Team Science Operations Department CAA-CFA Review Meeting.
CASE (Computer-Aided Software Engineering) Tools Software that is used to support software process activities. Provides software process support by:- –
Architecture View Models A model is a complete, simplified description of a system from a particular perspective or viewpoint. There is no single view.
TSS Database Inventory. CIRA has… Received and imported the 2002 and 2018 modeling data Decided to initially store only IMPROVE site-specific data Decided.
Sabriansyah R.A Version Control. The Repository Subversion adalah sistem tersentralisasi untuk informasi sharing Repository adalah pusat penyimpanan data.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
1 Unified Modeling Language Michael K. Wildes University of California, Riverside – Extension Program Presentation 2.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
CAA/CFA Meeting | CFA Team | ESAC | Octiber CFA Under Development CAA/CFA Meeting ESAC, Oct 11 th 2011 European Space AgencyCFA Team.
Grid Activities in CMS Asad Samar (Caltech) PPDG meeting, Argonne July 13-14, 2000.
Google Code Libraries Dima Ionut Daniel. Contents What is Google Code? LDAPBeans Object-ldap-mapping Ldap-ODM Bug4j jOOR Rapa jongo Conclusion Bibliography.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Review of PARK Reflectometry Group 10/31/2007. Outline Goal Hardware target Software infrastructure PARK organization Use cases Park Components. GUI /
9 Systems Analysis and Design in a Changing World, Fifth Edition.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Scientific Linux Inventory Project (SLIP) Troy Dawson Connie Sieh.
TECHNICAL ASSISTANCE FOR THE CONVERSION OF RBPAPs INTO RBMPs DATA MANAGEMENT INCEPTION WORKSHOP ESTAMBUL February Eusebio CRUZ GARCÍA.
CIT 140: Introduction to ITSlide #1 CSC 140: Introduction to IT Operating Systems.
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
1 CASE Computer Aided Software Engineering. 2 What is CASE ? A good workshop for any craftsperson has three primary characteristics 1.A collection of.
Distributed Software Development Link Analysis Tool Project Plan Adrien Olivier Dominik Rojković Hassan Aziz Khan Petar Butković.
Architecture Review 10/11/2004
Chapter 5 UNDERSTANDING AND DESIGNING ACCOUNTING DATA
Software Overview Sonja Vrcic
Archiving of solar data Luis Sanchez Solar and Heliospheric Archive Scientist Research and Scientific Support Department.
Chapter 1: Introduction
Chapter 2: System Structures
Generator Services planning meeting
CERN-Russia Collaboration in CASTOR Development
MaterialsHub - A hub for computational materials science and tools.
TYPES OF SERVER. TYPES OF SERVER What is a server.
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Chapter 2: System Structures
Database Design Hacettepe University
ACTIVE DIRECTORY An Overview.. By Karan Oberoi.
Presentation transcript:

CAA/CFA Review | Andrea Laruelo | ESTEC | May CFA Development Status CAA/CFA Review ESTEC, May 19 th 2011 European Space AgencyAndrea Laruelo

CAA/CFA Review | Andrea Laruelo | ESTEC | May Development Schedule - Creating Basic Infrastructure-

CAA/CFA Review | Andrea Laruelo | ESTEC | May Understanding the project

CAA/CFA Review | Andrea Laruelo | ESTEC | May CFA Entity Model UML Diagram From v0.1 to v0.7  Diagram that shows the relationship among the entities (and their attributes) for which metadata will be stored in the database.  Drawn using UML class diagram nomenclature  Basis for the Entity-Relationship (E-R) database model diagram among other things.

CAA/CFA Review | Andrea Laruelo | ESTEC | May Hardware  Two SUN servers running Linux which would offer redundancy and load balancing  Special attention will have to be given to the disk infrastructure for the CFA  Start planning for 100TB, but with the capacity to eventually increase it up to 200TB  100 TB of disk storage  Model: NetApp FAS 3270  Status: In purchase process  Currently: Development Virtual machine

CAA/CFA Review | Andrea Laruelo | ESTEC | May  Free/open source version control system.  Manages files and directories, and the changes made to them, over time.  Allows to recover older versions and examine the history of how data has changed.  Operates across networks, which allows it to be used by people on different computers. CFA Version Control System -Subversion-

CAA/CFA Review | Andrea Laruelo | ESTEC | May CFA Tracking System -Track management tool-  Open source project management tool  Enhanced wiki and issue tracking system for software development projects.  It provides an interface to Subversion  Seamless references between bugs, tasks, changesets, files and wiki pages.  A timeline shows all current and past project events in order, making the acquisition of an overview of the project and tracking progress very easy.  Roadmap listing the upcoming milestones.  Ticketing system during development phase  Relevant information  Related documentation  Access to svn code

CAA/CFA Review | Andrea Laruelo | ESTEC | May CAA-CFA ICD -Version 0.3-  Defines the interfaces between the CAA and the SAT/CFA  Requirements pertaining to the transfer of data and metadata.  Two different phases: - Initial synchronization of CAA and CFA repositories - Regular transfer of new products

CAA/CFA Review | Andrea Laruelo | ESTEC | May Migration Plan -Released v1.0- CAA Public Access T CFA B T CFA PB R T CAA E T DATA E CAA data ingestion only CFA BETA testing CFA Public Beta Access CAA hibernation CFA Public Access Only T CFA PR  Provides an overview of the necessary steps to be performed for the CAA to CFA migration.  Overall schedule for the transition.

CAA/CFA Review | Andrea Laruelo | ESTEC | May CFA Database -Design and installation- Scientific data model v0.7  PostgreSQL  Three different databases schemas:  Scientific schema: It needs to be consistent with the entity model  Controls schema: Used to log the daily actions performed with the archive.  Ingestion schema: Used to log the ingestion process.

CAA/CFA Review | Andrea Laruelo | ESTEC | May Postgres DB FTP Server CFA server Users Trac SVN CFA Development Machine Apache Web server

CAA/CFA Review | Andrea Laruelo | ESTEC | May Development Schedule -Archive Subsystems development-

CAA/CFA Review | Andrea Laruelo | ESTEC | May Status of archive subsystems development

CAA/CFA Review | Andrea Laruelo | ESTEC | May Storage Layer Test data ingested

CAA/CFA Review | Andrea Laruelo | ESTEC | May Data Layer Implementation  Stand-alone application  The only entry point to the database UML Diagram

CAA/CFA Review | Andrea Laruelo | ESTEC | May Entity Model Implementation  Diagram that shows the relationship among the entities (and their attributes) for which metadata will be stored in the database.  Create the entities by extending ABSI AbstractEntity class.The entity name is the same one used in the entity model diagram and the attributes are those inside the entity itself  Create the model class (ABCModel), which extends AbstractControlsModel  Create the transfer objects This module contains the POJOs (Plain Old Java Objects) that will carry the metadata across all layers of the archive when the system is running. Implementation

CAA/CFA Review | Andrea Laruelo | ESTEC | May Server Layer  The server layer is the hub for the requests made to the archive.  It basically decides what to do when a new request is performed  Calls the backend modules (Query Manager and Data Distribution sub-systems) through appropriate protocols (basically RMI)  This module implements the Command design pattern

CAA/CFA Review | Andrea Laruelo | ESTEC | May User Interface  GUI to access current CFA prototype  User registration  Basic queries beased on:  Experiment  Measurement Type  Instrument Type  Time  Implements the Model View Controller (MVC) design pattern  Follows the absi ui frame  Common layout to all Scientific Archives  Uses infonode and jgoodies as third-party libraries

CAA/CFA Review | Andrea Laruelo | ESTEC | May Development Schedule -Future Activities. Adding functionality-

CAA/CFA Review | Andrea Laruelo | ESTEC | May Questions ? → Suggestions