EVLA Archive The EVLA Archive is the E2E Archive

Slides:

Advertisements

Similar presentations

Lecture plan Information retrieval (from week 11)

Advertisements

Metadata at ICPSR Sanda Ionescu, ICPSR.

14-Jun-2004EVLA Software Design Review Transition Plan Bill Sahr 1 EVLA Hybrid Array & Transition Plan.

Adding Dynamic Content to your Web Site

Servlets Enterprise Systems Programming. Servlets  Servlets: server-side Java programs that enable dynamic processing of web-based requests  Web-based.

National Radio Astronomy Observatory June 13/14, 2005 EVLA Phase II Proposal Review EVLA Phase II Computing Development Bryan Butler (EVLA System Engineer.

Tux2 Database The Architecture of Our System © Juhani Välimäki 2005.

EVLA Data Processing PDR Proposal Handling Honglin Ye, NRAO.

Software for Science Support Systems EVLA Advisory Committee Meeting, March 19-20, 2009 David M. Harland & Bryan Butler.

Introduction to Web Base Multimedia Application. Web base application TCP/IP (HTTP) protocol Using WWW technology & software Distributed environment.

Outline IS400: Development of Business Applications on the Internet Fall 2004 Instructor: Dr. Boris Jukic Server Side Web Technologies: Part 2.

Multiple Tiers in Action

1 CS6320 – Why Servlets? L. Grewe 2 What is a Servlet? Servlets are Java programs that can be run dynamically from a Web Server Servlets are Java programs.

Web-based Software Development - An introduction.

Server Side Scripting Norman White. Where do we do processing? Client side – Javascript (embed code in html) – Java applets (send java program to run.

M. Taimoor Khan * Java Server Pages (JSP) is a server-side programming technology that enables the creation of dynamic,

Agenda Web Development Chapter 7 Review Class Discussion Issues.

IDK0040 Võrgurakendused I Building a site: Implementation Deniss Kumlander.

1 UTGB Shell An Open-Source Browser Framework for the Integration of Biological Data Taro L. Saito, Shin Sasaki, Budrul Ahsan and.

WIDAR Prototype Testing User Interface Software Kevin Ryan NRAO-DRAO Face-to-Face Meeting April 3, 2006.

Web Application Programming Carol Wolf Computer Science.

GDT V5 Web Services. GDT V5 Web Services Doug Evans and Detlef Lexut GDT 2008 International User Conference August 10 – 13  Lake Las Vegas, Nevada GDT.

HTML. Principle of Programming  Interface with PC 2 English Japanese Chinese Machine Code Compiler / Interpreter C++ Perl Assembler Machine Code.

National Center for Supercomputing Applications NCSA OPIE Presentation November 2000.

Bulk Metadata Structures in CERA Frank Toussaint, Michael Lautenschlager Max-Planck-Institut für Meteorologie World Data Center for Climate.

Project Overview Graduate Selection Process Project Goal Automate the Selection Process.

Doug Tody E2E Perspective EVLA Advisory Committee Meeting December 14-15, 2004 EVLA Software E2E Perspective.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Implementing a web service for spatial data – Spatial Fusion M.L. Crawford, D. Mirante – Bryn Mawr College Metamorphic.

Mainframe (Host) - Communications - User Interface - Business Logic - DBMS - Operating System - Storage (DB Files) Terminal (Display/Keyboard) Terminal.

Bill SahrEVLA Advisory Committee Meeting May 8-9, EVLA Monitor & Control.

K. Y. LoEVLA Advisory Committee Meeting September 6-7, 2007 Charge to the Committee K. Y. Lo.

Java Portals and Portlets Submitted By: Rashi Chopra CIS 764 Fall 2007 Rashi Chopra.

1 MSCS 237 Overview of web technologies (A specific type of distributed systems)

14 June 2004System-wide Services: User InterfaceRich Moeser 1 EVLA Overall Software Design Final Internal Review System-wide Services: User Interface.

Archive Access Tool Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 John Benson Scientist.

EVLA Software Bryan Butler. 2007May22EVLA SAGE Meeting2 Requirements and Goals of EVLA Software Maximize scientific throughput of the instrument At a.

R MoeserCorrelator f2f Meeting1 MCAF (Metadata Capture and Formatting) Rich Moeser.

The CERA2 Data Base Data input – Data output Hans Luthardt Model & Data/MPI-M, Hamburg Services and Facilities of DKRZ and Model & Data Hamburg,

A radiologist analyzes an X-ray image, and writes his observations on papers  Image Tagging improves the quality, consistency.  Usefulness of the data.

IBM Office Connect 3.0 James Edmiston Consultant Quest Information Systems, Inc Mike Terrell IT Specialist IBM Data.

Introduction to EVLA Software Bryan Butler. 2006Dec05/06EVLA M&C Transition Software CDR2 EVLA Computing (Terse) History The original EVLA Phase I proposal.

Observation Preparation Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 David M. Harland SSS Group Lead.

USQCD regional grid Report to ILDG /28/09ILDG14, June 5, US Grid Usage  Growing usage of gauge configurations in ILDG file format.  Fermilab.

DSpace System Architecture 11 July 2002 DSpace System Architecture.

LHCb File-Metadata: Bookkeeping Carmine Cioffi Department of Physics, Oxford University UK Metadata Workshop Oxford, 04 July 2006.

EVLA Data Processing PDR E2E Data Archive System John Benson, NRAO July 18, 2002.

Gustaaf van MoorselEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Computing End-to-end (E2e) software.

Bill SahrNSF Review May , EVLA Monitor & Control.

EVLA Data Processing PDR Pipeline design Tim Cornwell, NRAO.

EVLA M&C CDR EVLA Monitor Data Archive System John Benson, Chunai Cai NRAO Dec 6, 2006.

Science Gateway- 13 th May Science Gateway Use Cases/Interfaces D. Sanchez, N. Neyroud.

The Web Web Design. 3.2 The Web Focus on Reading Main Ideas A URL is an address that identifies a specific Web page. Web browsers have varying capabilities.

Presented by: K.AMARNATH Ht.no:10841f0045 Guided by: T.Suneetha.

2005 – 06 – - ESSP1 WDC Climate : Web Access to Metadata and Data Frank Toussaint World Data Center for Climate (M&D/MPI-Met, Hamburg)

Academic Computing Stanford University Libraries Technical Overview of CourseWork 3.0 January 2004.

Internet/Web Databases

Web-based Software Development - An introduction

Bryan Butler EVLA Computing Division Head

Chapter 2 Client/Server Applications

Monitor and Control Software

Tutorial 8 Objectives Continue presenting methods to import data into Access, export data from Access, link applications with data stored in Access, and.

EVLA Overall Software Design

The Celera Genome Browser: A Tool for Visualizing and Annotating the Human Genome

Gustaaf van Moorsel September 9, 2003

Software Requirements

8 6 MySQL Special Topics A Guide to MySQL.

EVLA M&C Components Observation Executor, Interim & Final Obs2script

Jungkee (Jake) Kim TMD and XML Jungkee (Jake) Kim

Web Application Development Using PHP

Presentation transcript:

EVLA Archive The EVLA Archive is the E2E Archive Will include data from : VLA bulk data, 1976 - future Continuous VLBA data GBT data, 2004 – future EVLA data ALMA connection 14 June 2004 EVLA Software Review

EVLA Archive E2E archive design/prototype – Fall 2001 Phase 1 operational today : All VLA science data 1976 – current VLBA science data 2002 – current Small amount GBT science data EVLA monitor data – current User downloads : 350 users, 8000 files, 500 Gbytes public, 400 Gbytes proprietary 14 June 2004 EVLA Software Review

EVLA Archive E2E Archive - Phase 1 Goals : Scientific prototype, encourage imaginative data mining Make all metadata available in catalog - EVLA By experimentation determine technology limits for large archives Support a useful monitor data archive during EVLA construction. 14 June 2004 EVLA Software Review

EVLA Archive Phase 1 Archive Technology User Interfaces – Query Tools : Web browser forms pages Simple Python scripts User Interfaces – Displays : Web browser – html Comma Separated Variable text tables XML tables (VO) Graphical plotter, VO tbl inputs, applet 14 June 2004 EVLA Software Review

EVLA Archive Phase 1 Archive Technology JAVA servlet JDBC connection to db catalog Apache Tomcat web server Catalog tables Oracle 9 on PC Linux 12 Terabytes disk array for bulk data Assorted cgi C programs 14 June 2004 EVLA Software Review

EVLA Archive E2E Archive for EVLA Phase 1 Archive designed for EVLA : Mainly WIDAR correlator channelization EVLA, NMA, VLBA combination EVLA monitor data : currently archived in daily Oracle tables, accessible via web tool, display in browser tables, cvs tables, graphical plotter Demo’d to engineers, techs 14 June 2004 EVLA Software Review

EVLA Archive Future Topics EVLA data storage format Near ALMA Data Export Format Pipeline interfaces Operating at WIDAR data rates Storage media Storing the ‘other’ information Other archive technologies 14 June 2004 EVLA Software Review