EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.

Slides:



Advertisements
Similar presentations
ISecurity GUI User-Friendly Interface. Features Full support of all green-screen functionality Simultaneous views of multiple iSecurity screens and activities.
Advertisements

Multi-DNC Data Collection/Monitoring
CSS Central: Central Management Utility Screen View Samples Next.
TANKS Software Operation First time in this software you need to add the meteorological data for your facility into the database To do this you will need.
The main tools and functions of the system can be accessed via this side bar Allometric equations editor can be accessed under utilities, and user.
25 July Standard and Searchable Reports. 25 July Report Types Standard Reports –“Canned” reports for the most common types of data inquiries.
OVSA Expansion Software Overview Gordon Hurford Kickoff Meeting NJIT 25-Oct-2010.
Dale E. Gary Professor, Physics, Center for Solar-Terrestrial Research New Jersey Institute of Technology 1 3/16/2012OVSA Preliminary Design Review.
Page 1 18-OCT-2004 RHESSI Data Analysis Workshop RHESSI Reuven Ramaty High Energy Solar Spectroscopic Imager Use or disclosure of data contained on this.
A NoC Generation and Evaluation Framework
RHESSI and OVSA Data Base Organization J. McTiernan OVSA expansion project kickoff meeting 25-Oct-2010.
Technical Tips and Tricks for User Support Mike Gardner
FASR-A 6 Gb/s x 2 x GB/s 400 GB/day 50 GB/day ~1 GB/day X xxx FASR Data Analysis Plan 22-May-2005 Simplified Data Pipeline.
THEMIS Science Software Training1July 2007 The THEMIS Graphical User Interface J. McTiernan 23-Jul-2007
A Guide to Oracle9i1 Creating an Integrated Database Application Chapter 8.
Applications Software
1 QED In Vivo USB Input Output Box configuration This tutorial contains a number of instructions embedded in a great deal of explanation. Procedures that.
Comprehensive Large Array-data Stewardship System (CLASS) Web Site Tutorial Visit CLASS Site at
Online Surveys A Look at Cardiff-TeleForm Denise H. Wells Planning and Research Central Piedmont Community College.
DEMONSTRATION FOR SIGMA DATA ACQUISITION MODULES Tempatron Ltd Data Measurements Division Darwin Close Reading RG2 0TB UK T : +44 (0) F :
WaveMaker Visual AJAX Studio 4.0 Training Troubleshooting.
Database-Driven Web Sites, Second Edition1 Chapter 8 Processing ASP.NET Web Forms and Working With Server Controls.
Detector noise analysis (DINO) demo Max Mutchler ACS-R Optimization Campaign dry-dryrun 30 January 2009.
Find these slides in the HRMS Basics course located at: Department of.
DE&T (QuickVic) Reporting Software Overview Term
Rsv-control Marco Mambelli – Site Coordination meeting October 1, 2009.
Chapter 9 Scripting RMAN. Background Authors felt that scripting was a topic not covered well Authors wanted to cover both Unix/Linux and Windows environments.
A Web-based Item Bank Search, View, and Select Items for Saving, Editing, and Printing (online testing available too) - Multiple.
Tutorial 121 Creating a New Web Forms Page You will find that creating Web Forms is similar to creating traditional Windows applications in Visual Basic.
HIFI Tutorial 3: Getting some basic science out A.P.Marston ESAC 27 June 2013.
Marcel Casado NCAR/RAP WEATHER WARNING TOOL NCAR.
Virtual Interaction Manager
IVC : a simulation and model-fitting tool for optical-IR interferometry Abstract I present a new software tool, called “Interferometry Visibility Computations”
Launch SpecE8 and React from GSS. You can use the chemical analyses in a GSS data sheet to set up and run SpecE8 and React calculations. Analysis → Launch…
Enabling High-Quality Printing in Web Applications
Kim Tolbert The Catholic University of America and Goddard Space Flight Center August 22-23, Fermi Solar Data Analysis Workshop at GSFC
Ts_print IN A FEW EASY STEPS. C L E A N, Q U A L I T Y D A T A F O R E X C E L L E N C E I N R E S E A R C H ts_print is CRSP’s flexible report writer.
The set of files includes : Tcl source of the POLYGON program The database (file obtained initially by P.Afonine from using phenix.model_vs_data.
EOVSA Data and Database System Gordon Hurford and Jim McTiernan EOVSA Prototype Readiness Review 24-Sept-2012.
0 eCPIC User Training: Dependency Mapper These training materials are owned by the Federal Government. They can be used or modified only by FESCOM member.
F. Levrier (LERMA - ENS) J. Pety (LERMA - IRAM Grenoble) P. Salomé (LERMA - Observatoire de Paris) STAR FORMAT meeting, Heidelberg, 4-5 may 2010 Making.
Mobile Photo James Anderson, Dustin Duran, Trevor Hamilton, Ahror Rahmedov, Vivek Rajkumar, Matthew Renzelmann.
Technical Workshops | Esri International User Conference San Diego, California Supporting High-Quality Printing in Web Applications with ArcGIS 10.1 for.
GLAST Science Support Center May 8, 2006 GUC Meeting Demonstration of GRB Spectral Analysis with the SAE David Band (GSSC/JCA-UMBC)
Introduction to RHESSI Data Analysis Documentation Data Products Access to Data SSW Analysis Modes RHESSI GUI Combining GUI and Command Line RHESSI Objects.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Supporting High-Quality.
Nfs or ftp server Server 1 Server 2 ClinCapture web app SAS script SAS REST notification service [SAS RNS] (can be run as standalone app) upload / download.
EOVSA Data and Database System J. McTiernan EOVSA CoDR 25-April-2011.
The material contained in this document is proprietary to Triniti Corporation (Triniti). This material may not be disclosed, duplicated or otherwise revealed,
Integrating QDEC with Slicer3 Click to add subtitle.
Fall 2003Sylnovie Merchant, Ph.D. ACCESS Tutorial Note: The purpose of this tutorial is to provide an introduction to some of the functions of ACCESS in.
Registration Solutions for your Event Management.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
Squirrel Tutorial Pre – Pre-Process Steps Modify Single Ion (SI) M/z Calibration Fitting Baseline Fitting Donna Sueper Aerodyne, University of Colorado,
SDRouteManagerCE A quick overview of functionality.
D. Heynderickx DH Consultancy, Leuven, Belgium 22 April 2010EuroPlanet, London, UK.
Digital Packaging Processor - Overview Gordon Hurford Nov 7, 2011 EOVSA Technical Design Meeting - NJIT.
GALILEO Tutorial ProQuest Search Basics Press a key or click the mouse button to advance to the next slide. July 2008.
EOVSA Pipeline Processing System J. McTiernan EOVSA Prototype Review 24-Sep-2012.
TROI – SPC Database Walkthrough Training Presentation Doc. USTP0213 Rev4.
ADPS Science Software Development Bryan Franz NASA Ocean Biology Processing Group Aquarius Data Processing Workshop, NASA/GSFC, March 2007.
May 29, 2006 GWADW, Elba, May 27 - June 21 LIGO-G0200XX-00-M Data Quality Monitoring at LIGO John Zweizig LIGO / Caltech.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
Horizon Photo-mote. ability to access photographs and images stored online, with the aid of a wireless remote remote enables the user to identify and.
FLIGHT PATH GUI David Alfego Josh Harrison. PURPOSE  Trials flown in Microsoft Flight Simulator X  Data collected according to coordinates of each flight.
WORKSHOP 1 introduction
Cover page.
Particle Insight Getting Started – Start-up & New Run….
Particle Insight Getting Started – Start-up & New Run….
Presentation transcript:

EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011

EOVSA pipeline processing summary: Interim DB (from DPP) Archive Process Application, File DBs Qlook Spec, FS Process Qlook Spec, Full Sun images The first Process takes the IDB; does time-dependent calibration, time and frequency averaging and creates the first of the Application databases. The next Process takes the ADB files, and creates spectrograms and full Sun images for browsing purposes and for use by the data analysis SW. The start point is the interim database, output from the DPP. This has had time-independent calibrations applied. Application databases are “Science” data, binned in time and frequency for use by the Data Analysis SW - in MIRIAD format (can also do FITS format if people want to use non-MIRIAD SW). We expect multiple datasets, magnetography, bursts, utility, type III. File databases contain information about the time range covered by each Application dataset. Quicklook Spectrograms are dynamic power spectra, functions of frequency and time, that can be used to choose time and frequency intervals by the data analysis SW. Full sun images could be used for choosing positions for high spatial resolution imaging.

Burst Process The next process examines the Qlook spectra and attempts to create a list of events. Also in this step, we look for intervals for magnetography, feeding back into the Mag. Database. Information from non-EOVSA sources may be helpful in identifying events. Event List Once we have a list of events, we go back and create more application databases, for flares, type IIIs. Event DBs The event database will be optimized in frequency and time resolution for burst studies. Event Images Images of bursts will hopefully be generated automatically, for distribution, and display on the cool EOVSA web pages. Event Archive Process Event Image Process Mag. DBModels Display

The EOVSA GUI is an IDL wrapper that will create MIRIAD scripts, which can be run locally or on a dedicated EOVSA server. The GUI borrows heavily from the RHESSI data analysis software. On initialization, the user chooses an observation time interval, and the dynamic spectrum for that time range is displayed. (Sample is FST data, but plot is simulated. ) The user will have the option of choosing time and frequency ranges graphically, or via pop-up widgets. Other settings, e.g., frequency binning, baseline choices, or frequency masks, are handled by selection widgets. Analysis SW: EOVSA IDL GUI

If you click the file pulldown: “Select Observation Time Interval” selects a time interval for which the Olook spectrogram will be plotted in the window. “Retrieve/Process Data” allows for choice of time interval and frequency bands for images and spectra. This is where most of the action is. You choose your parameters, press the “DO” button, MIRIAD commands are generated, and images or spectra are done. The rest of the buttons are for plotting, and exporting data: “Set Plot Preferences”, Sets plotting preferences for screen files and plot files, “Configure Plot File” allows the user to name the file, and output directory. “Print Plot” will print the plot, “Export Data” will allow you to export the data non- graphically, maybe in FITS format. “Exit” means exit. Currently only the Exit button is operational. The rest will be filled in.

Once the “DO” button is clicked, the IDL program generates a series of MIRIAD commands, which are written to a file. If the user has MIRIAD on his system, a process is spawned, and maps are created. If the user has no MIRIAD, then there is an option to upload the command file to our server, which will queue and then run the process. The user can choose to be notified via that his process has been run, or the IDL shell can be configured to automatically look for results. Image maps are saved in (FITS, MIRIAD or FITS or both) format. The EOVSA program will be able to read and display the image files.

Testing plan: Use FST foc data to establish ability to write MIRIAD format files, this will be needed for DPP and application databases. Resulting files will be used as input for prototype of data analysis SW. Also model files will be used to establish imaging capability