EOVSA Data and Database System J. McTiernan EOVSA CoDR 25-April-2011.

Slides:



Advertisements
Similar presentations
Poltys CA Outbound Dialer Module Training Presentation.
Advertisements

Little Used, but Powerful Features with GP Cathy Fregelette, CPA, PMP Practice Manager BroadPoint Technologies September 20, 2012.
1 Microsoft Access 2002 Tutorial 9 – Automating Tasks With Macros.
The main tools and functions of the system can be accessed via this side bar Allometric equations editor can be accessed under utilities, and user.
Software for Science Support Systems EVLA Advisory Committee Meeting, March 19-20, 2009 David M. Harland & Bryan Butler.
OVSA Expansion Software Overview Gordon Hurford Kickoff Meeting NJIT 25-Oct-2010.
Dale E. Gary Professor, Physics, Center for Solar-Terrestrial Research New Jersey Institute of Technology 1 3/16/2012OVSA Preliminary Design Review.
RHESSI and OVSA Data Base Organization J. McTiernan OVSA expansion project kickoff meeting 25-Oct-2010.
FASR-A 6 Gb/s x 2 x GB/s 400 GB/day 50 GB/day ~1 GB/day X xxx FASR Data Analysis Plan 22-May-2005 Simplified Data Pipeline.
THEMIS Science Software Training1July 2007 The THEMIS Graphical User Interface J. McTiernan 23-Jul-2007
FASR Calibration and Data Management Issues Gordon Hurford Space Sciences Lab University of California, Berkeley 9 Feb 2006 FASR Development Meeting.
1 Computing for Todays Lecture 22 Yumei Huo Fall 2006.
1 Computing for Todays Lecture 16 Yumei Huo Fall 2006.
1 QED In Vivo USB Input Output Box configuration This tutorial contains a number of instructions embedded in a great deal of explanation. Procedures that.
The Usage of IDB Analyzer: From our Research on Homework Saki Ikoma Penn State EDTHP
The 12 screens to follow contain a number of Tool descriptions, some instructions on their use, and in some cases a Task or two. If you dedicate one hour.
© 2008 The McGraw-Hill Companies, Inc. All rights reserved. ACCESS 2007 M I C R O S O F T ® THE PROFESSIONAL APPROACH S E R I E S Lesson 4 – Creating New.
Ircon ® ScanIR ® 3 Linescanner How to work with Snapshots? Confidential Rev. A 07/2013.
Chapter 9 Scripting RMAN. Background Authors felt that scripting was a topic not covered well Authors wanted to cover both Unix/Linux and Windows environments.
London April 2005 London April 2005 Creating Eyeblaster Ads The Rich Media Platform The Rich Media Platform Eyeblaster.
London April 2005 London April 2005 Creating Eyeblaster Ads The Rich Media Platform The Rich Media Platform Eyeblaster.
Department of Mechanical Engineering, LSUSession VII MATLAB Tutorials Session VIII Graphical User Interface using MATLAB Rajeev Madazhy
Solar observation modes: Commissioning and operational C. Vocks and G. Mann 1. Spectrometer and imaging modes 2. Commissioning proposals 3. Operational.
LiveCycle Data Services Introduction Part 2. Part 2? This is the second in our series on LiveCycle Data Services. If you missed our first presentation,
Tutorial 121 Creating a New Web Forms Page You will find that creating Web Forms is similar to creating traditional Windows applications in Visual Basic.
Protecting life, environment and property… 1 AutroMaster 5000: Version 4.0 Operation ID: AM5000_operation_eng_
Marcel Casado NCAR/RAP WEATHER WARNING TOOL NCAR.
A Universal Framework for Data Validation Giovanni Organtini INFN-Sez. di Roma.
Designing Interface Components. Components Navigation components - the user uses these components to give instructions. Input – Components that are used.
Kim Tolbert The Catholic University of America and Goddard Space Flight Center August 22-23, Fermi Solar Data Analysis Workshop at GSFC
Ts_print IN A FEW EASY STEPS. C L E A N, Q U A L I T Y D A T A F O R E X C E L L E N C E I N R E S E A R C H ts_print is CRSP’s flexible report writer.
Astrogrid Workshop – Group C (solar) Anne-Marie Broomhall, Bill Chaplin, Yvonne Elsworth, Steve Hale, Andrew Inglis, Brek Miller, David Pascoe, Graham.
Digital Packaging Processor Gordon Hurford Jim McTiernan EOVSA PDR 15-March-2012.
EOVSA Data and Database System Gordon Hurford and Jim McTiernan EOVSA Prototype Readiness Review 24-Sept-2012.
F. Levrier (LERMA - ENS) J. Pety (LERMA - IRAM Grenoble) P. Salomé (LERMA - Observatoire de Paris) STAR FORMAT meeting, Heidelberg, 4-5 may 2010 Making.
Microsoft Office Outlook 2013 Microsoft Office Outlook 2013 Courseware # 3252 Lesson 6: Organizing Information.
Creating Graphical User Interfaces (GUI’s) with MATLAB By Jeffrey A. Webb OSU Gateway Coalition Member.
Introduction to RHESSI Data Analysis Documentation Data Products Access to Data SSW Analysis Modes RHESSI GUI Combining GUI and Command Line RHESSI Objects.
HTML Form Widgets. Review: HTML Forms HTML forms are used to create web pages that accept user input Forms allow the user to communicate information back.
6 th Annual Focus Users’ Conference 6 th Annual Focus Users’ Conference Import Testing Data Presented by: Adrian Ruiz Presented by: Adrian Ruiz.
Basic Community Tools: Surveys, tasks, chat room, blogs, forums and the gallery.
Part 4 Processing and saving data with CGI/Perl Psychological Science on the Internet: Designing Web-Based Experiments From the Ground Up R. Chris Fraley.
Copyright © 2015 Pearson Education, Inc. Publishing as Pearson Addison-Wesley C H A P T E R 13 GUI Programming.
Digital Packaging Processor - Overview Gordon Hurford Nov 7, 2011 EOVSA Technical Design Meeting - NJIT.
1 Database Design and Development: A Visual Approach © 2006 Prentice Hall Chapter 12 DATABASE DESIGN AND DEVELOPMENT: A VISUAL APPROACH Chapter 12 Accessing.
IS493 INFORMATION SECURITY TUTORIAL # 1 (S ) ASHRAF YOUSSEF.
Water Use Efficiency Data
Event and Feature Catalogs in the Virtual Solar Observatory Joseph A. Hourclé and the VSO Team SP54A-07 : 2008 May 30.
EOVSA Pipeline Processing System J. McTiernan EOVSA Prototype Review 24-Sep-2012.
TROI – SPC Database Walkthrough Training Presentation Doc. USTP0213 Rev4.
Wimba Pronto Setting Pronto Preferences of the ND University System April 2009.
May 29, 2006 GWADW, Elba, May 27 - June 21 LIGO-G0200XX-00-M Data Quality Monitoring at LIGO John Zweizig LIGO / Caltech.
Correlator GUI Sonja Vrcic Socorro, April 3, 2006.
HIFI Tutorial 1: Running the HIFI Pipelines and Adaptations A.P.Marston ESAC 27 June 2013.
Solar observations with single LOFAR stations C. Vocks 1. Introduction: Solar Radio radiation 2. Observations with single LOFAR stations 3. Spectrometer.
VB.NET and Databases. ADO.NET VB.Net allows you many ways to connect to a database. The technology used to interact with a database or data source is.
 ASP.NET provides an event based programming model that simplifies web programming  All GUI applications are incomplete without enabling actions  These.
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
19 Copyright © 2004, Oracle. All rights reserved. Database Backups.
XP New Perspectives on Microsoft Office Access 2003 Tutorial 4 1 Microsoft Office Access 2003 Tutorial 4 – Creating Forms and Reports.
Creating SQL Database file And Displaying a Database Table in a DataGridView.
How to develop a VoIP softphone in C# by using OZEKI VoIP SIP SDK This presentation demonstrates the first steps concerning to how to develop a fully-functional.
XP Creating Web Pages with Microsoft Office
The CORNISH data reduction pipeline. Architecture - Overview AIPS Tasks Obit Tasks ObitTalk / Python Control Scripts MySQL Database Book-keeping Raw Data.
Simple Add-Ons from Disus
HIFI Hands-on Exercises
HOW TO CREATE A CLASS Steps:
Presentation transcript:

EOVSA Data and Database System J. McTiernan EOVSA CoDR 25-April-2011

EOVSA data processing: Processes Interim DB (from DPP) L0-L1 (Archive) Process Application DB File DB L1-L2 (Spectro) Process Qlook Spectrogram The L0 Process takes the IDB; does time-dependent calibration, time and frequency averaging and creates the Application database. The L1 Process takes the ADB files, and creates spectrograms for browsing purposes and for use by the data analysis SW. The L2 Process creates an event list of Solar radio Bursts. L2-L3 (Burst) Process Event List

EOVSA data processing: Products Interim DB (from DPP) L0-L1 (Archive) Process Application DB File DB L1-L2 (Spectro) Process Qlook Spectrogram The Application database is the archived database; “Science” data, binned in time and frequency for use by the Data Analysis SW - in MIRIAD format (can also do FITS format if people want to use non-MIRIAD SW). We expect at least three types of datasets, magnetography, bursts, and utility. The File database is a set of files containing information about the time range covered by each Application dataset. L2-L3 (Burst) Process Event List (Not sure if it’s possible to create an event list in an automated process, will start with RHESSI-like process.)

EOVSA data processing: Calibration? Interim DB (from DPP) L0-L1 (Archive) Process Application DB File DB L1-L2 (Spectro) Process Qlook Spectrogram Partial calibration happens in the DPP process, the data are calibrated using a time-independent gain factors. It is expected that this will be useful for simple tasks like spectral generation, but not for maps. The L0 process will analyze calibrator data, then apply or add time-dependent calibration. Post-imaging, more calibration might occur (maybe from “self-cal” or “closure phase output”) and added back into the ADB. L2-L3 (Burst) Process Event List Extra Calibration

EOVSA data processing: Maps Interim DB (from DPP) L0-L1 (Archive) Process Application DB File DB L1-L2 (Spectro) Process Qlook Spectrogram Once we have good calibrations, we can make maps of the Sun. Given a flare list, we can create flare images in some standard frequency bands. Also we will image active regions. Full Sun imaging may also be an option. L2-L3 (Burst) Process Event List Extra Calibration L3-L4 (Image) Process Radio Maps of the Sun,

EOVSA data analysis SW: The EOVSA GUI is an IDL wrapper that will create MIRIAD scripts, which can be run locally or on a dedicated EOVSA server. On initialization, the user chooses an observation time interval, and the dynamic spectrum for that time range is displayed. (Sample is not radio.) The user will have the option of choosing time and frequency ranges graphically, or via pop-up widgets. Other settings, e.g., frequency binning, baseline choices, or frequency masks, are handled by selection widgets. Once the image process is set up, the user presses a button.

EOVSA data analysis SW: Once the “Process” button is clicked, the IDL program generates a series of MIRIAD commands, which are written to a file. If the user has MIRIAD on his system, a process is spawned, and maps are created. If the user has no MIRIAD, then there is an option to upload the command file to our server, which will queue and then run the process. The user can choose to be notified via that his process has been run, or the IDL shell can be configured to automatically look for results. Image maps are saved in (FITS, MIRIAD or FITS or both) format. The EOVSA program will be able to read and display the image files.