[A Refresher On …] Tools for Matlab Analysis of DAQ Data [ from the 9ma Experiments] Ned Arnold October 2009.

Slides:



Advertisements
Similar presentations
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
Advertisements

Overview QW Gateway is a new front-end to QuipWare
Getting Started: Ansoft HFSS 8.0
Software to Manage EEP Vegetation Plot Data A design proposal Michael Lee January 31, 2011.
A graphical user interface (GUI) is a pictorial interface to a program. A good GUI can make programs easier to use by providing them with a consistent.
V4 – Executive Summary 1.Provide online add/delete of I/O to support continuous operation. 2.Provide redundant control of remote I/O to support improved.
1 Case Study: Starting the Student Registration System Chapter 3.
The Design Of A Web Document Snapshots Delivery System David Chao College of Business San Francisco State University.
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test L. Miller 1 GLAST Large Area Telescope: I&T Integration Readiness Review.
CFT Offline Monitoring Michael Friedman. Contents Procedure  About the executable  Notes on how to run Results  What output there is and how to access.
Chapter 33 CGI Technology for Dynamic Web Documents There are two alternative forms of retrieving web documents. Instead of retrieving static HTML documents,
สาขาวิชาเทคโนโลยี สารสนเทศ คณะเทคโนโลยีสารสนเทศ และการสื่อสาร.
Objectives Understand what MATLAB is and why it is widely used in engineering and science Start the MATLAB program and solve simple problems in the command.
Capture and Replay Often used for regression test development –Tool used to capture interactions with the system under test. –Inputs must be captured;
Introduction to Matlab & Data Analysis
Copyright © 2007, Oracle. All rights reserved. Managing Concurrent Requests.
PHP meets MySQL.
1 Functions 1 Parameter, 1 Return-Value 1. The problem 2. Recall the layout 3. Create the definition 4. "Flow" of data 5. Testing 6. Projects 1 and 2.
Tunis International Centre for Environmental Technologies Small Seminar on Networking Technology Information Centers UNFCCC secretariat offices Bonn, Germany.
TCL/Tk Based Environment for Mixed-Signal Circuit Design System Description Software Architecture Examples Future Directions Summary.
Team Difficulty, UI, and NQ Mi Seon Park Caitlyn Seim David Fleischhauer Charles Ethan Hayes Weiqing Li.
Introduction to Engineering MATLAB – 6 Script Files - 1 Agenda Script files.
Current and Future Applications of the Generic Statistical Business Process Model at Statistics Canada Laurie Reedman and Claude Julien May 5, 2010.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
Subversion in the Sur lab A tool for organizing and sharing analysis code.
An Environment for Matlab Analysis of DAQ Data from the 9ma Experiments Ned Arnold October 2009.
Ned Arnold 13 July, 2009 Convenience Tools … July 13, 2009.
Advanced Topics- Functions Introduction to MATLAB 7 Engineering 161.
Creating Graphical User Interfaces (GUI’s) with MATLAB By Jeffrey A. Webb OSU Gateway Coalition Member.
Functional Testing Montpellier October 2006 perfSONAR Meeting Michalis Michael (Cynet)
26 Mar 04 1 Application Software Practical 5/6 MS Access.
Chapter 3 MATLAB Fundamentals Introduction to MATLAB Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
Sessions in PHP – Page 1 of 13CSCI 2910 – Client/Server-Side Programming CSCI 2910 Client/Server-Side Programming Topic: Sessions in PHP Reading: Williams.
1 Ch. 1: Software Development (Read) 5 Phases of Software Life Cycle: Problem Analysis and Specification Design Implementation (Coding) Testing, Execution.
 2008 Pearson Education, Inc. All rights reserved PHP.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
NYS Division of Homeland Security And Emergency Services (DHSES) E-Grants Tutorial Creating an Application for the EOC RFP To access DHSES E-Grants you.
Microsoft Access is a database program to manage sort retrieve group filter for certain records.
Software Development Problem Analysis and Specification Design Implementation (Coding) Testing, Execution and Debugging Maintenance.
Greenstone Internals How to Build a Digital Library Ian H. Witten and David Bainbridge.
Cloud platforms Lead to Open and Universal access for people with Disabilities and for All WP Federating repositories of Solutions.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
1 MS Access. 2 Database – collection of related data Relational Database Management System (RDBMS) – software that uses related data stored in different.
Pipeline Introduction Sequential steps of –Plugin calls –Script calls –Cluster jobs Purpose –Codifies the process of creating the data set –Reduces human.
NSF Review, 18 Nov 2003 Peter Shawhan (LIGO/Caltech)1 How to Develop a LIGO Search Peter Shawhan (LIGO / Caltech) NSF Review November 18, 2003 LIGO-G E.
Visual DCT upgrade Gasper Jansa, Cosylab SLAC, April 2005.
Higher Computing Science 2016 Prelim Revision. Topics to revise Computational Constructs parameter passing (value and reference, formal and actual) sub-programs/routines,
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. A Concise Introduction to MATLAB ® William J. Palm III.
Remcom Inc. 315 S. Allen St., Suite 416  State College, PA  USA Tel:  Fax:   ©
July 19, 2004Joint Techs – Columbus, OH Network Performance Advisor Tanya M. Brethour NLANR/DAST.
Air pollutants, such as aerosols and various trace gases, are transported on a hemispheric or global scale. The Task Force on Hemispheric Transport of.
Dept. of Animal Breeding and Genetics Programming basics & introduction to PERL Mats Pettersson.
Navigation Framework using CF Architecture for a Client-Server Application using the open standards of the Web presented by Kedar Desai Differential Technologies,
Basic Navigation in Oracle R12 BY: Muhammad Irfan.
Unix tools Regular expressions grep sed AWK. Regular expressions Sequence of characters that define a search pattern banana matches the text banana
VisIt for the Mantid Project Owen Arnold (Tessella LLC) Michael Reuter (ORNL NSSD) February 10, 2011.
PROTEIN IDENTIFIER IAN ROBERTS JOSEPH INFANTI NICOLE FERRARO.
THIS MORNING (Start an) informal discussion to -Clearly identify all open issues, categorize them and build an action plan -Possibly identify (new) contributing.
Databases.
Data Virtualization Demoette… Custom Java Procedures
OPSE 301: Lab13 Data Analysis – Fitting Data to Arbitrary Functions
Outline Matlab tutorial How to start and exit Matlab Matlab basics.
User Defined Functions
Chapter 15 QUERY EXECUTION.
Cohesion and Coupling Chapter 5, Pfleeger 01/01/10.
Tomaž Špeh, Rudi Seljak Statistical Office of the Republic of Slovenia
Environmental Monitoring: Coupling Function Calculator
Metadata The metadata contains
OBSERVER DATA MANAGEMENT PRINCIPLES AND BEST PRACTICE (Agenda Item 4)
Calibration Infrastructure Design
Presentation transcript:

[A Refresher On …] Tools for Matlab Analysis of DAQ Data [ from the 9ma Experiments] Ned Arnold October 2009

Interactive analysis of DAQ Data using Matlab  Learning Curve Questions … –How do you know which DAQ data directory to use? –How do you know what valid timeframes of data are in a particular directory? –How do you know the channel names archived in the DAQ? –What do you do if you get an error from daq_fetch? –What is the structure of the data returned for a channel from daq_fetch? DAQ_data{n}(x,y,z) –How do you know the sub-channels of a channel … How many and what do they represent (I, Q, Amplitude, Phase, X, Y, Klystron parameters, etc) –Since the number of samples returned varies from channel to channel, how do you align them? Answer: correlate the sample #s stored in daq{n}(:,:,1) … (easily said!) –How do you know which sample #’s are supposed to have beam (i.e. valid diagnostic data)? –How do you decipher the TIME array returned by daq_fetch? –“I’m sure someone has had to implement this algorithm, where can I find an example?” 2

Interactive analysis of DAQ Data using Matlab  Existing Tools… –daq_fetch.m (Michael Davidsaver) Calls DESY-provided daq_read_svr() Input arguments: list of channel_names, Tstart, Tend –DAQ directory hard-coded in daq_fetch.m Output arguments: list of channel names (+ time), DAQ data (dlbl, daq) –daq_fetch_v2.m (enhanced by Ned Arnold) Calls DESY-provided daq_read_svr() Input arguments: list of channel_names, Tstart, Tend, DAQ directory, retry flag Output arguments: list of channel names (+ time), daq data [dlbl, daq], prints channels which are missing data –DESY’s DAQ DATA GUI Finds channel names which exist in DAQ repository for a specific time period Basic plotting and viewing of DAQ data 3

Interactive analysis of DAQ Data using Matlab  Existing Tools… –DOI Version 1 - Matlab GUI to retrieve DAQ data Entry fields for Tstart, Tend, DAQ Directory Select channels using predefined “channel group” files Estimates amount of data being requested On daq_fetch error, searches for the channel that is missing data Store results in a local file (for interactive analysis) Provides a framework for writing analysis programs that are “time frame independent” Introspection of analysis scripts to discover channels used by script –(i.e. selecting an analysis script puts those channels on the list to be fetched) Select analysis script, select time frame, execute … (2 mouse clicks) 4

Interactive analysis of DAQ Data using Matlab  New Tools (under development, but already useful) … –A Wiki site where you can get your questions answered AND contribute your own answers to common issues –A database of DAQ channels as of :16:34 (the last time the DAQ was restarted during the September run)A database of DAQ channels Search by …. –System, Channel Name (or partial name), Description, Type (spectra, scalar, bitmap) For a selected channel, the tool displays … –Units, type, # of samples/pulse, sample pattern, etc –A description of the channel –Sub-channels of data and their descriptions (e.g. I / Q) Extracted channel info from linac_main_run4453_chan_dscr.xml … how accurate is this? –Not 100% consistent with experience of DAQ data » Some channels return no data (Halo, dipoles, etc) –Looking for better descriptions of sub-channels –Need help! 5

Interactive analysis of DAQ Data using Matlab  Proposed Tool –DOI Version 2 … Retrieves information from the Channel Database for # of subchannels, size, etc Allows channel list editing (deletion/addition of individual channels) before the fetch Allows use of “nicknames” (with the help of the Channel Database) Retrieves information from the Channel Database to know how to “pre-process” certain channels (i.e. calculate phase/amplitude from I/Q, pre-alignment of diagnostic data, etc) Requires … –A commitment to maintain the Channel Database … 6