Status of data production and delivery. 2 17th CAA CrossCal Meeting – 25 March 2013 1.Status of dataset delivery 2.Status of data production pipeline.

Slides:



Advertisements
Similar presentations
CAA 10th Cross Calibration Workshop, Paris, France, 2-4th Nov CLUSTER / STAFF Action items C. Burlaud, P. Robert, M. Maksimovic, N. Cornilleau-Wehrlin,
Advertisements

STAFF Report. 1.Status of data delivery 2.Delivery Plan 3.Status of data pipeline 4.STAFF/FGM cross calibration 5.Conclusions 2 15th Cross-Calibration.
STAFF-SC / FGM Comparison I. Spectrograms comparison II. Average spectra comparison III. Wave Forms comparison IV. Noise Level Conclusions Cross_Calibration.
RHESSI and OVSA Data Base Organization J. McTiernan OVSA expansion project kickoff meeting 25-Oct-2010.
FGM report 9 th Cross calibration workshop Elizabeth Lucek, Patrick Brown, Paul French, Chris Carr, Tim Oddy, André Balogh I mperial College London March.
11 14th CAA Cross-Calibration meeting, York, 5-7 Oct 2011 STAFF CAA products & Cross-Calibration activities Patrick ROBERT & STAFF Team 5) STAFF-SC CWF.
1 10th CAA Cross-Calibration meeting, Paris, 2-4 November 2009 STAFF/SC cross-calibration activities Patrick ROBERT, C. Burlaud & STAFF Team 2) The Calibrated.
0. Short reminder of STAFF-SC and STAFF-SA experiment I. status of open action items II. status of data production III. status of calibration IV. status.
CAA 12th Cross-cal meeting Toulouse Oct STAFF status report N. Cornilleau-Wehrlin,P. Robert, V. Bouzid, and STAFF team.
Pipeline Basics Jared Crossley NRAO NRAO. What is a data pipeline?  One or more programs that perform a task with reduced user interaction.  May be.
Comparison of STAFF-SA and WBD Magnetic components of intense whistler-mode chorus Prepared by Ondrej Santolik 14th CAA Cross-Calibration meeting, York,
CAA 9th Cross-Calibration Workshop, Cambridge, England, 25th-27th March CLUSTER / STAFF ● status of calibration and archiving activities ● archiving.
CLUSTER/STAFF DATA at CAA. 11th Cross-Calibration Meeting, 7-9th April 2010, Goslar. C. Burlaud, P. Robert, O. Santolik, N. Cornilleau-Werhlin, P. Canu,
STAFF Report Patrick Robert, Rodrigue Piberne & STAFF team.
1 12th CAA Cross-Calibration meeting, Toulouse, Oct 2010 STAFF/SC Calibration & Cross-Calibration activities Patrick ROBERT & STAFF Team, LPP 2)
1 14th CAA Cross-Calibration meeting, York, 5-7 Oct 2011 STAFF CAA products & Cross-Calibration activities Patrick ROBERT & STAFF Team 5) STAFF-SC CWF.
STAFF Report Prepared by R. PIBERNE. 2 1.Status of software development 2.Status of Experiment Calibration / Cross Calibration 3.Status of dataset delivery.
WHISPER action items Gábor Facskó, Jean-Gabriel Trotignon,Séna Kougblénou, Xavier Vallières, Guillaume Lointier LPC 2 E/CNRS, Orléans, France 10th CAA.
CAA PEACE Status Iryna Rozum, Andrew Fazakerley, Natasha Doss, Andrew Lahiff, Yulia Bogdanova, Branislav Mihaljčić & the PEACE ops team MSSL 12 th Cross-Calibration.
1 CAA 2009 Peer Review, Jesus College, Cambridge, UK, March CAA Peer Review: Selected Recommendations.
DAA PEACE Status A. Fazakerley, B. Mihaljčić, I. Rozum, A. Lahiff, G. Watson, D. Kataria UCL Department of Space and Climate Physics Mullard Space Science.
9 th CAA Cross-Calibration Workshop, Jesus College, Cambridge, UK, March /17 CAA Graphics: Pre-generated/On-demand Panels and Cross-Calibration.
CAA 8th Cross-Cal meeting Kinsale (Ireland), 28 Oct 2008 Edita Georgescu EDI Status of Calibration and Archiving Activities.
CAA PEACE Status A.N. Fazakerley, I. Rozum, B. Mihaljcic.
15th CAA Cross-calibration workshop CIS archiving activities report University College of London 2012, April
Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.
Cluster Active Archive Status of DWP Activities Simon Walker, Keith Yearby, Hugo Alleyne ACSE, University of Sheffield.
Double Star Active Archive - STAFF-DWP Data errors and reprocessing Keith Yearby and Hugo Alleyne University of Sheffield Nicole Cornilleau-Wehrlin LPP.
Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.
Cluster Active Archive Science User Working Group (CAASUWG) - update Matt Taylor on behalf of CAASUWG.
Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.
Laboratoire de Physique des Plasmas C ROSS C ALIBRATION STAFF R EPORT TH M ARCH 2015 L EIDEN Prepared by R. Piberne & R. Katra Laboratoire de Physique.
20th CAA Cross Calibration Göttingen - October 15-16, 2014 Status of CIS Data Archival I. Dandouras, A. Barthe.
CIS Action Items 10 th Cross-Calibration Workshop Observatoire de Paris, Nov
1 CAA 21 th Cross Calibration Meeting, Leiden, th Mar 2015 CAA Cross Cal Meeting Mar 2015 Automated Pipeline Processing.
8th Cross-calibration Workshop CIS data delivery report Kinsale – October 2008.
FGM Report 17 th Cross Calibration Workshop Chris Carr, Elizabeth Lucek, Patrick Brown, Leah-Nani Alconcel, Barry Whiteside, Tim Oddy, Peter Fox, André.
Double Star Active Archive - DWP/STAFF 1 Double Star Active Archive STAFF/DWP Keith Yearby and Hugo Alleyne University of Sheffield Nicole Cornilleau-Wehrlin.
1 11 th CAA Cross-Calibration Workshop, Hotel die Tanne, Goslar, Germany 7-9 April 2010 CAA 11 th Cross-Calibration Workshop Hotel die Tanne, Goslar, Germany.
Laboratoire de Physique des Plasmas 20 TH CAA CROSS-CAL M EETING CLUSTER-STAFF REPORT O CTOBER 2014 G ÖTTINGEN The STAFF Team Laboratoire de Physique.
WHISPER report whisper team 16th CAA Cross-Calibration workshop Toulouse, France, 7-8 November 2012 CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE Laboratoire.
MSSL * A.N. Fazakerley, I. Rozum, N. Doss, B. Mihaljcic & the PEACE ops team PEACE CAA Action Items Status 11 th CAA Cross Calibration Meeting, 7 – 9 April.
CAA PEACE Status PEACE Operations Team Presented by Iryna Rozum MSSL Cross-Calibration Meeting, Uppsala, Sweden, April 2011.
Investigation of a discrepancy between magnetic field magnitudes determined by the FGM and EDI instruments Jonny Gloag, Edita Georgescu, Elizabeth Lucek,
1 CAA 20 th Cross Calibration Meeting, MPS, Gottingen 16th Oct 2014 CAA Cross Cal Meeting Oct 2014 Pipeline Automation Chris Perry.
WEC meeting TED status and WEC timing.
Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.
DAA Status/Progress B. Mihaljčić, A. Fazakerley, N. Doss, G. Watson UCL Department of Space and Climate Physics Mullard Space Science Laboratory 18 th.
16 th CAA Cross-Calibration Workshop IRAP, Toulouse, 6-9 November20121 Data gaps and spikes in FGM data.
21st CAA Cross Calibration Workshop Leiden, March 2015 WHISPER report WHISPER team LPC2E/CNRS.
21 th CAA Cross-Calibration Workshop Leiden, Netherlands24-26 March Introduction.
FGM Report 21 st Cross Calibration Workshop Chris Carr, Patrick Brown, Leah-Nani Alconcel, Tim Oddy, Peter Fox Imperial College London 24 March 2015.
14 th CAA Cross-calibration Workshop CIS archiving activities York October 5-7, 2011.
CAA inventory plots and graphical products overview Delphine Herment (ESTEC) ESAC - 17/03/2011.
Double Star Active Archive - STAFF- DWP 1 K.H. Yearby, S.N. Walker, M. Balikhin University of Sheffield.
16th CAA Cross-calibration Workshop
WHISPER Report Jean Gabriel Trotignon and WHISPER Team
CIS Data Archival Status
Cluster Active Archive – Wideband data BM2 mode
1. Introduction: general information
20th CAA/DAA Cross Calibration Meeting
EDI – CAA STATUS REPORT EDI CAA Status
CAA-OR (End of Phase 1) CAA DWP Operations Review
H. Rème, I.Dandouras and A. Barthe IRAP, Toulouse, France
Data Processing Status
Annual Report of the DWP Experiment 9th CAA Operations Review
Status Report of EDI on the CAA
10th CAA Operations Review Annual Report of the FGM Experiment
To get y, multiply x by 3 then add 2 To get y, multiply x by negative ½ then add 2 To get y, multiply x by 2 then subtract 3 To get y, multiply x.
DWCS2 Version UP Please place the farm files in the SD card directly under. Start the DWCS2, that Please insert the SD card. Please by pressing the.
Presentation transcript:

Status of data production and delivery

2 17th CAA CrossCal Meeting – 25 March Status of dataset delivery 2.Status of data production pipeline 3.Open Issues

a. STAFF-SA ProductContentLevel Num. of files ProducedDelivered to CAA C?_CP_STA_AGC Automatic Gain Control 1 1 file/ 1 sat./24h V04: 01/01/2001 to 31/12/2010 V05: 01/01/2011 to 31/12/2012 V04: 01/01/2001 to 31/12/2010 V05: 01/01/2011 to 31/12/2012 C?_CP_STA_PSD Power Spectral Density 2 1 file/ 1 sat./24h V04: 01/01/2001 to 31/12/2010 V05: 01/01/ /12/2012 V04: 01/01/2001 to 31/12/2010 V05: 01/01/ /12/2012 C?_CP_STA_SMSpectral Matrix2 1 file/ 1 sat./24h V04: 01/01/2001 to 31/12/2010 V05: 01/01/2011 to 31/12/2012 V04: 01/01/2001 to 31/12/2010 V05: 01/01/2011 to 31/12/ th CAA CrossCal Meeting – 25 March 2013

a. STAFF-SA 4 ProductContentLevel Num. of files ProducedDelivered to CAA C?_CQ_STA_SA_ NOT SRP_ CAVEATS PSD/SM Caveat2 1 file/ 1 sat./24h V01: 01/01/2001 to 31/12/2012 V01: 01/01/2001 to 31/12/2012 C?_CQ_STA_SA_ PSD NEG_ CAVEATS SM Caveat2 1 file/ 1 sat./24h V01: 01/01/2001 to 31/12/2012 V01: 01/01/2001 to 31/12/2012 C?_CP_STA_PPP Polarisation and Propagation Parameters 3 1 file/ 1 sat./24h V04: 01/01/2001 to 30/04/2012 V04: 01/01/2001 to 30/04/2012 C?_CQ_STA_SA_ UNDEFINED_MFA _ CAVEATS PPP Caveat3 1 file/ 1 sat./24h V01: 01/01/2001 to 30/04/2012 V01: 01/01/2001 to 30/04/ th CAA CrossCal Meeting – 25 March 2013

b. STAFF-SC, NBR and HBR mode 5 ProductContentLevel Num. of files ProducedDelivered to CAA C?_CP_STA_DWF Decommutated Waveform 1 1 file/mode/ 1 sat./24h V04: 01/01/2001 To 31/12/2011 V04: 01/01/2001 To 31/12/2011 C?_CP_STA_CWF_GSE Calibrated waveform 2 1 file/ 1 sat./24h V01: 01/01/2001 To 31/12/ C?_CP_STA_CS Calibrated Spectra 2 1 file/mode/ 1 sat./24h V02: 01/01/2001 to 31/12/2005 V03: 01/01/2006 to 31/12/2009 V04: 01/01/2010 To 31/12/2012 V02: 01/01/2001 to 31/12/2005 V03: 01/01/2006 to 31/12/2009 V04: 01/01/2010 To 31/12/2012 CL_CG_STA_SC_ SPECTRO Spectrograms Plots 3 1 file/ 4 sat./3h V01: 01/01/2001 to 31/12/2012 V01: 01/01/2001 to 31/12/ th CAA CrossCal Meeting – 25 March 2013

c. STAFF 6 ProductContentLevel Num. of files ProducedDelivered to CAA C?_CG_STA_HK STAFF House Keeping plots - 1 file/ 1 sat./24h V01: 01/01/2001 To 31/12/2012 V01: 01/01/2001 To 31/12/2012 C?_CQ_STA_ CALIBRATION_ CAVEAT STAFF Caveat3 1 file/ 1 sat./24h V01: 01/01/2010 To 30/06/2012 V01: 01/01/2010 To 30/06/ th CAA CrossCal Meeting – 25 March 2013

Year of delivery Product SC DWF Version SC Complex spectra V SC Images SC CWF GSE SA AGC/ PSD / SM/ Version SA AGC/ PSD / SM/ BE products = New version SA Polarisation/Propagation House Keeping plots d. Delivery plan 17th CAA CrossCal Meeting – 25 March 2013

All the data production pipeline are operationals. However, an upgrade of the L2 pipeline will be done to add status, half time interval and to introduce new smoothed transfer functions. a. SA b. SC b.1) All the data production pipeline are also operationals. Concerning CWF data, four years are produced and wait to be delivered. b.2) Some improvements were performed on the former pipelines. 8 17th CAA CrossCal Meeting – 25 March 2013

Eclipse - > Last progress meeting 9 b.2) SC - Improvements 17th CAA CrossCal Meeting – 25 March 2013

b.2) SC - Improvements Eclipse - > Now 10 17th CAA CrossCal Meeting – 25 March 2013

11 Onboard calibration data are now removed from CWF and CS. A caveat is created for this time period. Transfer functions were refined. Production time for CWF is now reasonable, ie 10 days for 2 years of data -> ~2 months to reproduce b.2) SC - Improvements 17th CAA CrossCal Meeting – 25 March 2013

12 Reproduce STAFF-SA data (add status, half time interval and use smoothed transfer function). STAFF EFW apparent time shift 17th CAA CrossCal Meeting – 25 March 2013