NHSC Workshop August 2013 NASA Herschel Science Center - page 1 PACS David R. Ardila User Support coordinator / NHSC Archive Scientist Recap of Data Access.

Slides:



Advertisements
Similar presentations
COMPANY LOGO HERE Getting Started 1. Download the setup file: Go to Click on the Visit Setup Page link (includes Java.
Advertisements

We’re Going ! Collaboration in the Cloud: Science Birdville ISD Instructional Technology.
Stephan Ott (Herschel Science Centre, ESTEC) on behalf of the Herschel Science Ground Segment Consortium
Chapter 41 Exploring Windows XP Vol. 1 Part Four – The World Wide Web and Windows XP.
CIS101 Introduction to Computing HTML Project Two.
This is your desktop. Open a browser and Click on this link.
ASP Cookies Y.-H. Chen International College Ming-Chuan University Fall, 2004.
CORE Volunteer Training Presented by: Tracey Calloway CORE Training/Project Manager CORE Calendar 2.0 Functionality August 22,
Paul Mundy and Bob Huggan 1 Websites.
User Guide for Individuals. Starting at crcnetbase.com, you will see the home page, if you are accessing through your university, you will see the university’s.
→ Herschel data for absolute beginners Herschel Science Centre (ESAC)
PACS Instrument Day: Welcome ! PACS Instrument Day: Welcome ! NHSC PACS R. Paladini NHSC Archive Data Processing Workshop – August 26 th – 30 th 2013 PACS.
Distributed Development: Lessons learned by Herschel GRITS 2011, June 17 Colin Borys.
Tech Vocabulary A Guide to Computer Terms and Acronyms.
NHSC SPIRE Webinar Q/A Session 20 th Nov 2013 Archive Query and Data Retrieval SPIRE Question and Answer Session Bernhard Schulz NHSC/IPAC.
U.S. Department of the Interior U.S. Geological Survey Diving into the Data Pool with DAAC2Disk Kelly Lemig ERT, Inc., contractor to the U.S. Geological.
Viewgraph 1 S. Ott Herschel Data Processing System NHSC Herschel Data Processing Workshop 26th August 2013 Overview of the Herschel Data Processing System.
Entering Data as a Contributor. Target time for completion MIN.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 SPIRE Photometer Data Reprocessing Bernhard Schulz (NHSC/IPAC) on.
LINUX TERMINAL TUTORIAL EDCI 339 – Online Presentation by Roop Rahal.
PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 SPIRE Day team, goals, schedule, logistics Bernhard Schulz NHSC/IPAC.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 Introduction to HIPE 12.1 (Part 2) Bernhard Schulz (NHSC/IPAC) on.
PACS Hitchhiker’s Guide to the Herschel Science Archive Pasadena, 6 th -10 th October 2014 Quickstart Guide to HIPE and the HSA David Shupe User Support.
NHSC Workshop August 2013 NASA Herschel Science Center - page 1 PACS David R. Ardila User Support coordinator / NHSC Archive Scientist The Herschel Science.
With Windows 7 Introductory© 2011 Pearson Education, Inc. Publishing as Prentice Hall1 Windows 7 Introductory Chapter 3 Advanced File Management and Advanced.
What is the VSO? (and what isn’t it?). The VSO …  Allows you to search multiple archives in a single search  Keeps you from needing to keep track of.
- page 1 NHSC – DP workshop – Feb – N. Billot PACS PACS Photometer Standard Pipeline Level 0 to Level 1 processing: From raw to calibrated data cubes.
- page 1 NHSC – DP workshop – Feb – N. Billot PACS PACS Photometer Standard Pipeline Level 1 to Level 2 processing: How to make a map for point source.
September 4, 2003MODIS Ocean Data Products Workshop, Oregon State University1 Goddard Earth Sciences (GES) Distributed Active Archive Center (DAAC) MODIS.
Page 1 PACS HSC SPIRE Webinar 6 th Mar 2013 Introduction and General HIPE changes that impact SPIRE Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC.
PACS Hitchhiker’s Guider to Herschel Archive Workshop – Pasadena 6 th – 10 th Oct 2014 SPIRE Photometer Data Products Kevin Xu NHSC/IPAC on behalf of the.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Photometer: Overview and Products Roberta Paladini NHSC/IPAC.
PACS Hitchhiker’s Guide to the Herschel Science Archive Pasadena, 6 th -10 th October 2014 Tuesday Introduction Agenda & Goals David Shupe User Support.
NHSC PACS How to Use getObservation And saveObservation To Access and Save Herschel Data in HIPE Yi Mei (NHSC/Caltech) Y. Mei NHSC Data Workshop – August.
NASA Herschel Science Center - page 1 B. Bhattacharya NHSC Cycle 1 Open Time Proposal Planning Workshop 3-4 June 2010 PACS Logistics & Helpdesk B. Bhattacharya.
NASA Herschel Science Center - page 1 NHSC Cycle 1 Open Time Proposal Planning Workshop 3-4 June 2010 PACS Accepted Programs & Observations to Date B.
Obs. Planning Workshop 22 July 2011 NASA Herschel Science Center - page 1 PACS David R. Ardila NHSC-HSC liaison The OT2 Call.
WBL - 1 Observation Planning Workshop, Pasadena, CA 3-4 June 2010 Herschel Observer Support Overview William B. Latter NHSC Deputy Director.
Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Tour of HIFI data.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 The SPIRE Destriper Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC 1.
Hannah Hobi IT 442 February  MENU  What is Screencast-O-Matic? What is Screencast-O-Matic?  How easy is it to use? How easy is it to use?  How.
The Use of “Virtual Field Trips” in the Electronic Classroom by D. E. Longer & Randy Gottfried.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Spectrometer: Overview and Products Roberta Paladini NHSC/IPAC.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 HIPE Introduction and Setup for SPIRE David Shupe, NHSC/IPAC on behalf of the SPIRE.
Page 1 PACS NHSC Webinar: What’s New in HIPE 13 for SPIRE 19 th May 2015, Pasadena What’s New in HIPE 13 General Topics Bernhard Schulz (NHSC/IPAC) on.
Data Processing Workshop NHSC, Pasadena, CA 02 – 04 February 2011 Stephan Ott VG #1 PACS Overview and new developments in.
Page 1 PACS GRITS 17 June 2011 Herschel Data Analysis Guerilla Style: Keeping flexibility in a system with long development cycles Bernhard Schulz NASA.
NHSC PACS PACS Photometry and Errors Estimate Roberta Paladini (NSHC/Caltech) R. Paladini NHSC Archive Data Processing Workshop – August 26 th – 30 th.
PACS Photometer Standard Pipeline Level 0 to Level 1 processing From raw to calibrated data cubes B. Altieri (ESA/HSC), N.Billot (IPAC/NHSC) ESAC March.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Issues with Photometer Data & How to Resolve them with HIPE Tools Kevin Xu.
Page 1 NHSC PACS Web Tutorial PACS 301 nhsc.ipac.caltech.edu/helpdesk NHSC/PACS Web Tutorials Running the PACS Spectrometer pipeline for CHOP/NOD Mode.
NASA Herschel Science Center - page 1 PACS NHSC Cycle 1 Open Time Proposal Planning Workshop 3-4 June 2010 ESA AO and NASA Funding Call Phil Appleton and.
HIFI Tutorial 1: Running the HIFI Pipelines and Adaptations A.P.Marston ESAC 27 June 2013.
Copyright © 2003 Pearson Education, Inc. Slide 8-1 Created by Jim Lengel, College of Communication, Boston University Web Wizard’s Guide to Shockwave.
Create a two-form project that starts from Sub Main. The first form one will see is a logon screen, which is from a previous assignment. The users are.
ESA Scientific Archives and Virtual Observatory Systems Science Archives and VO Team Research and Scientific Support Department.
PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Preparing HIPE for SPIRE work David Shupe, NHSC/IPAC on behalf of the SPIRE ICC.
Chris Knight Beginners’ workshop.
YouTube Dowload User Guide Version : After Opening YouTube Downloader Click on Download Manger on Top Right Corner highlighted.
Web coordinator workshop. Today’s objective Now you know the basics, we can explore more of the website’s features and how to successfully manage our.
Fourth Grade Home Directory/H-Drive The location on the server where individual users can save their work. This directory is named the same as the username.
BI Share Quick reference guide.
NHSC/PACS Web Tutorials
Overview and the latest developments in Herschel Data Processing
SRA Submission Pipeline
Overview and new developments in Herschel Data Processing
Create a Desktop Shortcut
Download and Install Process Explorer
By: David Mitchem, Matt Moffit
Presentation transcript:

NHSC Workshop August 2013 NASA Herschel Science Center - page 1 PACS David R. Ardila User Support coordinator / NHSC Archive Scientist Recap of Data Access Methods See Chapter 1 of Data Analysis Guide and youtube videos!

NASA Herschel Science Center - page 2 PACS NHSC Workshop August 2013 Data Management Data management in Herschel is complicated by the size of datasets Everything is about making data management efficient Do you really need big data sets in your disk?

NASA Herschel Science Center - page 3 PACS NHSC Workshop August 2013 HIPE HSA “Send to External Application” getObservation(…,useHsa=True) Product Browser For most people, this is all you need. Gets references to the data in HIPE and downloads data as needed Useful for Quick inspection Data reduction Does not save, unless you do it explicitly* *of course, there is a way to override this!

NASA Herschel Science Center - page 4 PACS NHSC Workshop August 2013 HIPE HSA “Send to External Application” HSA to local disk May be slow But then you have the data It allows you to bypass HIPE Tar file in local disk “Retrieve Products” getObservation() Use Navigator getObservation(…,useHsa=True) Product Browser Directory in local disk untar

NASA Herschel Science Center - page 5 PACS NHSC Workshop August 2013 HIPE HSA “Send to External Application” Tar file in local disk “Retrieve Products” getObservation() Use Navigator getObservation(…,useHsa=True) Product Browser Directory in local disk untar HIPE getObservation() Product Browser Local Pools (working directories in the local disk) saveObservation() saveProduct() Save Products GUI Pools are good if: You have a lot of data That needs reprocessing

NASA Herschel Science Center - page 6 PACS NHSC Workshop August 2013 HIPE HSA “Send to External Application” Tar file in local disk “Retrieve Products” getObservation() Use Navigator getObservation(…,useHsa=True) Product Browser Directory in local disk untar HIPE getObservation() Product Browser Local Pools (working directories in the local disk) saveObservation() saveProduct() Save Products GUI myHSA A type of pool. Unmodified data (or links) from HSA getObservation(…, useHsa=True, save=True) getObservation() Product Browser

NASA Herschel Science Center - page 7 PACS NHSC Workshop August 2013 HIPE HSA “Send to External Application” Tar file in local disk “Retrieve Products” getObservation() Use Navigator getObservation(…,useHsa=True) Product Browser Directory in local disk untar HIPE getObservation() Product Browser Local Pools (working directories in the local disk) saveObservation() saveProduct() Save Products GUI myHSA A type of pool. Unmodified data (or links) from HSA getObservation(…, useHsa=True, save=True) getObservation() Product Browser