Background runs at the UW “farm” A little background: we have installed the GRID-standard condor from the other UW in Madison. –Currently 6 CPUs available,

Slides:

Advertisements

Similar presentations

STAR Status of J/  Trigger Simulations for d+Au Running Trigger Board Meeting Dec5, 2002 MC & TU.

Advertisements

Future Dataflow Bottlenecks Christopher O’Grady with A. Perazzo and M. Weaver Babar Dataflow Group.

GLAST LAT Project Calibration and Analysis Meeting, 28 Nov 2005 E. Grove et al. 1 Proposed Flight Trigger Configuration: Engines and Scheduler Table J.

S. Ritz 1 Hardware Trigger Throttle Issues Context: the triggers Purpose of throttle on TKR trigger Earlier design using TKR geographic information The.

GLAST LAT Project Apr 1, 2005 E. do Couto e Silva 1/31 Overview of End to End Runs Eduardo do Couto e Silva April 1, 2005 ( not it is not a joke, we finally.

SVAC/ISOCInstrument Analysis Workshop, February 27, 2006 Anders W. Borgland 1 Overview Of LAT Data Taking Anders W. Borgland Science Verification, Analysis.

S. Ritz1 Checking Out What is Checked In  Need to optimize balance of checking between users and developers. –infuse more of a culture of detailed checking.

Bill Atwood, SCIPP/UCSC, Oct, 2005 GLAST 1 DC2 Discussion – What Next? 1)Alternatives - Bill's IM analysis - ???? 2)Backing the IM Analysis into Gleam.

GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test A. T. Kavelaars 1 GLAST Large Area Telescope: I&T Integration Readiness.

GLAST Rate Calculations Toby Burnett 12 Jan Jan 2000T. Burnett GLAST rate calculations2 Components used to measure rates Source model –Geomagnetic.

GLAST LAT ProjectTrigger Scheduler, Engines, and Rates 6 Feb 2006 J. Eric Grove Naval Research Lab Washington DC Trigger Scheduler, Engines, and Rates.

A.Chekhtman1 GLAST LAT ProjectCalibration and Analysis group meeting, April, 3, 2006 CAL on-orbit calibration with protons. Alexandre Chekhtman NRL/GMU.

Bill Atwood, SCIPP/UCSC, Oct, 2005 GLAST 1 Background Files Available Processed 500M v7r2 Bkg. events run at SLAC Processed 2M v7r2 All Gammas Processed.

GLAST June 8, 2000, P. Roger Williamson, BFP - 1 Balloon Flight Planning Roger Williamson June 8, 2000.

GLAST LAT Project 1S. Ritz Discussion: To Where From Here? DC1 Closeout Meeting February 13, 2004 S. Ritz Gamma-ray Large Area Space Telescope.

GLAST LAT ProjectDOE/NASA CD3-Critical Design Review, May 12, 2003 S. Ritz Document: LAT-PR Section 03 Science Requirements and Instrument Design.

Analysis Meeting 31Oct 05T. Burnett1 Classification, etc. status at UW Background rejection for the v7r2 “500M” run at SLAC”: first look at v7r3.

GLAST LAT ProjectGLAST Flight Software IDT, October 16, 2001 JJRussell1 October 16, 2001 What’s Covered Activity –Monitoring FSW defines this as activity.

Bill Atwood, SCIPP/UCSC, Dec., 2003 GLAST ALL GAMMAs using the New Recons First runs of ALL GAMMA – from glast-ts and SLAC Unix farm glast-ts sample: no.

GLAST LAT ProjectI&T Meeting – Feb 12, 2003 W. Focke 1 EM timing analysis Warren Focke February 12, 2004.

GLAST LAT Project11/18/04 I&T Two Tower IRR 1 GLAST Large Area Telescope: Integration and Test Two Tower Integration Readiness Review Particle Test Gary.

Residual Background events after Rejection Cuts M total background events (GlastReleasev3r3p7) 344 residual events after Bill's rejection cuts. 342.

GLAST LAT Project IA Workshop 4 July 15, 2005 E. do Couto e Silva 1/7 Overview of Data Taking Anders W. Borgland Science Verification, Analysis and Calibrations.

GLAST LAT ProjectTest Planning Meeting Aug 2, 2004 E. do Couto e Silva 1/6 SVAC EM2 Goals Develop distributions for E2E tests that involve comparison of.

GLAST background review dec Simulating rates: the big picture Incoming rate into the 6 m 2 sphere: is it right? Corresponding trigger rate: implies.

GLAST LAT ProjectIA Workshop 6 – Feb27,2006 S. Ritz Backgrounds and Trigger Rates 1 Backgrounds and Trigger Rates on Orbit S. Ritz with many contributions.

T. Burnett: DC2 kickoff 2-Mar-061 DC2 Orbit and Background Orbit: 55 days Pointing strategy: scan & rock! Background Model generation Interleave with signal.

Analysis Meeting 14Nov 05T. Burnett1 Classification, etc. status at UW New application to apply trees to existing tuple Background rejection for the v7r2.

Bill Atwood, SCIPP/UCSC, Oct, 2005 GLAST 1 Back Ground Rejection Status for DC2 a la Ins. Miner Analysis.

Analysis meeting 11July05 - T. Burnett 1 Status of the Background Review DC2 prep meeting: Switch to CRflux package by Mizuno for charged particles, Earth.

ACD calibrations Pedestals Measured from online script Measure PHA w/ HV off, no charge injection Use cyclic triggers ~ ADC counts, very narrow.

CalRecon Moments Analysis Studies I Tracy Usher1/17 A Brief History of Glast Release GR (Friday, July 15) –Effectively, the first DC-2 2M all-gamma.

When I get my CTPP 2000 CD Home What should I do?.

Operating Systems Who’s in charge in there?. Types of Software Application Software : Does things we want to do System Software : Does things we need.

KLOE Offline Status Report Data Reconstruction MonteCarlo updates MonteCarlo production Computing Farm C.Bloise – May 28th 2003.

7/23 Timers in Coldfire Processor Computer Science & Engineering Department Arizona State University Tempe, AZ Dr. Yann-Hang Lee (480)

Online Data Challenges David Lawrence, JLab Feb. 20, /20/14Online Data Challenges.

Operating Systems.

GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 8, 2002 K.Young 1 LAT Data Processing Facility Automatically process Level 0 data.

LOGO Scheduling system for distributed MPD data processing Gertsenberger K. V. Joint Institute for Nuclear Research, Dubna.

CDF data production models 1 Data production models for the CDF experiment S. Hou for the CDF data production team.

D0 Farms 1 D0 Run II Farms M. Diesburg, B.Alcorn, J.Bakken, T.Dawson, D.Fagan, J.Fromm, K.Genser, L.Giacchetti, D.Holmgren, T.Jones, T.Levshina, L.Lueking,

GLAST Large Area Telescope Instrument Flight Software Flight Unit Design Review 16 September 2004 Diagnostics Framework James Swain Stanford Linear Accelerator.

APEL & MySQL Alison Packer Richard Sinclair. APEL Accounting Processor for Event Logs extracts job information by parsing batch system (PBS, LSF, SGE.

6/26/01High Throughput Linux Clustering at Fermilab--S. Timm 1 High Throughput Linux Clustering at Fermilab Steven C. Timm--Fermilab.

LOGO PROOF system for parallel MPD event processing Gertsenberger K. V. Joint Institute for Nuclear Research, Dubna.

O After integration and test at SLAC and GSFC, BFEM was shipped to the National Scientific Balloon Facility (NSBF) at Palestine, Texas. The experiment.

EGEE is a project funded by the European Union under contract IST HEP Use Cases for Grid Computing J. A. Templon Undecided (NIKHEF) Grid Tutorial,

LOGO Development of the distributed computing system for the MPD at the NICA collider, analytical estimations Mathematical Modeling and Computational Physics.

Beam Test Plan 1999 P. Roger Williamson Hansen Experimental Physics Laboratory Stanford University GLAST Collaboration Meeting GSFC February 10, 1999.

The KLOE computing environment Nuclear Science Symposium Portland, Oregon, USA 20 October 2003 M. Moulson – INFN/Frascati for the KLOE Collaboration.

SECTION 5: PERFORMANCE CHRIS ZINGRAF. OVERVIEW: This section measures the performance of MapReduce on two computations, Grep and Sort. These programs.

Sep. 17, 2002BESIII Review Meeting BESIII DAQ System BESIII Review Meeting IHEP · Beijing · China Sep , 2002.

Accessing PBeast and monitoring the L1 trigger Emily Thompson.

GLAST Large Area Telescope LAT Flight Software System Checkout TRR Test Suites (Backup) Stanford Linear Accelerator Center Gamma-ray Large Area Space Telescope.

CPU on the farms Yen-Chu Chen, Roman Lysak, Miro Siket, Stephen Wolbers June 4, 2003.

Jaime Frey Computer Sciences Department University of Wisconsin-Madison Condor and Virtual Machines.

D0 Farms 1 D0 Run II Farms M. Diesburg, B.Alcorn, J.Bakken, R. Brock,T.Dawson, D.Fagan, J.Fromm, K.Genser, L.Giacchetti, D.Holmgren, T.Jones, T.Levshina,

Bill Atwood, 6-Feb-2008 Pass 6: GR V13R9 Muons, All Gammas, & Backgrounds Muons, All Gammas, & Backgrounds Overview Overview Data Sets: Muons: allMuon-GR-v13r9.

After integration and test at SLAC and GSFC, BFEM was shipped to the National Scientific Balloon Facility (NSBF) at Palestine, Texas. The experiment was.

S. Ritz 1 Onboard Science Processing S. Ritz F-FIDT March 2002.

GLAST LAT ProjectNovember 18, 2004 I&T Two Tower IRR 1 GLAST Large Area Telescope: Integration and Test Two Tower Integration Readiness Review SVAC Elliott.

Background Rejection Prep Work

Bernd Panzer-Steindel, CERN/IT

Commissioning of the ALICE HLT, TPC and PHOS systems

US CMS Testbed.

Who’s in charge in there?

Downlink rates The next slide was presented to Jonathans’ flux review

Tower A: A First Look Finding the Data: Login: THIS ONE! user: glast

Data Challenge 1 Closeout Lessons Learned Already

Presentation transcript:

Background runs at the UW “farm” A little background: we have installed the GRID-standard condor from the other UW in Madison. –Currently 6 CPUs available, including 2 on new hyperthreaded machine just for batch jobs –Many more in principle available in department –glast-ts is the submit machine, supplies one CPU to farm –Worker machines get Glast software using mapped glast-ts drive Using the DC2 proposed scheme –Two jobs, first creates incoming list for 1 orbit-second, second processes Assign run number: second after launch. Run only every 100 th run. Should allow replay. (But see later) Run recon only if triggers and passes onboard filter –Trigger includes LOCAL only for now, no throttle –8 kHz trigger rate, 450 Hz downlink (not counting SAA or deadtime) –running ~250 jobs/day. Started run with HEAD1.594 on Friday, up to now Fastest machine (new 64-bit processor Mips) takes 30 min/job, slowest (1000 Mips) 100 min.

Runs missing?

Reproducibility test Used HEAD1.585, run 2000 –Make a run/event list from the “downlink” events, extract these incoming particles –Run job #2 on this sampled input file –Compare the two tuple files entry by entry Results: not a disaster –Using criteria that if CalEnergyRaw is identical (to 6 figures), about ½ pass. –Suspect a RandGauss flag is not being reset. Used by Acd, Cal, Tkr. –But pass ratio is energy dependent. 