Nurcan Ozturk University of Texas at Arlington for the Distributed Analysis Support Team (DAST) ATLAS Distributed Computing Technical Interchange Meeting.

Slides:



Advertisements
Similar presentations
Request Tracking (RT) The new ticketing system Tomasz Wlodek.
Advertisements

Easy, like an attachment. But can your doc stand on its own? Yes. Only teachers can upload files to course site. So definitely a push- tool. Maybe.
Space Missions Can Your Library Automation Software Do This? David Hook MDA
DOE User Facilities. What happens when something fails? User contacts someone they know Solved my last problem User contacts local support staff Part.
INTRODUCTION TO THE VIRTUAL PLATFORM OF THE AFRICAN FORUM FOR AGRICULTURAL ADVISORY SERVICES (AFAAS)
Adcos – one shifters wildest dreams… Wahid Bhimji.
Distributed Computing Operations Stefan Roiser LHCb Computing Operations Workshop 27 Jan ‘15.
Cornell University Library Instruction Statistics Reporting System Members: Patrick Chen (pyc7) Soo-Yung Cho (sc444) Gregg Herlacher (gah24) Wilson Muyenzi.
Experiment Support Introduction to HammerCloud for The LHCb Experiment Dan van der Ster CERN IT Experiment Support 3 June 2010.
AMOD Report Doug Benjamin Duke University. Hourly Jobs Running during last week 140 K Blue – MC simulation Yellow Data processing Red – user Analysis.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES News on monitoring for CMS distributed computing operations Andrea.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
Nurcan Ozturk University of Texas at Arlington US ATLAS Distributed Facility Workshop at SLAC October 2010 Assessment of Analysis Failures, DAST.
MP5 migration: D7i – P. Martel & B. Vercoutter – TS Workshop Archamps – May 25 th 2005 – EDMS Agenda New Functionalities and Possibilities Underused.
CS621 : Seminar-2008 DEEP WEB Shubhangi Agrawal ( )‏ Jayalekshmy S. Nair ( )‏
ATLAS Outreach & Education News & Collaboration. News Reporting ATLAS progress and results to the world ATLAS Week - 11 Oct 2011S. Goldfarb - ATLAS Outreach.
LSC Segment Database Duncan Brown Caltech LIGO-G Z.
ATLAS DQ2 Deletion Service D.A. Oleynik, A.S. Petrosyan, V. Garonne, S. Campana (on behalf of the ATLAS Collaboration)
Creating a common understanding on Adverse events information requirements CCC-TI Isabelle Laugier Nov 2 nd 2012.
Nurcan Ozturk University of Texas at Arlington Grid User Training for Local Community TUBITAK ULAKBIM, Ankara, Turkey April 5 - 9, 2010 Overview of ATLAS.
Part 04 – Preparing to Deploy to the Cloud Entity Framework and MVC Series Tom Perkins NTPCUG.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
GGUS summary (7 weeks) VOUserTeamAlarmTotal ALICE ATLAS CMS LHCb Totals 1 To calculate the totals for this slide and copy/paste the usual graph please:
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
McLean HIGHER COMPUTER NETWORKING Lesson 7 Search engines Description of search engine methods.
Restricted Search Engine Laurent Balat Christophe Decis Thomas Forey Sebastien Leclercq ESSI2 Project Supervisor: Johny BOND June 2002.
BNL DDM Status Report Hironori Ito Brookhaven National Laboratory.
Enabling Grids for E-sciencE System Analysis Working Group and Experiment Dashboard Julia Andreeva CERN Grid Operations Workshop – June, Stockholm.
Searching Tutorial By: Lola L. Introduction:  When you are using a topic, you might want to use “keyword topics.” Using this might help you find better.
Experiment Support ANALYSIS FUNCTIONAL AND STRESS TESTING Dan van der Ster, CERN IT-ES-DAS for the HC team: Johannes Elmsheuser, Federica Legger, Mario.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Overview of STEP09 monitoring issues Julia Andreeva, IT/GS STEP09 Postmortem.
GGUS at PEB – –- page 1 LCG Klaus-Peter Mickel, GridKa Karlsruhe LCG-PEB-Meeting ( ) The Global Grid User Support Model (Report of GDB.
Graeme Stewart: ATLAS Computing WLCG Workshop, Prague ATLAS Suspension and Downtime Procedures Graeme Stewart (for ATLAS Central Operations Team)
WLCG Service Report ~~~ WLCG Management Board, 9 th August
DDM Monitoring David Cameron Pedro Salgado Ricardo Rocha.
Nfs or ftp server Server 1 Server 2 ClinCapture web app SAS script SAS REST notification service [SAS RNS] (can be run as standalone app) upload / download.
Storage cleaner: deletes files on mass storage systems. It depends on the results of deletion, files can be set in states: deleted or to repeat deletion.
Nurcan Ozturk University of Texas at Arlington US ATLAS Transparent Distributed Facility Workshop University of North Carolina - March 4, 2008 A Distributed.
ATLAS Experience with GGUS Guido Negri INFN – Milano Italy.
Karsten Köneke October 22 nd 2007 Ganga User Experience 1/9 Outline: Introduction What are we trying to do? Problems What are the problems? Conclusions.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Ricardo Rocha CERN (IT/GS) EGEE’08, September 2008, Istanbul, TURKEY Experiment.
Chapter 12: How Private are Web Interactions?. Why we care? How much of your personal info was released to the Internet each time you view a Web page?
PD2P The DA Perspective Kaushik De Univ. of Texas at Arlington S&C Week, CERN Nov 30, 2010.
1 End User Support Introduction Identify and select remedies.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
MUON DAQ WORKSHOP Muon Week, CERN February 2014 Nicoletta Garelli (SLAC)
Global ADC Job Monitoring Laura Sargsyan (YerPhI).
Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.
Lesson 10—Networking BASICS1 Networking BASICS The Internet and Its Tools Unit 3 Lesson 10.
Shifters Jamboree Kaushik De ADC Jamboree, CERN December 4, 2014.
0/8 HyperNews for ATLAS Status and expectations Applications Area meeting, February 1, 2006 Traudl Kozanecki.
CERN - IT Department CH-1211 Genève 23 Switzerland CERN - IT Department CH-1211 Genève 23 Switzerland Request and Incident.
CERN IT Department CH-1211 Geneva 23 Switzerland t James Casey CCRC’08 April F2F 1 April 2008 Communication with Network Teams/ providers.
Testing Infrastructure Wahid Bhimji Sam Skipsey Intro: what to test Existing testing frameworks A proposal.
Finding Data in ATLAS. May 22, 2009Jack Cranshaw (ANL)2 Starting Point Questions What is the latest reprocessing of cosmics? Are there are any AOD produced.
CERN IT Department CH-1211 Genève 23 Switzerland t Future Needs of User Support (in ATLAS) Dan van der Ster, CERN IT-GS & ATLAS WLCG Workshop.
CERN IT Department CH-1211 Genève 23 Switzerland t Distributed Analysis User Support in ATLAS (and LHCb) Dan van der Ster, CERN IT-GS & ATLAS.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
ATLAS Distributed Computing ATLAS session WLCG pre-CHEP Workshop New York May 19-20, 2012 Alexei Klimentov Stephane Jezequel Ikuo Ueda For ATLAS Distributed.
MND section. Summary of activities Job monitoring In collaboration with GridView and LB teams enabled full chain from LB harvester via MSG to Dashboard.
GGUS summary (3 weeks) VOUserTeamAlarmTotal ALICE7029 ATLAS CMS LHCb Totals
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.
Data Distribution Performance Hironori Ito Brookhaven National Laboratory.
ATLAS Distributed Computing Tutorial Tags: What, Why, When, Where and How? Mike Kenyon University of Glasgow.
How to Contribute to System Testing and Extract Results
AMI – Status November Solveig Albrand Jerome Fulachier
Pole 3 – Dashboard Assessment COD 20 - Helsinki
Do it now – PAGE 11 You will find your do it now task in your workbook – look for the start button! Wednesday, 21 November 2018.
Presentation transcript:

Nurcan Ozturk University of Texas at Arlington for the Distributed Analysis Support Team (DAST) ATLAS Distributed Computing Technical Interchange Meeting Annecy – April 19, 2012 User Support Ideas

A searchable web interface  Accumulated vast knowledge in DAST egroups however it is not searchable  Need a searchable web interface+backend database:  User types the error seen and the result will be a step-by-step description of what to do to resolve the issue (with a link to FAQ or twiki)  For some cases, provide a diagnostic tool for users to figure out the problems themselves:  Example: manageTier3SW/ATLASLocalRootBase stack to diagnose DB issues, grid-cert issues as well as generate a file containing information that can point us to the problem.  Users do their first level support by searching for themselves thus reducing the load on DAST.  The database can be populated by anyone as soon as issue is resolved.  Despite the above, not sure how many people will do searches first before asking for help. Asoka’s experience from another experiment: “other users got annoyed if someone asked a question that was already posted before and peer pressure worked. ATLAS users seem more forgiving or DAST shifters are a much more kinder lot.” Nurcan Ozturk 2 Ideas from Asoka De Silva

Jira to rescue?  Asked for a test instance of Jira from CERN IT (by Manoj Jha). May have it in 2 weeks.  DAST will evaluate its performance and plan on migrating to.  What Jira offers for us:  One interface (instead of two) for user-user and user-shifter interactions  No central page exist which displays ongoing problems affecting distributed analysis. Shifter can post ongoing problems on Jira web interface and users read them before sending any new ticket.  Possible to inform only the concerned users (for a specific issue) directly in Jira. Thus reducing the number of threads that all users receive.  A new idea from Wensheng De:  DAST shifters' reports are currently under-utilized  If shifters can make shift summaries with Jira or insert question/solution info into Jira. This would make shift summaries more regularated, machine readable, and searchable in response to future queries. Nurcan Ozturk 3

Improvements in other systems  Any improvements on the following will help in user support:  automatic retries of failed jobs  excluding problematic sites by Hammercloud  Input data availability – PD2P  Looking at dq2 traces to understand dq2-get problems better – talk by Thomas Beermann earlier  Second copy of user datasets done automatically – does not look attractive by looking at Thomas’s talk  Also improvements in communication with other teams:  Communicate better with ADCoS shifters on site problems, namely GGUS tickets may have been opened by them already Nurcan Ozturk 4