Post-Deployment Monitoring Is it part of Test?

Slides:



Advertisements
Similar presentations
ETHICAL HACKING A LICENCE TO HACK
Advertisements

©2006 Systeme Evolutif LtdSlide 1 Test Process Improvement …is a waste of time? Paul Gerrard Technical Director Systeme Evolutif Systeme Evolutif Limited.
©2003 Systeme Evolutif LtdSlide 1 we’ll change the way you think about testing What Is the Value of Testing and How Can We Increase It? Paul Gerrard Technical.
Test Case Management and Results Tracking System October 2008 D E L I V E R I N G Q U A L I T Y (Short Version)
Regression Testing – What to Automate and how Assurance with Intelligence Paul Gerrard Gerrard Consulting 1 Old Forge Close Maidenhead Berkshire SL6 2RD.
AMI & Grid Data Analytics & Analysis Management Platform Page  1 What does this platform offer? Our tool is a next generation grid management software.
Software Architecture Prof.Dr.ir. F. Gielen
Social Media Marketing, Ecommerce and the Opportunities for Women in Africa Rose Maghas Africa Women Linkages Forum.
A Framework for Testing in Scrum Projects Assurance with Intelligence Paul Gerrard Gerrard Consulting 1 Old Forge Close Maidenhead Berkshire SL6 2RD UK.
Skyward Server Management Options Mike Bianco. Agenda: Managed Services Overview OpenEdge Management / OpenEdge Explorer OpenEdge Managed Demo.
Open Panel Discussion on Solving Chapter and Section Problems Brian Berg (2012 SCV Section Chair) John Swan (past Computer Soc. Chapter) Paul Wesling (e-GRID.
Business Continuity and DR, A Practical Implementation Mich Talebzadeh, Consultant, Deutsche Bank
Lecture 2b: Software Project Management CSCI102 - Introduction to Information Technology B ITCS905 - Fundamentals of Information Technology.
SESSION 9 THE INTERNET AND THE NEW INFORMATION NEW INFORMATIONTECHNOLOGYINFRASTRUCTURE.
EPIC Online Publishing Use and Costs Evaluation Program: Summary Report.
Testing - an Overview September 10, What is it, Why do it? Testing is a set of activities aimed at validating that an attribute or capability.
Brian Bradley.  Data is any type of stored digital information.  Security is about the protection of assets.  Prevention: measures taken to protect.
Introduction, getting to know you & program objectives Expro 100 Engineering The Hague November 2013.
Lesson 10: IT Project and Program Management. Lesson 10 Objectives  Identify resources for technical data  Identify project management fundamentals.
Web Development & Design Foundations with XHTML
©Test Management Forum 2006Slide 1 Post-Deployment Monitoring Is it part of Test? Paul Gerrard Technical Director, Systeme Evolutif Systeme Evolutif Limited.
User Group 2015 Security Best Practices. Presenters Steve Kelley, COO 31 years experience building and managing operations and service delivery organizations.
Web Developer & Design Foundations with XHTML
1 Web Developer Foundations: Using XHTML Chapter 8 Web Site Development.
Webmaster Overview Fort Collins, CO Copyright © XTR Systems, LLC Webmaster Overview Instructor: Joseph DiVerdi, Ph.D., MBA.
Trimble Connected Community
Implementation of HUBzero as a Knowledge Management System in a Large Organization HUBBUB Conference 2012 September 24 th, 2012 Gaurav Nanda, Jonathan.
Software Quality Assurance Lecture #8 By: Faraz Ahmed.
1 NETE4631 Managing the Cloud and Capacity Planning Lecture Notes #8.
Test Organization and Management
Test Roles and Independence of Testing Telerik Software Academy Software Quality Assurance.
What is a life cycle model? Framework under which a software product is going to be developed. – Defines the phases that the product under development.
Project Tracking. Questions... Why should we track a project that is underway? What aspects of a project need tracking?
E q Is Your Audit Plan Keeping Pace With Your Business? Duncan Edwards Liam McCaul – Partner, Risk Advisory Services E Q Internal Audit — Adding Value.
Exit, Cry Tears Dealing with Testing Review Boards Paul Gerrard Gerrard Consulting PO Box 347 Maidenhead Berkshire SL6 2GU UK e:
Information Assurance Program Manager U.S. Army Europe and Seventh Army Information Assurance in Large-Scale Practice International Scientific NATO PfP/PWP.
Chapter 6 of the Executive Guide manual Technology.
ITEC 275 Computer Networks – Switching, Routing, and WANs Week 12 Chapter 14 Robert D’Andrea Some slides provide by Priscilla Oppenheimer and used with.
Web Security for Network and System Administrators1 Chapter 2 Security Processes.
University of Palestine Faculty of Applied Engineering and Urban Planning Software Engineering Department Prepared By Ahmed Obaid Wassim Salem Supervised.
Monitoring Windows Server 2012
ITIL QUESTIONS 1 Which of the following is a Service Desk Activity ?
Clarity Today – Confidence Tomorrow IT Certification Skills Clarity Today – Confidence Tomorrow switchboard:
Transforming Business People into Testers and Test Managers – How? Paul Gerrard Aqastra Limited PO Box 347 Maidenhead Berkshire SL6 2RD Tel:
February 2008 Gemini Incident Overview. Agenda Focus this part of the presentation is on the system elements of last year’s Gemini incident :-  Briefly.
Software Testing and Software Quality Assurance Process.
Vendor Management from a Vendor’s Perspective. Agenda Regulatory Updates and Trends Examiner Trends Technology and Solution Trends Common Issues and Misconceptions.
LOGO TESTING Team 8: 1.Nguyễn Hoàng Khánh 2.Dương Quốc Việt 3.Trang Thế Vinh.
1 I.U. Professional Opportunities Orientation Program Kristin Gaines Manager, Global Financial Support & Services.
SEN 460 Software Quality Assurance. Bahria University Karachi Campus Waseem Akhtar Mufti B.E(C.S.E) UIT, M.S(S.E) AAU Denmark Assistant Professor Department.
“The Role of Experience in Software Testing Practice” A Review of the Article by Armin Beer and Rudolf Ramler By Jason Gero COMP 587 Prof. Lingard Spring.
1 Sean Aluoto Anthony Keeley Eric Werner. 2 Project Plan Overview Project Lifecycle model Time line Deliverables Organization plan Risk management Design.
© CGI Group Inc. PrimePortal & #define Annika Maltesson, Project Krister Sundkvist,
What Project Managers Need to Know About Cloud Computing Stacy Taylor President, Red Mountain Services
ITEC 275 Computer Networks – Switching, Routing, and WANs Week 12 Chapter 14 Robert D’Andrea Some slides provide by Priscilla Oppenheimer and used with.
Difference between External and Internal Server Monitoring.
A Brief intro to Project Management What can it do for you
Understanding the New PTC System Monitor (PSM/Dynatrace) Application’s Capabilities and Advanced Usage Stephen Vaillancourt PTC Technical Support –Technical.
Optimizing the Approach
Test Roles and Independence of Testing
The evolution of monitoring services : RNP Case
Senior Team Briefing Implementing 360 Degree Feedback.
BUILDING A PRIVACY AND SECURITY PROGRAM FOR YOUR NON-PROFIT
TOLL FREE The Firefox Developer Edition Tech Support Toll Free.
Garmin Software Update Support Call for
Unit 27: Network Operating Systems
Web Site Project Management
How To Land Your Dream Job in Cyber Security
Intelligent Assurance and Testing
Internal Audit Who? What? When? How? Why? In brief . . .
Presentation transcript:

Post-Deployment Monitoring Is it part of Test? Paul Gerrard Technical Director, Systeme Evolutif Systeme Evolutif Limited 9 Cavendish Place London W1G 0QD, UK Tel: +44 (0)20 7636 6060 email: paulg@evolutif.co.uk http://www.evolutif.co.uk/

Paul Gerrard Paul is the Technical Director and a principal consultant for Systeme Evolutif. He has conducted consultancy and training assignments in all aspects of project assurance, software process improvement and testing. Previously, he has worked as a developer, designer, project manager and consultant for small and large developments. Paul has engineering degrees from the Universities of Oxford and London, is Web secretary for the BCS SIG in Software Testing, contributed to BS 7925-1 and BS7925-2, host of the Test Management Forum and Founder Chair of the ISEB Software Testing Certification Board which has been taken by nearly 20,000 candidates. He is a regular keynote speaker at both development and testing seminars and conferences in Europe, US and Australia, and won the "Best Presentation" award at EuroSTAR ’95 and "Best Presentation of 2002" award for the BCS SIGIST. Paul devised the term Project Intelligence for an innovative approach to results-based management supported by the disciplines of software testing. He is Women’s coach for Maidenhead Rowing Club and webmaster and ISP administrator for several websites including www.evolutif.co.uk. (IN PACK BUT TO REMOVE FROM DISPLAY VERSION)

What is Post-Deployment Monitoring? After deployment, systems need to be monitored, like any production process ‘User Point of View’ Extranet – visible to the outside world Intranet – visible to internal users “Customer Perception” ‘Infrastructure Point of View’ Technically oriented measurement of availability, resource usage, queue length etc. The “Vital Signs”

What can be monitored – user view Functionality Response times Availability Usability/Accessibility Security Etc etc. In fact, most of the non-functional aspects can be monitored from a ‘users’ point of view Tools and external services widely available.

What can be monitored – infrastructure view System and network resources 100s of attributes can be monitored Cpu, memory, page faulting, io, queue length etc. Network latency, bandwidth, availability Etc. etc. Production support have had tools to monitor, log, raise alerts, do event monitoring for years Not usually focused on the users experience, though.

Who does the monitoring? Testers, having a more user-oriented view, believe they could monitor the user experience, if asked Production/Support team, having long experience (and tools to manage the process) are already responsible What should the testers’ role be?

Arguments against testers Testing only superficially related to production monitoring Some shared tools for observing and measuring But production monitoring goes so much further Includes outage detection, event management, call management, capacity planning, etc. Post-deployment monitoring does not fit into test Production support monitor and FIX problems Testers should stick to the phase where they can add value – pre-deployment.

Arguments for testers? Who monitors outsourced hosted systems? Hosting company will monitor infrastructure But might not spot user outages Hosting company are internally focused, not independent Should ‘independent’ testers having some domain knowledge, experience of tools specify remote monitoring? Done by a 3rd party? Done by client’s IT people?

Why monitor? Monitoring is partly to detect failures But it is really focused on change: Changes to infrastructure disturbs performance, availability, resilience, security Changes in user behaviour cause peaks in load Growth in volumes load systems and slow them progressively as resources are over stretched Skill of hackers increases risk of security vulnerabilities Changes to functionality or design disturbs functionality, usability, accessibility, security (but shouldn’t it have been detected earlier?) Some caused by projects (testers already involved) Some caused by the passage of time.

In summary… Testers come to monitoring from their point of view – is it really a testing issue? If independent monitoring is required, should testers be involved? Is monitoring really the same as regression testing? Are testers involved because customers haven’t planned it right and have no one else to consult? What is the role of testers in monitoring?