1. www.rbsmarkets.com optional client logo www.rbsmarkets.com FINANCIAL MARKETS 00 MONTH 2004 Project: Operational Testing Strategy Author: Johan Lundin

2. 21 Feb, 2008 FINANCIAL MARKETS Johan Lundin 2 years at RBS Credit Trading Support Automated testing Performance / Load / Functional 2 years at RBS Credit Risk Useful fact: Has been leading a team of Arctic Rangers in the Swedish special forces

3. 21 Feb, 2008 FINANCIAL MARKETS Ann McElroy 5 years at RBS Credit Trading Support Head of QA team Support Alexandria Suite Support Centralised Pricing Support Spreadsheets Useful fact: Currently building her dream house in Ireland

4. 21 Feb, 2008 FINANCIAL MARKETS Agenda The Testing Problem Strategy Tactical Implementation Recruitment Future

5. 21 Feb, 2008 FINANCIAL MARKETS The Testing Problem Time 2 weeks release cycle 20 10 5 1 Manual testers required 2 days test time ICE Alexandria Regression test effort

6. 21 Feb, 2008 FINANCIAL MARKETS Strategic Goal At least 10 times the testing capacity Regression test in the same time frame Same budget

7. 21 Feb, 2008 FINANCIAL MARKETS Strategic Solution Leverage India Cost 1 : 3 Automate Speed 1 : 5 Scale Scalability 1 : 20+

8. 21 Feb, 2008 FINANCIAL MARKETS India – Tactical Implementation Two week iterations Flexibility to replan PL / BA (Ann)Tech lead (Johan) London PL (Tarun)Tech lead (Bipan) India Test developer Manual tester Phone meeting twice a week Status updates Social lubrication

9. 21 Feb, 2008 FINANCIAL MARKETS Automation – Tactical Implementation Using RBS standard (HP Quick Test Pro) Component based user action library 10 new tests delivered per week 250 tests run per release 30 min to do a test manually Automated tests 5x manual test execution speed Automation enables scalability

10. 21 Feb, 2008 FINANCIAL MARKETS Scalable – Tactical Implementation Grid Architecture Virtual Desktops as Grid Engines Engine Broker

11. 21 Feb, 2008 FINANCIAL MARKETS Manual Testing Bulk and batch jobs New functionality not yet automated

12. 21 Feb, 2008 FINANCIAL MARKETS Recruitment Hire developers and teach them to test Use technologies that developers like and learn from Critical mass of people to enable training Knowledge sharing

13. 21 Feb, 2008 FINANCIAL MARKETS Future Organic knowledge transfer AprilMayJun ICE Phase 2 Glacier Phase 2 NPP Exotics 2008