1 aba.com BANKERS Best Practices: Effective Release Management April Faulk, Senior Director of Elearning Technology Anna Phipps, Senior Director of Customer Support

2 aba.com BANKERS About the Founded in 1875, the American Bankers Association is a membership organization serving banks of all sizes and charters. Professional Development Group Training and education programs to “help improve the performance of banks by improving the performance of bankers.”  Conferences  Schools  Telephone Briefings  Online Training  Diplomas and Certificates (AIB)  Certification (ICB)  Custom In-Bank Training

3 aba.com BANKERS Training Business ABA Extended Enterprise Hundreds of Learning Objects/ Multiple Learning Object formats (Curricula, Online Classes, ILT, Postings) Nearly 4,000 Organizations in our Extended Enterprise 3,500+ client administrators using proxy enrollment & reporting High volume – e.g. 489,359 enrollments in January ,000+ students taking classes that include static, rich, audio, video, and social learning Using desktops, laptops, iPads

4 aba.com BANKERS Business Challenge: Seeking the Best of Both Worlds 4 releases every year New feature roll out Testing Training Support Stability Regressed issues Unexpected visibilities Unprepared administrators

5 aba.com BANKERS Solution: Release Management Tools Successful SaaS is about Successful Partnership Our Vendor provides: Release calendar Test environment Overviews Release Matrix UAT Period Checkpoints/ Discussions Does your vendor provide similar things?

6 aba.com BANKERS

7 ABA Release Management Release Team Communications Kick off Meeting Scheduling/Reminders Release Testing Test Scripts Issue Escalation Go Live Change Management

8 aba.com BANKERS Kick Off Call Test Scripts Review Kick Off Call Test Scripts Review Feature Reviews Full Testing and Test Item Processing Feature Reviews Full Testing and Test Item Processing Announcements Deploy Training Materials Announcements Deploy Training Materials ABA Release Process

9 aba.com BANKERS Release Resources Testing Environments People—Release Team Extended Technologies (Test Scripts, Automation Tools?, Outlook) File Samples Test Scripts Test Plan Kickoff templates and Process Checklists TIME

10 aba.com BANKERS Release Team Tech Services Business Stakeholders Everyone in your organization who runs a business on your LMS How are they involved? Feature release preview Test Script Development Testing Issue Reporting Solid Release Management Commu nication Test Scripts Testers

11 aba.com BANKERS Communications Outlook Appointments & Reminders Release Matrix Testing Statuses Touch points Release Kick Off Call High Impact Features & Communication Strategies

12 aba.com BANKERS Test Scripts Test scripts Sharepoint Task Manager

13 aba.com BANKERS How to Develop Test Scripts List Every Security Role (Student, Instructor, Sys Admin, Domain Admin, Social Admin, Test Admin) Identify Test Accounts—Use the REAL IDs in staging Start with Most Common Tasks User can log in Admin can create a user Admin can enroll a student Content can launch Connect posting can be created EVERYONE contributes: Collaborate to Expand Augment with Each Release Trouble Spots New Features

14 aba.com BANKERS For Example: ID User Types 1. Student User Self-Paced 2. Student User with Social 3. Domain Administrator 4. AIB Instructor 5. System Administrator 6. Test Administrator

15 aba.com BANKERS For Example: Find a Real Account 1. Student User Self-Paced: Karen Burns 2. Student User with Social: John Davis 3. Domain Administrator: Jackie Catalano 4. AIB Instructor: Robert Krulevitz 5. System Administrator: Myself 6. Test Administrator: Sydney Henderson

16 aba.com BANKERS For Example: Top 10 Things They Do Student User Self-Paced 1.Login 2.Reset Password 3.Password Recover 4.Navigate to Learning 5.Launch Content 6.Content Completes 7.Content Bookmarks 8.Take a test and fail 9.Take a test and pass (score updates) 10.Review module details

17 aba.com BANKERS Go Live Ghost Testing Webex when applicable Publication of Training/Support materials Announcements

18 aba.com BANKERS Best Practices: BEFORE UAT Update your test environment data New Feature Mapping Who & What? DON’T RUSH IT Block Out the Time Test Script Development New & Old ALL Stakeholders: Contribute, Prioritize and Test P1s in Week 1 Assign the Tasks

19 aba.com BANKERS Best Practices: DURING UAT Use Your Test Scripts Leverage prioritization Advanced filtering Test Early, Test Often Augment the Test Scripts Send Out Status Reports Announce Big Changes Participate in Tech Support Calls Leverage Escalation Channels Plan for Change Management Existing Features New Features

20 aba.com BANKERS Best Practices: AFTER GO LIVE Proactively Communicate around Known Issues Remind about Training Materials Roll Out New Features Quickly

21 aba.com BANKERS Best Practices: Change Management 1. Meet with Stakeholders 2. Generate Buy-In 3. Demonstrate & Test 4. Train Stakeholders 5. Test and Pilot 6. Discuss the Outcomes 7. Recognize Each Win/ Deal with Issues Quickly 8. Develop Your Communication Strategy ( s, documentation, webex, login message, postings)

22 aba.com BANKERS Where you can begin… 1. Identify your Test Team 2. Determine what software to use for tracking test scripts 3. Brainstorm test scripts 4. Review each other’s test scripts 5. Meet and Set Your Release Timelines Script Development Kick Off Discussions Determine Communication Plans/Needs