1. Town Hall briefing to the AMTSO membership
Standards and Operational Pilot Update
November 7, 2017
Town Hall briefing to the AMTSO membership

2. Town Hall Meeting Agenda
Introducing Our Members Web Site
Reminder : Contact List Registration
Operational Pilot Updates
Test Plan Templates and Usage Guidelines
Voluntary and Involuntary Attestations
Compliance Confirmation
Revised Standards (Draft 6) Information
Remaining Areas of Confusion
Your Questions Heading to Beijing

3. AMTSO Documentation and Artifacts
AMTSO Members Web Site

5. Operational Pilot Updates
AMTSO Operational Pilot (May 2017-November 2017)
Operational Pilot Updates

6. Test Plan Templates Multiple Test Plan Creation Tools Tested
Word Edition (Produces DOC/PDF Files)
On-Line Edition (Produces CSV Files)
6 Test Plans Built During Operational Pilot
AV-Comparatives (3 Test Plans, 3 Tests)
Mac, Mobile, Business
SE Labs (1 Test Plan, 3 Tests)
Endpoint (Consumer, SMB, Enterprise)
SKD Labs (1 Test Plan, 1 Test)
Endpoint (Consumer, China Market)
AppEsteem/AV-C (1 Test Plan, Commissioned)
Deceptor Test

7. Test Plan Structure Introduction Scope Methodology Participation
Environment
Schedule
Control Procedures
Dependencies
Scoring Process
Dispute Process
Tester Attestations
On-Line Change Submission Process

8. Voluntary / Involuntary Feedback
Different Presentations Required
< 2 Minutes for Voluntary Participants
Meets the Posting Feedback Requirements

9. Compliance Confirmation
~50 Checklist Items
Compares all Test Artifacts against Standard
Relaxed requirements for publishing links
Operational Pilot Confirmed Compliant Tests
AV-Comparatives 2017 Mac Security Review
SE Labs Q Endpoint Security Test
AV-Comparatives 2017 Mobile Security Review

10. One-Page Test Review Summary
Test Plan
At-a-Glance Feedback
Click-Through Interface to Drill-Down for Detailed Feedback
Tester Report Links
Compliance Report

11. AMTSO Testing Standards and Change Control
Revised Draft 6

12. Standards Draft 6 Open Comment Period through November 15th
Detailed Change Logs Available on Web Site
Change Process Followed with SWG
Key Updates
Section – Added definition of Fair, based on outcome of SWG
Section 7.3 – Added requirement for “fairness” (aka common courtesy) in tester/vendor communications
Section – Added informative reference for clarity
Section – Updated language and added informative reference for clarity
Section – Moved example out into informative reference and expanded for clarity

13. Clarifying Areas of Confusion
AMTSO Questions and Answers
Clarifying Areas of Confusion

14. Voluntary and Involuntary
All participants are initially Involuntary
Must opt-in to a test to be Voluntary
Voluntary Participant : A Participant who has chosen to cooperate with the Tester on the Test in the manner designated in the Test Plan, and has complied with the Voluntary Participant requirements set forth in Section 7 of the Standards.
A Voluntary Participant may cease complying with the requirements at any time and become Involuntary once again.

15. Process Too “Heavyweight”
Required < 2 Man-Days Tester Time
Voluntary Attestations < 2 Minutes Per Test
Compliance Review and Report < 1 Man-Day
Continue to Automate Mailings and Workflow post-Pilot Phase

16. Your Questions Heading to Beijing