1. A Discerning Approach to 3rd Party Testing Overview of 3rd Party Testing, including latest Symantec Endpoint Protection Results from the Tolly Group
September 2008

2. Agenda Demystifying 3rd Party Testing 1 2
The Tolly Group: Impact on Office Productivity 2
This is a sample “Agenda/Preview” slide. This slide is ideal for “setting the scene” at the beginning of your presentation by providing a “big picture” overview of what you plan to cover.
To Change Slide Title:
In Normal View (View > Normal), triple click on the title placeholder to select the title text and begin typing desired text.
To Change Titles in Shapes (i.e.: “Text here”):
Place cursor on top of text in Shape and triple click to select text. Begin typing desired text.
To Change Font Color/Size:
Place cursor on top of text and triple click to select it. right-click and select “Font” from the drop-down menu. Select desired attributes to change font, size, boldness, color, etc. Note: many of the same commands can also be accessed from the “Font" group of the “Home” tab or from the “Mini” toolbar that appears when text is selected.
To Change a Shape’s Fill Color:
double-click along edge of Shape to activate the “Drawing Tools Format” tab. Click the “Shape Fill” button within the “Shape Styles” group to select a color or desired effect. To choose a custom color, click on the “More Fill Colors” option. Choose “Picture,” “Gradient” or “Texture” to set a gradient, texture, pattern and/or picture fill.
To Delete a Shape:
Select the edge of the desired object by clicking once. Press the “Delete” key from your computer keypad.
To Copy a Shape:
Select the edge of the desired object by clicking once (making certain the selection border appears around the object to be copied). Type “Ctrl C” (copy), click outside object, then type “Ctrl V” (paste) to place the object. Click and drag the pasted object to desired location.
Reviewing the Checklist 3
Q&A 4

3. The Big Question: Who performed the test?
Do they have a testing Charta?
Who paid for the test?
Notify competitors about the test?
Detailed test methodology description?
Example: Network Testing Labs
No website
Don’t mention who paid for the test
Misleading “World Class Award”

4. Is the setup fair?
Example: McAfee commissioned Tolly report in June 2008

5. Shouldn’t they detect 100% of their own samples?
Pay Attention to the details:
McAfee confirmed that the malware samples used in this test were actual samples submitted to McAfee researchers.
Shouldn’t they detect 100% of their own samples?

6. Is the test relevant?
Example: McAfee commissioned Tolly report, June 2008

7. Who cares about the speed of scanning malware?
Relevant details:
McAfee’s Total Protection for Endpoint anti-malware solution processed 86 malware files per minute under extreme conditions where malware files were constantly copied onto the system.
Who cares about the speed of scanning malware?

8. Consider what they don’t say
Example: Sophos commissioned Cascadia Labs Report, 2007

9. AV-Comparatives: False Positives
~400
Contact Carsten Hoffmann
Created August 2008
Source
Classification Internal Only (might change check source for updates)
Check source for updates 5 2 2
Source: AV-Comparatives – Anti-Virus Comparative No. 18, Page 7 (05/2008)

10. Other favorite tactics
Didn’t get any positive reviews lately?
Use old data!
Nobody will read the footnote stating that it is from 2005
Don’t have money for a third party review?
Create some charts from AV-Comparatives, VB100 and AV-Test!
They perform tons of tests and everybody is good at something
Nobody will read the full 20 page report and find all the negative things
Failed a test like Virus Bulletin?
Say it is irrelevant!
No test is perfect so we will always find something negative to say

11. Latest Symantec Endpoint Protection 3rd Party Test
Highlight Symantec’s strengths vs. McAfee
Less impact on typical office usage
Faster open and save time for Word and PowerPoint
The Test
Symantec Endpoint Protection11.0 vs. McAfee Total Protection for Endpoint bundle
Measure time to open and save 5MB Microsoft Word file
Measure time to open and save 20MB Microsoft PowerPoint file
The Result
Symantec wins the test
Results are interesting!

12. Productivity Impact Microsoft Office 2007/Vista File “Open” Times
(Increase Over Unprotected System)
Time (seconds)
Contact Carsten Hoffmann
Created August 2008
Source
Classification External
The Tolly Group tested the performance impact of Symantec Endpoint Protection and McAfee Total Protection for Endpoint.
Tolly Group tests show that Microsoft Word was able to open a 5MB document in 2.7 seconds on a system with Symantec Endpoint Protection 11.0 installed, requiring only 0.20 seconds longer than the baseline system. On a system with McAfee Total Protection for Endpoint installed, the same operation took 4.2 seconds. Microsoft Word opened the file on the baseline OS in 2.5 seconds.
Testing also included measuring the time to open a 20MB Microsoft Power Point document. On the base line system it took 3.8 seconds to open the 20MB presentation. Symantec added only 0.7 seconds to the operation. The system with McAfee installed took, 5.1 seconds to open the PowerPoint document, demonstrating that McAfee’s impact was 48% higher than Symantec’s
Source: The Tolly Group – Symantec Endpoint Protection vs. McAfee Total Protection for Endpoint Page 1 (08/2008)

13. Productivity Impact
Microsoft Office 2007/Vista File “Save/Close” Times
(Increase Over Unprotected System)
Time (seconds)
Contact Carsten Hoffmann
Created August 2008
Source
Classification External
Tolly Group engineers measured the amount of time required to save and close a modified 5MB word file. The system with the Symantec client took only 1.2 seconds longer than the baseline system. The system with McAfee installed required 0.5 seconds longer than Symantec and 1.7 seconds longer than the baseline OS. This same test was conducted for a 20MB Microsoft Power Point document. Powerpoint saved the presentation in 10.7 seconds on a system protected by Symantec, compared to 11.3 seconds on a system protected by McAfee. The McAfee products added 1.9 seconds to this operation.
Source: The Tolly Group – Symantec Endpoint Protection vs. McAfee Total Protection for Endpoint Page 1 (08/2008)

14. Remember: The Checklist
Who performed the test?
The Tolly Group
Is the test fair?
Yes!! We used default settings, identical hardware and did not provide the test data.
Is the test relevant?
Yes – Everyone works with Microsoft Office
Is there something that you don’t say?
The charts show the impact not the actual time
Opening word files is relevant: 2.7 seconds vs. 4.2 seconds
Saving PowerPoint files less: vs. 11.3

15. SEP 11.0 Maintenance Release 3 (MR3) enhancements15 15

16. Symantec Endpoint Protection MR3
Improved Client Performance
Significant Boot Time improvement
Reduced Virtual Memory
Reduced Application Load time
Improved Management Server Performance
Reduction in resources with new delta creation process
Smaller incremental virus definitions
Improved Reporting Management
Additional information added and easier to read 16 16

17. Symantec Endpoint Protection MR3
IIS Custom website now utilized
More secure
Avoid Conflicts
Virtualization Support
Randomize Client connections to SEPM for obtaining Content Updates
Scalability Controls
Group Update Provide modifications
Other
SNAC trialware now included!
Available on FileConnect today: 17 17

18. Resources
For more information on Symantec Endpoint Protection and the Tolly Report, please visit the Symantec Endpoint Security Website: familyid=endpointsecurity 18

20. &
QUESTIONS
ANSWERS 20 20 20