1. OWASP Application Security Verification Standard
– Web Application Edition
Mike Boberski (Booz Allen Hamilton)
Jeff Williams (Aspect Security)
Dave Wichers (Aspect Security)
12/08

2. The Challenges…
There is a huge range in the coverage and level of rigor available in the application security verification market!
Consumers have no way to tell the difference between someone just running a grep tool, and someone doing painstaking code review and manual testing.

3. The Philosophy of ASVS
Any standard that provides a basis for the verification of web applications should be application-independent.
Any such standard should be life-cycle model independent.
Any such standard should define requirements that can be applied across applications without special interpretation.

4. The Design of ASVS
The standard should define levels of application security verification.
The difference in coverage and level of rigor between levels should be relatively linear.
The standard should define functional verification requirements that take a white-list (i.e. positive) approach.

5. An Overview of ASVS
“Verification Levels” section
“Detailed Verification Requirements” section
“Verification Reporting Requirements” section

6. What questions does ASVS answer?
How do I know how much trust can be placed in a web application or web service?
How do I know what features to build into security controls used by a web application or web service?
How do I acquire a web application or web service that is verified to have a certain range in coverage and level of rigor? ? ?

7. How is the ASVS intended to be used?
It can be used to provide a yardstick with which to assess the degree of trust that can be placed in their web applications and services,
It can be used to provide guidance to security control developers as to what to build into their commercial products in order to satisfy web application and service security requirements, and
It can be used to provide a basis for specifying web application and web service security requirements in contracts.   

8. What is the status of the ASVS as an OWASP standard?
The Web Application Edition of ASVS is the first OWASP standard. Its current official release version is Beta.
A Web Service Edition of ASVS is under development and not yet available for release.
Future Editions of ASVS are planned both for additional languages (it is currently available in English) and for future technologies (perhaps for example, a Cloud Computing Edition)

9. Project Plan and Status
12/8/ OWASP ASVS Final assistance required! Please join the mailing list for more information and assignments.
12/5/ OWASP ASVS exits the Summer of Code 2008! The Beta draft of the Web Application Edition is released! Mike Boberski, Jeff Williams, and Dave Wichers are the primary authors.
10/3/ OWASP ASVS Alpha draft is released! Mike Boberski is the primary author.
4/16/ OWASP ASVS Summer of Code 2008 proposal submitted by Mike Boberski wins!

10. Details: What are ASVS verification levels?

11. Earning a level…

12. Level 1 – Automated Verification
Level Definitions
Level 1 – Automated Verification
Level 1A – Dynamic Scan (Partial Automated Verification)
Level 1B – Source Code Scan (Partial Automated Verification)
Level 2 – Manual Verification
Level 2A – Penetration Test (Partial Manual Verification)
Level 2B – Code Review (Partial Manual Verification)
Level 3 – Design Verification
Level 4 – Internal Verification

13. Breadth – Number of Requirements
Coverage
Depth – Level of Rigor
No malicious developers
The design has to be right
The controls have to be right
Scan 
Breadth – Number of Requirements   

14. Level 1 in more detail
Automated verification of a web application treated as groups of components within single monolithic entity.

15. Application Security Verification Techniques
Find Vulnerabilities
Using the Running Application
Find Vulnerabilities
Using the Source Code
Manual Application Penetration Testing
Manual Security Code Review
Automated Application Vulnerability Scanning
Automated Static Code Analysis

16. Tools – At Best 45%
MITRE found that all application security tool vendors’ claims put together cover only 45% of the known vulnerability types (695)
They found very little overlap between tools, so to get 45% you need them all (assuming their claims are true)

17. Level 2 in more detail
Manual verification of a web application organized into a high-level architecture.

18. Manual Penetration Test Level 2B Manual Code Review
Level 2 Options
Level 2A
Manual Penetration Test
Level 2B
Manual Code Review
Need BOTH to achieve a full level 2
But requirements can be filled by either

19. Level 3 in more detail
Design verification of a web application organized into a high-level architecture.

20. Level 4 in more detail
Internal verification of a web application by searching for malicious code (not malware) and examining how security controls work.

21. What are ASVS verification requirements?
Security architecture verification requirements
Security control verification requirements 
Security architecture information puts verification results into context and helps testers and reviewers to determine if the verification was accurate and complete

22. A positive approach Negative Positive
The tester shall search for XSS holes
Positive
Verify that the application performs input validation and output encoding on all user input

23. Requirement Summary Security Area Level 1A 1B 2A 2B Level 3 Level 4
V1 – Security Architecture Verification Requirements 1 2 4 5
V2 – Authentication Verification Requirements 3 9 13 14
V3 – Session Management Verification Requirements 6 7 8
V4 – Access Control Verification Requirements 12 15
V5 – Input Validation Verification Requirements
V6 – Output Encoding/Escaping Verification Requirements 10
V7 – Cryptography Verification Requirements
V8 – Error Handling and Logging Verification Requirements
V9 – Data Protection Verification Requirements
V10 – Communication Security Verification Requirements
V11 – HTTP Security Verification Requirements
V12 – Security Configuration Verification Requirements
V13 – Malicious Code Search Verification Requirements
V14 – Internal Security Verification Requirements
Totals 22 51 83 96
112

24. What are ASVS reporting requirements?
R1 – Report Introduction
R2 – Application/Service Description
R3 – Application/Service Security Architecture
R4 – Verification Results 
Is the report sufficiently detailed to make verification repeatable?
Does the report have sufficient types of information to allow a reviewer to determine if the verification was accurate and complete? 

25. You can download a copy from the ASVS Project page:
Where do I go from here?
You can download a copy from the ASVS Project page:
You can send comments and suggestions for improvement using the project mailing list:
See “Mailing List/Subscribe” link on project web page.

26. Where can I find help getting started using ASVS?
You can find information to help you get started using ASVS in two locations:
Section “Some Guidance on the Verification Process” in ASVS
There are articles at the bottom of the ASVS Project Page:

27. Questions? ?