1. B2B STRATEGIES FOR COMPETITIVE ADVANTAGE © DGI 2001 www.drummondgroup.com Drummond Group, Inc. & ebXML Interoperability / Conformance Testing

2. © DGI 2001 www.drummondgroup.com Drummond Group We have been working with various standards and I/C testing for several years Currently conducting testing for IETF Interoperability over the Internet AS1 & AS2. Previously: X.400 and OBI

3. © DGI 2001 www.drummondgroup.com Sponsors Our method has been to find sponsors among the large standards organizations ebXML Testing Sponsors GCI (endorsed by WWRE) UCC*EAN OAG and STAR (Automotive) Possible relationships NIST This Committee

4. © DGI 2001 www.drummondgroup.com DGI Goal Facilitate market growth for a specification: Create a community of vendors by creating an non-competitive, neutral environment allowing a set of interoperable vendors to enter the market together Market a choice of products that are known to be interoperable and conformant to the standard

5. © DGI 2001 www.drummondgroup.com Interoperability The three main barriers to Interoperability are: Firewalls Proxies Certificates Once these are configured then a test plan can be implemented.

6. © DGI 2001 www.drummondgroup.com DGI Approach We approach Conformance & Interoperability a little differently Do not use a Reference Implementation, in the early phases Perform testing as a group Maintain a neutral, non-competitive environment Perform Full Matrix Testing Allow Debug during the testing

7. © DGI 2001 www.drummondgroup.com Interactive DGI takes an interactive approach to test plan development… Use Cases from Sponsors and Industry Representatives Test Participants Input

8. © DGI 2001 www.drummondgroup.com GCI, STAR, OAG, AIAG Testing Schedule – Sponsored by UCC Create First Test Plan by September Begin Testing in late September Test Conclude in January (1Q02) Timeframe

9. © DGI 2001 www.drummondgroup.com Relationship We see this as a win-win effort. The more working together the better. How do we bring OASIS in to the GCI, OAG, UCC and AIAG Conformance/Interoperability Test?

10. B2B STRATEGIES FOR COMPETITIVE ADVANTAGE © DGI 2001 www.drummondgroup.com Questions

11. © DGI 2001 www.drummondgroup.com Initial Test Set Use Cases Common Use Cases: 1. Send Data Set ==> Receive Data Set 2. Send Signed Data ==> Received/Verify Signed Data 3. Send Encrypted Data ==> Receive/Verify Encrypted Data 4. Send Signed/Encrypted Data ==> Receive/Verify Signed/Encrypted Data 5. Do tests 1-4 and include Unsigned/Signed Receipts 6. Do tests 1-5 with other data (XML, EDI, OAG-BOD, RNet-PIP, binary, etc.) 7. Do test 6 with messages containing multiple data sets/types in one message. 8. Validate basic CPA element handling (Retries, RetryInterval, SyncReply) 9. Validate Conversation parameters (ConversationID over multiple messages) 10. Send purposefully bad data/headers to validate Error Handling. 11. Validate Once-and-only-once (duplicate) handling. 12. Validate all of the above over three Transports (SMTP, HTTP, HTTPS)

12. © DGI 2001 www.drummondgroup.com Tests To Add Next Time: Multiple Hops (validate structure and handling of Via & TraceHeaderList) Validate XMLencryption Validate Registry Lookup functionality Validate Reliable Messaging Order Semantics System/Message Status Functionality (Ping, Pong, StatusRequest, StatusResponse)