is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts A Study of the Impact of Compression and Binary Encoding on SOAP Presented by: Alex Ng AWSA March 2005 Brisbane, Australia Alex Ng Department of Computing Macquarie University Paul Greenfield CSIRO ICT Centre Shiping Chen CSIRO ICT Centre

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Outline  Background  SOAP  Binary XML  XML Compression  Experimental design  Result discussion

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Background  SOAP Web Services has been very successful in platform-independent application  Performance Characteristics of SOAP  Typical SOAP message size is significantly larger than binary format  SOAP performance is affected by implementation and the choice of encoding style  SOAP itself is not processor intensive  Concerns:  The verbosity of text-based XML, processor and bandwidth requirements  The use of base64 encoding for binary data

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Some Approaches in Optimizing SOAP  SOAP Message Transmission Optimization Mechanism (MTOM)  Recent W3C standard  XML InfoSet, WS-Security & WS-* compatible  Streams binary data as MIME message  Uses XOP to selectively encode individual SOAP elements  Binary XML  W3C XML Binary Characterization WG  Sun Fast Web Services  XML Compression  Schema Based: XMill & Millau  Dictionary Based: gZip

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Research Questions 1.How effective is compression as a way of improving the performance of SOAP Web Services? 2.How effective are the proposals for binary encoding for XML likely to be improving the performance of SOAP Web Services?

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Experimental Design: Test Messages Message Type SimpleMediumComplex BaseOne Customer Record20 Customer Record 1 Customer Rec + 50 Product Details JPEG Simple + 14Kb JPEG image Medium + 14Kb Complex + 14Kb X.509 Signed Simple + X.509 Certificate & Digital Signature Medium + X.509 Certificate & Digital Signature Complex + X.509 Certificate & Digital Signature EncryptedSimple Encrypted + X.509 Cert. & Signature Medium Encrypted + X.509 Cert. & Signature Complex Encrypted + X.509 Cert. & Signature

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Test Environment Hardware: 3GHz, 1Gb memory, 100Mhz Ethernet, CeNTIE 1Gps WAN Software: W2003 Server Standard ASP.NET 1.1 Test Setup: SOAP: ASP.NET Doc/Lic Binary:.NET Remoting HTTP/Binary gZip: SharpZipLib.dll MTOM: translate our binary messages into MTOM format by hand

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Result: Message Size: Simple

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Message Size : Medium

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Message Size : Complex

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Latency

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Latency Summary (lightly loaded network)  SOAP performs as good as other binary- encoded alternatives in test messages with simple structure and small number of XML tags  SOAP is not far behind in other cases.  The number of XML tags and structures affect the performance of SOAP  The overhead of Base64 encoding is not significant (in latency)  Compression always slow in our situations

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Processor Time Per Request SimpleMediumComplex SOAP Client1.4ms3.2ms6.8ms SOAP Server1.3ms2.9ms6.1ms Compression Client 3.3ms8.5ms19.2ms Compression Server 3.3ms8.6ms18.5ms Remoting Client0.4ms1.3ms2.1ms Remoting Server 0.7ms1.8ms3.2ms Compression Time not high in absolute value

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts The Impacts of Compression : Simple & Medium SimplePredicted Latency (ms) BandwidthSOAPgZipRemoting 100Mbit/Sec Mbit/Sec Mbit/Sec Kbit/Sec MediumPredicted Latency (ms) BandwidthSOAPgZipRemoting 100Mbit/Sec Mbit/Sec Mbit/Sec Kbit/Sec

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts The Impacts of Compression : Complex ComplexPredicted Latency (ms) BandwidthSOAPgZipRemoting 100Mbit/Sec Mbit/Sec Mbit/Sec Kbit/Sec

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Conclusion  Both compression and binary encoding are effective at reducing message size  Compression works best with complex and repetitive structure  MTOM is effective with large binary attachment but not for message with small number of binary elements  due to the overheads of MIME and XOP elements  Compression appears to be useful for all  Exception: the least compressible messages and the fastest network

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Future Work  Refine our models of SOAP performance  Propose ways to improve the performance, scalability and effectiveness of SOAP

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts Related Work  Cokus & Winkowski (2002)  Emphasised on Wireless Application: WBXML, MPEG-7 & ASN.1 PER  Cai et. al (2002)  Compared gZip against XMill  Small message: gZip better than XMill,  Nair (2004)  Surveyed five different XML compression techniques: gZip, XMill, Xgrind, Xpress, and Xcomp

is supported by the Australian Government through the Advanced Networks Program (ANP) of the Department of Communications, Information Technology and the Arts References  Cokus, M. and Winkowski, D. XML Sizing and Compression Study For Military Wireless Data. In Proceedings of the XML  Cai, M., Ghanderizadeh, S., Schmidt, R., et al. A Comparison of Alternative Encoding Mechanisms for Web Services. In Proceedings of the DEXA  Nair, S.S. XML Compression Techniques: A Survey, (on-line) Accessed 23 September Compress.pdf