ODFAutoTests Jos van den Oever

Standards, tests, code ODF

Plugfests: manual comparison

Tests in office suites load / save layout Calligra some unit tests cstester LibreOffice / OpenOffice convwatch, lenient-pdf-compare WebODF Abiword cyclone3, officeotron

Tests in web browsers: ACID

Box Acid Test (Acid1) 1998 Todd Fahrner CSS 1

Acid2 April 2005 Ian Hickson CSS 2.1 HTML PNG Safari passed in October 2005 Opera, Konqueror, Firefox followed soon In 2009, Internet Explorer 8 passed

Acid3 March 2008 Ian Hickson DOM JavaScript SVG Embedded fonts In 2010, WebKit and Firefox pass In 2012, Internet Explorer 10 passed Mobile browsers mostly pass

Acid tests for ODF HTML is read-only, ODF is read / write ODF has no standardized scripting language HTML has no competition, ODF has OOXML ODF is usually not a text file, but a zip file

ODFAutoTests http://gitorious.org/odfautotests Easy to: write tests automatically run tests in different suites to evaluate results automatically

What it can test Loading of file not crashing or hanging Saving a file creating valid ODF storing valuable content Printing (more precisely: creating a PDF) drawing the content correctly

Writing tests Input: XML file with suite configuration XML file with tests Fragment of ODF Description of result: XPath or mask Output: HTML and XML with test results PDF and PNG with renderings

Load/save example

Load/save example 2

Problems with layout testing differences in installed fonts installed languages (hyphenation) differences in rendering of fonts differences in anti-aliasing

Layout example: two columns + = pdf of odt svg mask should be white + =

Getting started git clone https://git.gitorious.org/odfautotests/odfautotests.git cd odfautotests ant java -jar odfautotests.jar config.xml tests.xml This gives you: report.xml report.html

ODFAutoTests http://gitorious.org/odfautotests Easy to: write tests automatically run tests in different suites to evaluate results automatically