1. ODFAutoTests
Jos van den Oever

2. Standards, tests, code
ODF

3. Plugfests: manual comparison

4. Tests in office suites load / save layout Calligra some unit tests
cstester
LibreOffice / OpenOffice
convwatch, lenient-pdf-compare
WebODF
Abiword
cyclone3, officeotron

5. Tests in web browsers: ACID

6. Box Acid Test (Acid1)
1998
Todd Fahrner
CSS 1

7. Acid2 April 2005 Ian Hickson CSS 2.1 HTML PNG
Safari passed in October 2005
Opera, Konqueror, Firefox followed soon
In 2009, Internet Explorer 8 passed

8. Acid3 March 2008 Ian Hickson DOM JavaScript SVG Embedded fonts
In 2010, WebKit and Firefox pass
In 2012, Internet Explorer 10 passed
Mobile browsers mostly pass

9. Acid tests for ODF HTML is read-only, ODF is read / write
ODF has no standardized scripting language
HTML has no competition, ODF has OOXML
ODF is usually not a text file, but a zip file

10. ODFAutoTests http://gitorious.org/odfautotests Easy to: write tests
automatically run tests in different suites
to evaluate results automatically

11. What it can test Loading of file not crashing or hanging Saving a file
creating valid ODF
storing valuable content
Printing (more precisely: creating a PDF)
drawing the content correctly

12. Writing tests Input: XML file with suite configuration
XML file with tests
Fragment of ODF
Description of result: XPath or mask
Output:
HTML and XML with test results
PDF and PNG with renderings

13. Load/save example

14. Load/save example 2

15. Problems with layout testing
differences in
installed fonts
installed languages (hyphenation)
differences in rendering of fonts
differences in anti-aliasing

16. Layout example: two columns+ =
pdf of odt
svg mask
should be white + =

17. Getting started
git clone
cd odfautotests
ant
java -jar odfautotests.jar config.xml tests.xml
This gives you:
report.xml
report.html

18. ODFAutoTests http://gitorious.org/odfautotests Easy to: write tests
automatically run tests in different suites
to evaluate results automatically