1. Computer vision and machine learning for archaeology The potential of machine learning and image analysis techniques for the domain of archaeology Drs. L. van der Maaten, Drs. P.J. Boon, Dr. A.G. Lange, Dr. H. Paijmans, Prof.dr. E.O. Postma Paul Boon p.boon@cs.unimaas.nl p.boon@cs.unimaas.nl http://www.referentiecollectie.nl/rich Institute for Knowledge and Agent Technology Maastricht University

2. Outline Introduction –Why & How –Computer vision and machine learning Examples –Historical glass, on-line reference collection –Modern coins Conclusion Future work

3. Why & How Need for on-line reference collections Making a collection digital is not enough Create tools for identifying artifacts –Vision and machine learning for finding ‘alike’ objects –Web technology for presentation and navigation Collection Artifact? Library

4. Computer vision and machine learning 186, gl_flu_4

5. Computer vision and machine learning 186, gl_flu_4 1.Object detection 2.Feature extraction 3.Classification

6. Computer vision and machine learning 186, gl_flu_4 Not a replacement, but a tool!

7. Example Historical glass Content based image retrieval Outer shape contours

8. Object detection

9. Shape context r θ θ r 0 0 0 0 0 0 0 0 1 1 2 2 2 2 3 3 6 6 4 4 Translation, scale and rotation invariant Histogram construction

10. Classification

17. Example Coins Automatic classification system, using texture information Modern coins, but in future early- medieval coins

18. Original

19. Object detection

20. Features

21. Conclusion You can successfully integrate computer vision and machine learning with an online collection

22. Future work Improve usefulness –Object detection –Evaluate technology Other types of material –Using outer shape and texture Partial shapes, from sherds? Evaluate typologies or device new ones?

23. Shape map

24. Acknowledgements We thank the Dutch Royal Coin Cabinet for providing the medieval coin dataset Arent Pol – specialist on early-medieval coins Institute for Knowledge and Agent Technology, Maastricht University Dutch National Service for Archaeological Heritage Jaap Kottman – glass specialist Netherlands Organization for Scientific Research