1. Augmenting the Generalized Hough Transform to Enable the Mining of Petroglyphs Qiang Zhu, Xiaoyue Wang, Eamonn Keogh, 1 Sang-Hee Lee Dept. Of Computer Science & Eng., 1 Dept. of Anthropology University of California, Riverside

2. Outline  Motivation  Approach  Evaluation  Conclusion

3. Motivation(1)-applications Petroglyphs are one of the earliest expressions of abstract thinking. Providing a rich source of information:  climate change  existence of a certain species  patterns of human’s migrations and interactions

4. Motivation(2)-difficulties Progress in petroglyph research has been frustratingly slow.  due to their extraordinarily diverse and complex structure  most matching algorithms can not capture the similarity of petroglyphs  for those that can, even in limited cases, do not scale to large collections

5. Approach How to preprocess the raw data? How to define the distance measure? How to speed up?

6. Preprocessing(1) With rare exceptions, petroglyphs do not lend themselves to automatic extraction with segmentation algorithms. The border of this rock may be recognized as the edge of this petroglyph

7. PetroAnnotator Load the raw image into our human computation tool

8. PetroAnnotator (cont.) Draw an approximate boundary around object, and then trace the shape

9. Preprocessing(2)-downsampling A (A)Two overlaid skeleton traces (340 by 250) of the same image of a Bighorn sheep. Less than 3.5% of the pixels from each image overlap. (B) The same two images after downsampling (30 by 23). 75.6% of the pixels (denoted by black) are common to both.

10. Distance Measure-why GHT ? essentially makes no assumption about the data  open/closed boundaries  connected/disconnected shapes correctly captures the similarity  subjective/objective similarity on unlabeled/labeled datasets tightly lower bound the distance  allowing for very efficient searches in large datasets

11. Classic GHT GHT is a useful method for two dimensional arbitrary shape detection. QC

12. (1) Find the “star-pattern” R R

13. (2) Superimpose & Accumulate 01000 00000 11100 00000 A C 01100 00000 12210 00000 01110 00000 12321 00000 01110 00100 12321 01110

14. (3) Find the “peak” C Q R R’ 01110 00100 12321 01110 A

15. A Basic Distance Measure Classic GHT doesn’t explicitly encode a similarity measure We can simply define a GHT-based distance: minimal unmatched edge points (MUE) = number of edge points in Q – maximal matched edge points = 4 – 3 = 1 (for our toy example)

16. A New Cell Incrementation Strategy When can we obtain the value of a particular cell in the accumulator?  In the classic GHT, until the end of all incrementation  Is it possible to obtain the value one by one?  Need to check all positions that are possible to increase the cell value QC ?

17. Lower Bound 22422 In this column Q needs 2 pixels in C, and has 3 In this column Q needs 2 pixels in C, and has 2 In this column Q needs 4 pixels in C, and has only 2 In this column Q needs 2 pixels in C, and has 2 In this column Q needs 2 pixels in C, and has 3 QC 22422 SigQx = 00322230000 SigCx = ? 0 Minimal missed points: + 0+ 2+ 0 = 2 ? ? ? ? ? ? ? ?

18. Time Complexity Classic GHT  O(N Q ×N C +S 2 )  superimpose all query vectors to all edge points in the candidate image Lower bound GHT  O(S 2 )  compare one-dimensional signatures  further reduced by early abandon and shifting order  one to two orders of magnitude speed-up

19. Variants on the Basic Distance Measure Query-by-Content: Clustering: Finding Motifs:

20. Evaluation We performed three sets of experiments ：  Evaluation of Utility -on unlabeled data  Evaluation of Accuracy -on labeled data  Evaluation of Scalability -on synthetic data

21. Evaluation of Utility (1) Atlatls Anthropomorphs Bighorn Sheep (1)Our GHT-based distance measure correctly groups all seven pairs (2)The higher level structure of the dendrogram also correctly groups similar petroglyphs A clustering of typical Southwestern USA petroglyphs

22. Evaluation of Utility (2) abcd e f g h SC WY

24. Evaluation of Utility (3) Whether our distance measure can find meaningful motifs?  2,852 real petroglyphs  4,065,526 possible pairs  52 top motifs (0.00128%) by motif cutoff 050100150200 Motif Cutoff

25. Evaluation of Accuracy-datasets NicIcon dataset  24,441 images  14 categories  33 volunteers  234×234 pixels  WD/WI tests Farsi digits dataset  From 11,942 registration forms  60,000 digits for training  20,000 digits for testing  54×64 pixels (largest MBR) 0138249675

26. (1) Test the Downsampling Size 1020304050607080 0 10 20 30 Resolution (R×R) of Downsampled Images (NicIcon) Error Rate (%) 5 WI WD 5102030 2 4 8 12 16 Resolution (R×R) of Downsampled Images (Farsi) Error Rate (%) In both datasets, the error rate of one-nearest- neighbor test varies little once the resolution is greater than 10×10

27. (2) Competitive accuracy NicIcon dataset  Error rate for WD: 4.78%  8.46% for WI  The dataset creators tested on the online data using three classifiers.  Only one of them (DTWB) is better, however, slower Farsi digits dataset  Error rate: 4.54%  Borji et al. performed extensive empirical tests on this dataset  Of the twenty reported error rates, the mean was 8.69%  Only four beat our approach, but need to set at least six parameters

28. Evaluation of Scalability-datasets We made 8 synthetic petroglyph datasets  Based on 22 classic petroglyphs  Duplicated by 10 volunteers on a tablet  Applied a Random Polynomial Transformation  Containing up to 1,280,000 objects

29. (1) Querying by Content Leave-one-out one-nearest-neighbor test. Repeated the test for 10 times on each dataset. 10K 20K40K80K160K320K640K1280K 40 60 80 100 Size of Synthetic Petroglyphs Datasets Prune Rate (%) Max Prune Rate Avg Prune Rate Min Prune Rate 10K20K40K80K160K320K640K1280K 2 6 10 14 18 Size of Synthetic Petroglyphs Datasets % to Brute Force Time

30. (2) Finding Motifs  A brute force algorithm requires time quadratic in the size of dataset.  By using the triangular inequality of our distance measure, we only need to calculate a tiny fraction of the exact distance.  Even for the smallest dataset: -our algorithm is 712 times faster -we can prune 99.84% of the calculations 10K20K40K80K160K320K640K1280K 0 40000 80000 120000 Size of Synthetic Petroglyphs Datasets Speed Up (times)

31. Conclusion In this work we considered, for the first time, the problem of mining large collections of rock art.  Introduced a novel distance measure  Found an efficiently computable tight lower bound to this measure  Enabled mining large data archives effectively

32. Thanks for your listening ! All datasets and the code can be downloaded from: http://www.cs.ucr.edu/~qzhu/petro.html