1. CS597D: Geometric Analysis of 3D Models Thomas Funkhouser Princeton University CS597D, Fall 2003 Thomas Funkhouser Princeton University CS597D, Fall 2003

2. Introduction On-line multimedia data is changing the way we get and use information Call me Ishmael. Some years ago -- never mind how long precisely -- having little or no money in my purse, and nothing particular to interest me on shore, I thought I would sail about a little and see the watery part of the world. It is a way I have of driving off the spleen, and regulating the circulation. Whenever I find myself growing grim about the mouth; whenever it is a damp, drizzly November in my soul; whenever I find myself involuntarily pausing before coffin warehouses, and bringing up the rear of every funeral I meet; and especially whenever my hypos get such an upper hand of me, … 2D Images Text Audio What about 3D data? Image courtesy of www.dreamhorse.com

3. Introduction 3D data is becoming more commonly available Someday 3D models will be as common as images are today Cheap ScannersWorld Wide Web 3D Cafe Cyberware Fast Graphics Cards ATI Images courtesy of Cyberware, ATI, & 3Dcafe

4. Motivation When 3D data is ubiquitous, there will be a shift in research focus Future research will ask: “How do we find 3D data?” Future research will ask: “How do we find 3D data?” Utah VW BugUtah TeapotStanford Bunny Images courtesy of Stanford & Utah Previous research has asked: “How do we acquire 3D data?” Previous research has asked: “How do we acquire 3D data?”

5. Introduction 3D data acquired via the Web will often be void of structural and semantic information Images courtesy of De Espona & Utah Utah VW Bug Analysis algorithms also are needed to create “useful” 3D models from “raw” 3D data

6. Introduction Research in retrieval & analysis 3D data is warranted as it has been for other media types Object Recognition Object Retrieval Object Classification Object Synthesis Matching Object Similar Objects Matching Class Novel Objects Shape Index Shape Descriptor Shape Analysis Index Construction Shape Analysis Clustering & Learning Class Specification Database of 3D Models Geometric Query

7. Introduction Which is harder to analyze? 2D Image 3D Model Images courtesy of Georgia Tech and www.dreamhorse.com

8. Lecture Outline Introduction Problems Applications Course overview Lectures Coursework Resources Wrap-up

9. Shape Analysis Problems Examples: Feature detection Segmentation Labeling Registration Matching Recognition Classification Clustering Retrieval

10. Shape Analysis Problems Examples:  Feature detection Segmentation Labeling Registration Matching Retrieval Recognition Classification Clustering “How can we find significant geometric features robustly?” Images courtesy of Bill Regli, Drexel University

11. Shape Analysis Problems Examples: Feature detection  Segmentation Labeling Registration Matching Retrieval Recognition Classification Clustering “How can we decompose a 3D model into its parts?” Images courtesy of Ayellet Tal, Technion & Princeton University

12. Shape Analysis Problems Examples: Feature detection Segmentation  Labeling Registration Matching Retrieval Recognition Classification Clustering “How can we decompose a 3D model into its parts?” Images courtesy of Ayellet Tal, Technion & Princeton University Handle Cup

13. Shape Analysis Problems Examples: Feature detection Segmentation Labeling  Registration Matching Retrieval Recognition Classification Clustering “How can we align features of 3D models?” Images courtesy of Emil Praun

14. Shape Analysis Problems Examples: Feature detection Segmentation Labeling Registration  Matching Retrieval Recognition Classification Clustering “How can we compute a measure of geometric similarity?” Image courtesy of Ilya Vakser, GRAMM

15. Shape Analysis Problems Examples: Feature detection Segmentation Labeling Registration Matching  Retrieval Recognition Classification Clustering “How can we find 3D models best matching a query?” 1) 2) 3) 4) Query Ranked Matches

16. Shape Analysis Problems Examples: Feature detection Segmentation Labeling Registration Matching Retrieval  Recognition Classification Clustering “How can we find a given 3D model in a large database?” Images courtesy of Florida State Univ.

17. Shape Analysis Problems Examples: Feature detection Segmentation Labeling Registration Matching Retrieval Recognition  Classification Clustering “How can we determine the class of a 3D model?” Images courtesy of Darpa E3D Project Query Classes

18. Shape Analysis Problems Examples: Feature detection Segmentation Labeling Registration Matching Retrieval Recognition Classification  Clustering “How can we learn classes of 3D models automatically?” Images courtesy of Viewpoint

19. Lecture Outline Introduction Problems Applications Course overview Lectures Coursework Resources Wrap-up

20. Shape Analysis Applications Examples: Virtual worlds Animation Mechanical CAD Chemistry Military Paleontology Molecular bio Medicine Forensics Art

21. Shape Analysis Applications Examples:  Virtual worlds Animation Mechanical CAD Chemistry Military Paleontology Molecular bio Medicine Forensics Art vp41620.wrl

22. Shape Analysis Applications Examples: Virtual worlds  Animation Mechanical CAD Chemistry Military Paleontology Molecular bio Medicine Forensics Art Image courtesy of Ayellet Tal, Technion & Princeton University

23. Shape Analysis Applications Examples: Virtual worlds  Animation Mechanical CAD Chemistry Military Paleontology Molecular bio Medicine Forensics Art Movie courtesy of Ayellet Tal, Technion & Princeton University

24. Shape Analysis Applications Examples: Virtual worlds Animation  Mechanical CAD Chemistry Military Paleontology Molecular bio Medicine Forensics Art Images courtesy of Bill Regli, Drexel University

25. Shape Analysis Applications Examples: Virtual worlds Animation Mechanical CAD  Chemistry Military Paleontology Molecular bio Medicine Forensics Art Morphine

26. Shape Analysis Applications Examples: Virtual worlds Animation Mechanical CAD Chemistry  Military Paleontology Molecular bio Medicine Forensics Art Images courtesy of Darpa E3D Project

27. Shape Analysis Applications Examples: Virtual worlds Animation Mechanical CAD Chemistry Military  Paleontology Molecular bio Medicine Forensics Art Images courtesy of Delson & Freiss

28. Shape Analysis Applications Examples: Virtual worlds Animation Mechanical CAD Chemistry Military Paleontology  Molecular bio Medicine Forensics Art Image courtesy of Ilya Vakser, GRAMM

29. Shape Analysis Applications Examples: Virtual worlds Animation Mechanical CAD Chemistry Military Paleontology Molecular bio  Medicine Forensics Art Image courtesy of Polina Golland, MIT Hippocampus-amygdala study in schizophrenia

30. Shape Analysis Applications Examples: Virtual worlds Animation Mechanical CAD Chemistry Military Paleontology Molecular bio Medicine  Forensics Art Images courtesy of Boeing

31. Shape Analysis Applications Examples: Virtual worlds Animation Mechanical CAD Chemistry Military Paleontology Molecular bio Medicine Forensics  Art Images courtesy of Stanford University

32. Lecture Outline Introduction Problems Applications Course overview Lectures Coursework Resources Wrap-up

33. Lectures Topics: Methods (80%) Applications (20%) Speakers: Professors Students Guests

34. Coursework In class: Present papers Lead discussions Out of class: Two course projects (~6 weeks each) Proposal talks, written reports, presentations Any topic(s) related to course

35. Course Projects Sample topics: New representations New algorithms Compare methods Use methods Other attributes New applications Non-CS applications

36. Course Projects Sample topics:  New representations New algorithms Compare methods Use methods Other attributes New applications Non-CS applications Reflective symmetry descriptors Images courtesy of Misha Kazhdan

37. Course Projects Sample topics: New representations  New algorithms Compare methods Use methods Other attributes New applications Non-CS applications Images courtesy of Katz & Tal Hierarchical Mesh Decomposition using Fuzzy Clustering and Cuts [Katz & Tal, 2003]

38. Course Projects Sample topics: New representations New algorithms  Compare methods Use methods Other attributes New applications Non-CS applications Harmonic Descriptor Spin Image Shape Context Images courtesy of Kazhdan, Johnson, & Belongie

39. Course Projects Sample topics: New representations New algorithms Compare methods  Use methods Other attributes New applications Non-CS applications Reflective symmetry descriptor Mesh simplification Images courtesy of Hoppe & Kazhdan

40. Course Projects Sample topics: New representations New algorithms Compare methods Use methods  Other attributes New applications Non-CS applications Text Shape Appearance

41. Course Projects Sample topics: New representations New algorithms Compare methods Use methods Other attributes  New applications Non-CS applications Modeling by Example

42. Course Projects Sample topics: New representations New algorithms Compare methods Use methods Other attributes New applications  Non-CS applications Mechanical CAD 1 Paleontology Chemistry Molecular Biology Ilya Vakser (GRAMM) National Design Repository

43. Resources Data sets Princeton shape benchmark Protein data bank CAD databases CAT and MRI scans Range scans Software Ringlet Other useful tools Papers

44. Wrap Up Students’ to do list: Sign up for in-class presentations Start thinking about project topics