1. Interactive Images: Cuboid Proxies for Smart Image Manipulation Youyi Zheng, Xiang Chen, Mingming Cheng, Kun Zhou, Shi-Min Hu, Niloy J. Mitra Presenter: Jiapei ZHANG

2. Outline Coupled 2D-3D Analysis 2D pixels 3D proxies Image Decomposition Background + Textured Proxies Interactive Editing

4. Initial camera calibration Grab Cut Six corners Corner points 6 correspondence pairs Linear program Camera calibration

5. Initial Scene Estimation Triplet of adjacent edgesCandidate cuboid For each candidate cuboid in the set {Pi} Joint Optimization minimize the total fitting error

6. Stacking & Occlusion A B

7. Resolving Ambiguities MRF formulation

8. Non-convex objects Cutting plane identificationRedundancy removal Greedy Algorithm Choose the one covers the largest area of Ri

10. Light & Shadow User-marked shadow correspondence Estimate a single light position (in a least squares sense) such that

11. Decomposition Remove projected proxy and shadows Image completion For each proxy: (i) shadow effects based on light position (ii) symmetric regions to fill in missing texture for invisible faces

13. Basic Operation Extracted proxies + Relations Relations: Operations: placement, repetition, alignment, coplanarity, repetition, parallelism translate, rotate, scale, stack

14. User-Indicated Relation hinge joint slide inside mark

15. Repeated Edit

16. Virtual Shopping

17. User Study V.S. Users recognized: 63.2% real images 44.5% fake images