Visualization Technology Basic Masaki Hayashi Nov.10, 2015 Visualization with 3D CG

Lecture assigning I will focus on the technical aspect of visualization. Technical issue of visualization  Masaki Hayashi What, how and why is visualization?  Steven Bachelder

Today’s lecture Overview of visualization method Key issues of 3DCG visualization Available technologies of visualization with some show cases (I will introduce the principles behind the technologies as much as possible)

Visualization Very wide meaning Creative visualization Flow visualization Geovisualization Illustration Information graphics visual representations of information Information visualization Interactive visualization Music visualization Scientific visualization Software visualization Visualization (computer graphics) From Wikipedia

Visualization with 3DCG To make a model  Using CG tool To digitize a real thing  Digitization technique

1 Digitization Storage & Network & Computer User interface 2 Representation 3 Dissemination Scanning, modeling Display, Web Three phases of visualization in digital manner

Digitization Filming  Photograph Laser scanning  Measurement by laser beam Photogrammetry  Reconstruct geometry from multiple pictures

Filming Digital camera Resolution, White balance, Focal length, RAW data, Lighting Image scanner Resolution, Color depth Image stitching

Laser scanning Range: Small object, statue, ruin to city landscape + Aerial Output: 3D point cloud x, y, z, + (i, r, g, b) Multiple measurements: Compensation of the shadow IMView ILRIS Intelligent Laser Ranging and Imaging Systems 3m – 1000m (Optech) Peru (landscape), Hampson museum (artifact) Minolta-Konica Vivid 9i Example: ScanView (CMU)

Medical scanning CT scanner (computed tomography) MRI scanner (magnetic resonance imaging) Virtual autopsy by Linköping University Example:

Photogrammetry Digital camera Multiple filming and software reconstruction Range: Same as scanner Output: 3D point cloud + color x, y, z, r, g, b Compensation of shadow Example: PhotoScan (Agisoft) Acute3D

Representation Device: PC Monitor Screen projection Handheld device Head-mounted display Image: 2D picture 2D panoramic image 3D CG Stereoscopic hologram

Virtual Museum Real space Immersive VR Big display AR Web based Floor map navigation Panorama walkthrough Art work viewing 3DCG walkthrough

Immersive display HMD (Head Mounted Display) Classic Latest

Immersive display CAVE (Cave Automatic Virtual Environment) Comes with head tracking, stereoscopy, wand, multiple loudspeakers

Immersive display ImmersaDesk Comes with head tracking, stereoscopy, wand, stereo sound

Big display 4K / 8K 4K LCD Monitor (Astrodesign) 60-inch 8K PDP Monitor (Panasonic) 145-inch 8K projector (NHK)

Big display Multi-display Curved screen with 3 projectors (22m x 6m) (Toppan)

Big display Cleveland Museum (12m x 1.5m) 23 HDTV tiles with touch panel Multi-display

AR ( Augmented Reality ) AR information service Google glass Real image + CG

AR ( Augmented Reality ) A board with marker Real image + CG CG is composited in real-time

Panoramic display Google Art Project PERISCOPE ( DNP ) Panoramic movie

Web service 360-degree image, floor plan navigation, information display Louvre Virtual Tours

Web service Panorama view, view point transition, information display Smithsonian National Museum of Natural History

Web service Google Art Project Panorama view + view point transition (same technique used in Street View)

Web service Google Art Project Detail observation mode + related information

Web service 3DCG walkthrough GRAPHTWERK ( UNITY based 3D walkthrough )

Web service 3D Ancient Wonders (Shockwave Player, UNITY ) 3DCG walkthrough

Web service The Virtual Hampson Museum( VRML, PDF, OBJ data ) 3DCG object handing

Dissemination There is not so many technical issue Rather social issue Devices for users:  PC, Tablet, Smartphone, etc. Ways of reaching:  Web, Internet, Mobile, etc. User interactions:  Keyboard, Touch screen, Voice control, Haptic device, etc.

Dissemination Some keywords Links Tagging Rating (likes) Keyword searching Personalization Community SNS Example of social tagging (from Steve Project)

Dissemination Examples of virtual museum ation/joconde/fr/ Joconde Portal collections of museums in France 500,000 objects Artefacts Canada 3,000,000 objects chin.gc.ca/artefact/index-eng.jsp Steve Project “Steve tagger” social tagging