Nov. 11, 2016 Visualization with 3D CG Orientation Masaki Hayashi

Schedule (2016 – 2017) V Day Time Room Lectures Remark 45 Nov 11(F) 13-16 B15 Orientation and Visualization basic Lecture 46   Nov 18(F) 13-15 E30 Digital 2D image basic Lecture, workshop 47 Nov 25(F) B14 4K/8K imaging system Lecture,　lab tour 48 Nov 29(T) B13 Digital camera & Color theory Dec 2(F) 3D object digitization 49 Dec 6(T) E41 3D object scanning by PhotoScan Workshop Dec 9(F) 3DCG basic 50 Dec 13(T) Virtual museum with Unity Lighting in Unity Dec 16(F) Eastern Visual culture 51 W51 - W1 Xmas break 2 Jan.10(M) E44 Project help Jan.13(T) Presentation from students

Masaki HAYASHI（林正樹）, PhD. Self introduction Masaki HAYASHI（林正樹）, PhD. Associate professor Department of Game Design, Uppsala University 1986 - 2006 NHK Science and Technology Research Laboratories (20 years) 2006 - 2011 Game and IT companies 2012 - Uppsala University, Campus Gotland Astrodesign, Inc. Engineering Researcher on Content ( Virtual museum, Text-to-vision, etc.) My profile: http://hayashimasaki.net/profile/index-e.html

Orientation See portal Something to ask? Dropbox Schedule (check the PDF version) Course materials (ppt files, links, etc.) Something to ask? Email: masaki.hayashi@speldesign.uu.se Room: CMLab (2nd floor of Building F) Dropbox Will be announced soon 4

Orientation You can use… all in CMLab 4K resolution CG environment 4K, 60inch TV, PC with GPU card Virtual museum in Unity Museum model, Unity project with source code 3D object digitization equipment Filming gear (digital camera, lighting equipment) 3D reconstruction software (PhotoScan) all in CMLab 5

The lectures and the workshops Visualization technology basic Digital 2D image basic 4K/8K imaging system Color theory, digital camera 3DCG basic 3D object scanning Digitization by AGISOFT (workshop) Virtual museum on UNITY (workshop) 6

1. Visualization technology basic Technical aspect of visualization Visualization basic Three phases of visualization Digitization, Representation, Dissemination Representation Real space, Immersive VR, Big display, AR Web service: Panorama, view point transition, Walkthrough Dissemination Devices, ways of reaching, User interactions (With a lot of videos and demos)

2. Digital 2D image basic + Mini workshop 2D image digitization Technical knowledge of 2D image 2D image digitization Scanning, resolution, depth, aspect ratio, color scheme Image compression JPEG, GIF, PNG Image processing LUT (Look UpTable) Histogram Spacial filtering: smoothing, Edge detection/enhancement Image magnification and shrinking + Mini workshop

3. 4K/8K imaging system + Mini lab tour Basic of video Frame rate, video format standard, video compression Basic of video production Video equipment: Offline editing (non-linear), real-time switching 4K video eqipment Camera, recorder, Switcher, non-linear editing soft, Encoder/Decoder, Display, Projector 8K imaging system Specification, 8K video equipment 4K/8K real-time CG system + Mini lab tour to see 4K image and video

Theory of color representation 4-1. Color theory Theory of color representation Red Green Blue Test light Matching Test field Reference field

4-2. Digital camera Resolution, RAW data, dynamic range, EXIF

5. 3D object scanning Laser scanning Scanning equipment Range: Small object, statue, ruin to city landscape, Aerial Output: 3D point cloud (x, y, z) +(i, r, g, b) Multiple measurements: Photogrammetry Digital camera, software reconstruction Range: Output: 3D point cloud + color (x, y, z, r, g, b)

6. Digitization by PhotoScan Workshop using “PhotoScan” (Agisoft) Taking pictures  Masking  Import  Reconstruction  Fixing errors  Export ( This is needed for the final assignment )

Theory of basic computer graphics 7. 3D CG basic Theory of basic computer graphics y x z

8. Virtual museum with UNITY (workshop) How to use UNITY Import your own models into the space Small Virtual Museum project will be provided ( Final assignment is given on this day )

Work shop of lighting in UNITY 9. Global illumination in UNITY (workshop) Work shop of lighting in UNITY

Eastern (Japanese) Visual Culture Special lecture Eastern (Japanese) Visual Culture (Dec. 16) 17

Special lecture 18

Make your own virtual museum Final project Make your own virtual museum Each one will present your result on the last day of the course. ?

Production + Essay Final assignment Description and reflection of your production written in a scientific paper format. Your own virtual museum with 3D objects, pictures and text. Submission at the end of the course (Jan. 2017) Some tools to do the final work will be provided. Some helpful workshops provided Guideline of scientific paper format provided. 20