Extending the DICOM standard by an “Optical Surface Scan IOD” Dipl.-Ing. Christian Dressler Dr.-Ing. Oliver Burgert

Optical Surface Scan, WG-06 meeting, Use cases 2

Optical Surface Scan, WG-06 meeting, Idea  Two possibilities to store scanner data Raw data 3d object Scanner External Post-processing PACS Point clouds, surface meshes, textures, device- specific attributes, 3d models 3

Optical Surface Scan, WG-06 meeting, Reconstruction with „Paraview“  Reconstruction based on point cloud with uv map and bitmap 4

Optical Surface Scan, WG-06 meeting, Reconstruction with „Paraview“  Point cloud contains of xyz and uv values  Here: comma separated ascii file 5

Optical Surface Scan, WG-06 meeting, Reconstruction with „Paraview“  Import point cloud 6

Optical Surface Scan, WG-06 meeting, Reconstruction with „Paraview“  Assign columns to coordinate system 7

Optical Surface Scan, WG-06 meeting, Reconstruction with „Paraview“  Display point cloud 8

Optical Surface Scan, WG-06 meeting, Reconstruction with „Paraview“  Calculate surface mesh (multiple parameters) 9

Optical Surface Scan, WG-06 meeting, Reconstruction with „Paraview“  Assign texture according to uv map 10

Optical Surface Scan, WG-06 meeting, Reconstruction with „Paraview“  Smooth 11

Idea  Two possibilities to store scanner data Optical Surface Scan, WG-06 meeting, Raw data 3d object Scanner External Post-processing PACS Point clouds, surface meshes, textures, device- specific attributes, 3d models 12

Changes to the DICOM standard 13 Optical Surface Scan, WG-06 meeting, Two new IODs Point data Surface New IEs each New Modules Point cloud module UV-Mapping module Using existing Points Macro New Macro Use the Mesh Module Add Module New DCM codes Add Module Frame of Reference VL Photo IOD

Changes to the DICOM standard 14 Optical Surface Scan, WG-06 meeting, Two new IODs Point data Surface New IEs each New Modules Point cloud module UV-Mapping module Using existing Points Macro New Macro Use the Mesh Module Add Module New DCM codes Add Module Frame of Reference VL Photo IOD

Storing Scanner Data in DICOM structure 15 Optical Surface Scan, WG-06 meeting, Patient Study 1 Study 2 Study n Series 2 Series1 Series n Raw Data IOD VL Photo IOD 3D object IOD FOR

Optical Surface Scan, WG-06 meeting, Texture  Linking via Frame of References (FOR)  Suggested by WG-13 (Visible Light) Point or Mesh IOD VL Photo IOD Frame of Reference 16

Optical Surface Scan, WG-06 meeting, Texture Missing Frame of Reference IE in current IOD! 17

Changes to the DICOM standard 18 Optical Surface Scan, WG-06 meeting, Two new IODs Point data Surface New IEs each New Modules Point cloud module UV-Mapping module Using existing Points Macro New Macro Use the Mesh Module Add Module New DCM codes Add Module Frame of Reference VL Photo IOD

Changes to the DICOM standard 19 Optical Surface Scan, WG-06 meeting, Two new IODs Point data Surface New IEs each New Modules Point cloud module UV-Mapping module Using existing Points Macro New Macro Use the Mesh Module Add Module New DCM codes Add Module Frame of Reference VL Photo IOD

Create two IODs  Two new IODs  Surface Point Data IOD  Surface Mesh IOD 20 Optical Surface Scan, WG-06 meeting, Scanner External Post-processing PACS Point clouds, surface meshes, textures, device- specific attributes, 3d models

Surface Segmentation IOD can not be used 21 Optical Surface Scan, WG-06 meeting, New IOD with only the „Surface Mesh“ Module

New Surface Mesh IOD 22 Optical Surface Scan, WG-06 meeting, Will be used

New Surface Point Data IOD 23 Optical Surface Scan, WG-06 meeting,

Closer look to Equipment IE 24 Optical Surface Scan, WG-06 meeting,

Changes to the DICOM standard 25 Optical Surface Scan, WG-06 meeting, Two new IODs Raw data Surface New IEs each New Modules Point cloud module UV-Mapping module Using existing Points Macro New Macro Use the Mesh Module Add Module New DCM codes Add Module Frame of Reference VL Photo IOD

Changes to the DICOM standard 26 Optical Surface Scan, WG-06 meeting, Two new IODs Raw data Surface New IEs each New Modules Point cloud module UV-Mapping module Using existing Points Macro New Macro Use the Mesh Module Add Module New DCM codes Add Module Frame of Reference VL Photo IOD

Create two Modules 27 Optical Surface Scan, WG-06 meeting, Surface Mesh Module Points Macro Point Cloud Module Additionally create Points Macro … … UV-Map Module Point Cloud Extension Macro Create new Module and Macro Use for color storage -Module already exists -Contains Points Macro -Module may not be used

Adding UV-Map Module 28 Optical Surface Scan, WG-06 meeting, UV-Map Module Point Cloud Extension Macro xyz ……… uv… … 0.3 … … …… Multiple textures per Point Cloud allowed One additional column per Sequence Additional columns Point Cloud

Adding UV-Map Module 29 Optical Surface Scan, WG-06 meeting, xyz ……… uv… … 0.3 … … …… UV-Map Module Point Cloud Extension Macro New Codes! Point Cloud Module

Adding a module for Scan Procedure 30 Optical Surface Scan, WG-06 meeting,

Use case 1  ONE SINGLE SHOT WITHOUT TEXTURE ACQUISITION AS POINT CLOUD 31 Optical Surface Scan, WG-06 meeting,

Use case 2  ONE SINGLE SHOT WITH TEXTURE ACQUISITION AS MESH 32 Optical Surface Scan, WG-06 meeting, VL Photographic Imagic assigned via FoR to Surface Mesh

Use case 3  STORING MODIFIED POINT CLOUD WITH TEXTURE AS MESH 33 Optical Surface Scan, WG-06 meeting, New Series to be created

Use case 4  MULTISHOT WITHOUT TEXTURE AS POINT CLOUDS AND MERGED MESH 34 Optical Surface Scan, WG-06 meeting, Merged mesh shall use Scan Procedure Module with Registration Method Attribute

Use case 5  MULTISHOT WITH TWO TEXTURE PER POINT CLOUD 35 Optical Surface Scan, WG-06 meeting, UV Map Module provides Sequence for multiple Textures Name A Name B

Use case 6  USING COLORED VERTICES INSTEAD OF TEXTURE 36 Optical Surface Scan, WG-06 meeting, Extended Point Cloud Macro to be used

Changes to the DICOM standard 37 Optical Surface Scan, WG-06 meeting, Two new IODs Point data Surface New IEs each New Modules Point cloud module UV-Mapping module Using existing Points Macro New Macro Use the Mesh Module Add Module New DCM codes Add Module Frame of Reference VL Photo IOD

Optical Surface Scan, WG-06 meeting, Open issues 38

Thank you! Acknowledgements The Innovation Center Computer Assisted Surgery (ICCAS) at the Faculty of Medicine at the University of Leipzig is funded by the German Federal Ministry for Education and Research (BMBF) and the Saxon Ministry of Science and the Fine Arts (SMWK) in the scope of the initiative “Unternehmen Region” with the grant numbers 03 ZIK 031 and 03 ZIK 032. It is also sponsored by funds of the European Regional Development Fund (ERDF) and the state of Saxony within the frame of measures to support the technology sector.