CRITICAL DESIGN REVIEW COMIT

CONTENTS Motivations Mission Overview Stakeholders Sponsors Team Organization Electrical System Overview Functional Decomposition Environmental Circuit Overview Image Sensing Overview Data Processing Overview Application Framework Structural System Overview Drawings Budget Risks & Impacts Economic Impacts Risk Mitigation and Safety Environmental Impacts Societal Impact Schedule Gantt Chart Milestones Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems 2

MISSION “The mediocre teacher tells. The good teacher explains. The superior teacher demonstrates. The great teacher inspires.” ― William Arthur Ward Our mission is to inspire students in a way that defies conventions of the classroom, engaging them in the sights, sounds, and kinesthetic of a new experience. Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems 3

OVERVIEW This project will provide a table-sized multi-touch interface on which to run educational applications. Primary Foci: Exciting, dynamic, non-conventional learning Appeals to childlike curiosity Engages multiple users User-Centered Design Educates on math, science, and music Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems 4

STAKEHOLDERS "Consumer preference and motivation is far less influenced by the tangible attributes of product and service than the sub-conscious sensory and emotional elements derived by the total experience." Dr. Gerald Zaltman, Harvard Business School Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems 5

SPONSORS “A leader in sustainable, energy-efficient LED lighting” “Designers, fabricators, architects, engineers and end- users have come to rely on ACRYLITE ® sheet products to meet their unique challenges in a broad range of market.” Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems 6

TEAM ORGANIZATION Team MemberRoles Jenny CoferProject Manager Jared YenzerSystems Engineer Justin BarthHardware Engineer Nate TurleySoftware Engineer Nate GlabStructural Engineer Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems 7

ELECTRICAL SYSTEM OVERVIEW JUSTIN BARTH Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems 8

LEVEL 0 FUNCTIONAL DECOMPOSITION Power 120 V AC Touch Touch Table Legend Input / Output Display Audio 9

LEVEL 1 FUNCTIONAL DECOMPOSITION Power Supply 12 V Touch Sensing Touch Utilization Environmental Sensors Power 120 V AC Touch Display Audio 10 Touch Data Legend Input / Output Power Data

LEVEL 2 FUNCTIONAL DECOMPOSITION Power Supply 120V AC Power 120 V AC Display Audio Touch Projector Application Framework Image Processing System Imaging System Acrylic Surface IR LEDS 11 Touch Sensing Touch Utilization Environmental Sensors 12 V Legend Input / Output Power Data 12 V

ENVIRONMENTAL SENSORS SYSTEM OVERVIEW JARED YENZER Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems 12

ENVIRONMENTAL SENSORS 13 Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems Proximity Sensor 3.3 V LED STRIPS R in I/O Analog Output Temperature Sensor 5 V Analog Output CAT5114 Potentiometer CAT32 LED DRIVER

PROXIMITY SENSOR GP2Y0A21YK SPECIFICATIONS Infrared Analog Sensor 25 Hz Sampling Rate 5V Supply Detecting Distance 10 to 80 cm Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems 14

TEMPERATURE SENSOR TMP36 SPECIFICATIONS Analog Sensor 5V Supply ± 2º Celsius Accuracy -40º C to +125º C Range Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems 15

IMAGING SYSTEM OVERVIEW JARED YENZER Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems 16

IMAGING SYSTEM Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems TCM8230 Camera ATXMEGA16D4 μController 3.3 V 20 MHz CLK 8 Lines Parallel Camera Data 2.8 V1.5 V I2C BUS I/Os to Potenti ometer Proximity Sensor & Temp Data 17

MICROCONTROLLER ATXMEGA16D4INPUTS/OUTPUTS I2C BUS Program Camera Reg. Image Size Color Options Shutter Speed I/O Pin for LED Circuit Control Potentiometer 12-Bit ADC Proximity Sensor Temperature Sensor Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems 18

CAMERA TCM8230 Inputs/Outputs Parallel Data Out D0 – D7 I2C Bus Control Registers 30 FPS YUV Format (3 Bytes) Luminance (Y) Chrominance (UV) Sub-QCIF (128px x 96px) Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems 19

PROGRAMMER AVRISP MKIISPECIFICATIONS Program AVR PDI 6 pin Interface Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems 20

TESTING RESULTS TEST BOARDSOFTWARE Test Major Components Microcontroller √ Camera Voltage Regulators √ Proximity Sensors Drivers for MCU √ 21 Presenter: Jared Yenzer Capstone Senior Design 2012 COMIT TouchSystems

IMAGE PROCESSING SYSTEM OVERVIEW JUSTIN BARTH Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems 22

FPGA IMAGE PROCESSING SYSTEM Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems 8 Line Parallel Camera Data Horizontal End Frame End Camera Clock Touch Coordinates in TUIO Format Available Input 5v USB GPIO RS MHz Clock

FPGA Altera DE0INPUTS/OUTPUTS Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems 72 GPIO pins RS-232 Serial Out 115,200 baud 50MHz 24

RS-232 TO USB ADAPTER RS-232 to USB AdapterINPUTS/OUTPUTS Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems 25 RS-232 on FPGA USB on Raspberry Pi

FPGA DATA SENT OVER RS-232 Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems 26

BLOB DETECTION ALGORITHM Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems For each luminance pixel in frame if pixel ≥ brightness threshold for neighbor in pixel neighbors if neighbor is part of a blob pixel is incorporated into that blob if pixel not assigned a blob pixel assigned to new blob compare location of new pixel with blob parameters determine left, right, top, bottom most points of blob Draw boxes around each blob Use center point of boxes to determine touch coordinates to send out 27

BLOB DETECTION ALGORITHM IN MATLAB Presenter: Justin Barth Capstone Senior Design 2012 COMIT TouchSystems Basic image of IR touch blobs Image after processed through Matlab algorithm 28

APPLICATION FRAMEWORK OVERVIEW NATE TURLEY Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems 29

FUNCTIONAL DECOMPOSITION 5 V Raspberry Pi TUIO Spec via COM port HDMI 30

RASBERRY PI BOARD SPECIFICATIONS 700 MHz ARM11 Overclocking Broadcom VideoCore IV OpenGL ES 2.0 USBx2 via integrated Hub HDMI Video Output 5v, 700mA, 3.5 W OS: Raspbian Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems Broadcom BCM2835 SoC 31

SOFTWARE OpenFrameworks Open source c++ toolkit Game engine architecture Setup() Update() Draw() Built in event listener Custom Event Args Callbacks OpenGL ES 2.0 Standard for embedded accelerated graphics Hardware floating point support Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems 32

Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems UML CLASS DIAGRAM CRITICAL SOFTWARE COMPONENTS 33

APPLICATION FLOW CHART Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems 34

PROJECTOR ViewSonic PDJ5351SPECIFICATIONS Presenter: Nate Turley Capstone Senior Design 2012 COMIT TouchSystems 23’’ Throw Distance 2500 Lumens 3000:1 Contrast Ratio $420 35

STRUCTURAL SYSTEM OVERVIEW NATHAN GLAB Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems 36

TABLE STRUCTURE Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems 37

TABLE STRUCTURE Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems 38

INSIDE TABLE STRUCTURE Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems 39

BUDGET OVERVIEW JENNIFER COFER Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems 40

BUDGET ItemCompanyUnit PriceQuantityTotal Cost Projector$4201 IR LED ReelEnvironment alLights.com $215 - $21.50 (estimated) 1, length 5m $193 (estimated) Rear Projection Sheet (diffuser) Acrylite$ $ , 40x25in$ Endlighten T Acrylic (Polished) Acrylite$ $ , 40x25in$ Plexiglas Overlay Home Depot$1091, 40x25$ Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems

BUDGET ItemCompanyUnit PriceQuantityTotal Cost Proximity Sensing Board Final Advanced Circuits $331 AVRISP Microcontroller Atmel$ Proximity LEDsSparkfun$1.3548$64.80 CMOS CameraSparkfun$9.952$19.90 PotentiometerMouser$3.042$6.08 LED DriverMouser$2.482$4.96 IR LED track materials $50 42 Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems

BUDGET ItemCompanyUnit PriceQuantityTotal Cost Sound System Provided11N/A Structural Materials Home Depot$150 Proximity Sensing Board Draft Advanced Circuits $331 Total $1, Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems

ECONOMIC ASPECTS Marketability of system: Could decrease teachers needed (esp. special education) Could supplement homeschooling Could extend past an educational environment Cost expected to decrease in mass production 44 Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems

RISKS & IMPACTS OVERVIEW JENNIFER COFER Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems 45

ENVIRONMENTAL IMPACTS Acrylite is Green and LEEDs certified “We are committed to minimizing our environmental impact. Operating under the Guiding Principles of Responsible Care ®, we strive to continuously improve our health, safety, and environmental performances. Our goal is to improve the environment by supplying sustainable and long-living acrylic products to the green building sector and to all other markets we serve.” Environmental Lights has A New Angle on Green “At EnvironmentalLights.com we believe in sustainable lighting solutions that are energy-efficient and long-lasting, which lowers energy use and minimizes the environmental impacts from manufacturing and waste.” 46 Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems

RISK MITIGATION & SAFETY Temperature Fans Ventilation Overall heat sensor (in LED circuit) Temperature sensor on camera board / projector unit Dust Fans Devices accessible for cleaning Followed Component Specifications (linked below) Acrylic herehere IR LEDs herehere Followed UL Guidelines (linked here)(linked here) 47 Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems

SOCIETAL IMPACT Defying educational conventions “Spoon feeding in the long run teaches us nothing but the shape of the spoon” ~ E. M. Forster Providing the alternative “It is the supreme art of the teacher to awaken joy in creative expression and knowledge.~ Albert Einstein 48 Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems

SCHEDULE OVERVIEW NATHAN GLAB Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems 49

SCHEDULE 50

SCHEDULE DateDescriptionDeliverable Sept. 25/27Milestone 1 Oct. 16/18PDR Oct. 23/25Functional Decomposition Nov. 13/15Milestone 2 Dec. 4/6CDR Jan. 15/17Milestone 3  Materials Ordered  Have the Structure Assembled  Application Framework complete  Camera Driver set up  Matlab blob detection optimized Apr. 16/18Milestone 4  FPGA Implementation  Camera to FPGA integration  FPGA to CPU integration  Environmental Sensor Implementation  Software Application Implementation Apr. 23/25Expo  Completed table with custom software running 51 Presenter: Nate Glab Capstone Senior Design 2012 COMIT TouchSystems

QUESTIONS? Presenter: Jenny Cofer Capstone Senior Design 2012 COMIT TouchSystems 52