I.H.L.A MEDIA Christopher Fuller, Nicholas Johns, Ashley Kaufman, Brandon McCauley, Matthew Pachol, Christopher Suever

 Wish to examine what it takes to create a seamless experience between an individual and technology  Through the use of interactive “mirrors”, our objective is to get the observer to interact with a pre-designed interface and allow them to have control over the outcome that would create a memorable experience  Applications for our proposed design would be through it’s use in advertising and entertainment purposes. PROBLEM STATEMENT

 It is predicted that spending on digital ads will surpass the combined total of ad spending on newspapers and magazines ads in 2015  One of the biggest problems with digital advertising is a large varying demographic of customers  Form of art that involves the spectator in a way that allows the art to achieve its purpose  Immersive Environment: Real-time image processing and manipulation, biometric feedback and be aesthetically pleasing. PROBLEM BACKGROUND

 Raspberry Pi  Single board computer  CPU, GPU, USB AND HDMI  Raspberry Pi camera module  5 mega-pixel for images  1080p, 30 frames/sec for video  HD monitors  LCD/LED monitors  720p or higher resolution  HDMI compatible MAJOR TECHNOLOGIES

HARDWARE SPECIFICATIONS Micro-USB Power Port: 700mA (3.5W) HDMI 2.0: Up to 18 Gbits/s USB 2.0: Up to 480 Mbits/s Ethernet RJ45:10/100Mbits/s High Bit Rate SD Cards: 95 MB/s Raspberry Pi Camera: 1080p Monitor Display: At least 720p

ARCHITECTURE OF SYSTEM

LEVEL 0 Module Raspberry Pi: Model B, Raspbian OS Inputs Raspberry Pi Camera: 5 MP (images), 1080p (video), 15-pin ribbon connection, > 15 Mbits/s Micro USB Power Port: 700 mA, 3.5 W, 5V DC Outputs HDMI Video Output: 1080p, 30 fps, Up to 15 Gbits/s FunctionalityAcquire and manipulate the camera input to produce HD video output.

LEVEL 1 Module Camera Serial Interface Inputs Raspberry Pi Camera: 5 MP (images), 1080p (video), 15-pin ribbon connection, > 15 Mbits/s Power: > 250 mA OutputsRPi Camera Image: 5 MP resolution FunctionalityServes as the connection port between the Raspberry Pi and the Raspberry Pi camera to enable image acquisition.

LEVEL 1 Module System on a Chip (SOC): Broadcom BCM2835, (CPU, GPU, DSP, SDRAM, USB port) Inputs RPi Camera Image: 5 MP resolution Power: 700 mA OutputsManipulated RPi Camera Image: 5 MP resolution FunctionalityIntegrates all components of the RPi module into a single chip. Serves as the medium between image acquisition and video output to manipulate the RPi camera image. Module High-Definition Multimedia Interface Inputs Manipulated RPi Camera Image: 5 MP resolution Power: 700 mA OutputsVideo Output: 1080p, 30 fps, up to 15Gbits/s FunctionalityInterface for transferring the manipulated RPi camera image data from the HDMI-capable RPi camera to a compatible computer monitor in order to display the HD video output.

LEVEL 2

Module Central Processing Unit: 700 MHz, ARM1176JZF-S core Inputs RPi Camera Image: 5 MP resolution Power: 700 mA OutputsManipulated RPi Camera Image: 5 MP resolution FunctionalityResponsible for the pre-processing (resizing) of the acquired image data as well as performing image edge detection and contour finding. LEVEL 2 Module Graphics Processing Unit: Broadcom VideoCore 250 MHz, OpenGL ES 2.0 (24 GFLOPS), 1080p30 h.264 high-profile decoder and encoder 1080p Inputs RPi Camera Image: 5 MP resolution Power: 700 mA OutputsManipulated RPi Camera Image: 5 MP resolution FunctionalityProvides openGL ES 2.0, hardware accelerated openVG, and 1080p30 h.264 high profile decoder and encoder. This controls the image data manipulation by use of algorithms including Shaders, Particles, and Grey-Scott Reaction Diffusion.

 High-level open source toolkit  C++, object oriented  Allows for direct calls to native system libraries  MIT licensed: freedom of use in commercial or non- commercial applications.  Cross platform C++ interface to graphics, audio, video, networking and access to many libraries OPENFRAMEWORKS

 Header file  Blue print or empty structure with no implementation detail  Cpp file  Definition of functions and program.  Setup()  Allows for setting of program specifics prior to running the program (setting the windows size, frame rate, etc.)  Update()  Use for continuously updating the state of the program  Draw()  Allows for the interaction of the system. STRUCTURE OF OPENFRAMEWORKS

Particle SystemGray Scott Diagram OUTCOMES

REACTION DIFFUSION EXAMPLE

CONTEXT DIAGRAMS

USE CASES

SEQUENCE DIAGRAMS StandbyImage Acquisition

SEQUENCE DIAGRAMS OutputImage MeshingImage Processing

OBJECTIVE TREE

TaskDescriptionMembers Hardware Integration Make sure hardware applications are compatible as well as work as a cohesive unit Fuller, Johns, Kaufman, McCauley, Pachol, Suever Software Integration Making sure the programming languages and image modification algorithms are compatible. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Algorithm Design Create software algorithms to modify a user’s image in various ways. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Algorithm Implementation Test to determine whether the algorithms designed are functional and work to display the output. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Software and Hardware Integration Ensure that the hardware as well as software is compatible and work to display the output. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Completed Prototype of SystemCreate a working prototype that combines all prior tasks and works properly. Fuller, Johns, Kaufman, McCauley, Pachol, Suever EXPECTED OUTCOMES

PROJECT PLAN

 Integrating all technologies cohesively  Designing multiple innovative unique display options  Creating the system to work in real-time.  Allowing the user with a free range of interactive possibilities  Create a system at a low cost.  Develop the system that has minimal power concerns. CHALLENGES AND UNCERTAINTIES

ActivityFailureCauseSolutions Power Loss System experiences an external power loss. Over-heating of the system as well as the over consumption of power due to a single component. Allow for the system to be in an environment that allows for proper heating of the system as well as monitor the system’s power consumption. Software Failure Code or software does not function properly. Code has “bugs” or other failures within or the software used is not compatible. Determine if the code is “bug” and confirm that the software is functioning properly. Hardware Failure Hardware does not work properly. Over-heating of the system or the connections between the components are not ideal. Test connections between the components to determine if they are connected. Also to monitor the system’s power consumption. Environmental Issues Lighting of the environment causes an issue within the system. Too much or too little lighting for the system. The space in which the system is in is not large enough for proper image retrieval. Allow for the system to be placed in an environment that is ideal for image retrieval as well as image output. A well lit room as well as a room that is large enough for image retrieval that does not compromise the system. System over- heating System over-heats causing a failure within the system. Power consumption of the Raspberry Pi or other components is too high. Monitor the system’s power consumption. Image outputThe image output quality is not ideal or does not work at all. The image manipulation does not yield a output image that is ideal. Software, code or Raspberry Pi does not work properly. Test the output of the system onto the monitor and determine if it’s both in as close real time as possible as well in the quality that is ideal. FAILURE ANALYSIS

 Raspberry Pi  Purchased from distributor  HD Monitors  Utilizing monitors that we have in our possession  Camera  Raspberry Pi Camera module purchased from distributor  Openframeworks  Obtained from Openframework website  Visual Studio  Obtained from Dreamspark website. COMPONENT PROCUREMENT PLANS

 Digital interactive art is a growing art form that incorporates science and technology.  Immersive environment consists of human-computer interface which promotes social engagement from users.  Complex algorithms combined with the level of interactivity leads to memorable and unique aesthetics.  Incorporates STEM aspects into the market world. CREATIVE AND INNOVATIVE ASPECTS

 Project is meant to be intuitive and aesthetically pleasing.  Multiple uses such as advertising, art or just fun entertainment.  Main goal: provide a memorable, unique and interactive experience for the user. CONCLUSION

QUESTIONS?