1. Microsoft Kinect TM + Crowdsourcing A Prototype for Code Validation Matt Trippy, Owner Enovation Concepts

2. Agenda PurposeDefinitions Tools / Apps Objectives Outcomes / Demo Next Steps Sources

3. Purpose Prototype a Crowdsourced Project Demonstrate Use of Enhanced User Interface (Kinect TM for Windows) Demonstrate Use of Multiplayer Gaming Tasks to Support Enhanced Verification of Complex Code Use of Both Qualitative and Quantitative Metrics are Being Established and Collected Determine Potential Defects in Modules: Differing Code, “Dead” Code, Inefficient / Overly Complex Code Kinect TM Chosen for Widespread Appeal of Motion Recognition Interface & Growth Potential of Multipurpose Sensors Potential to Increase Crowdsourced Population More Robust Platform For Future Crowd-source Problems: Voice Recognition, Motion-sensing Inputs, & Traditional Controller-based System Inputs More Rapid And Varied Inputs By The “Gamer” Initial Work With Xbox 360 Kinect TM Sensor; Now Using The (2 nd Generation) Microsoft Windows Kinect TM More Suited For Desktop Computing Platforms

4. Definitions Crowdsourcing: [Simple] “The application of Open Source principles to fields outside of software” (Jeff Howe, Wired, 2006) [Better] “Crowdsourcing is the act of taking a job traditionally performed by a designated agent and outsourcing it to an undefined, generally large group of people in the form of an open call”

5. Tools

6. Application No “Out-of-the-Box” Kinect TM Apps for Analysis, Collaboration Lots of “Gamer” Software (Enovation Concepts) Developed Crowdsourcing App Scripting to Enable Visualization of Source Being Crowdsourced Challenge: Automate the Visualization to Enable Cognitive Processes to be Analyzed by the “Crowd” Keep the Human Focused on Logic, Other Cognitive Tasks Automation Takes the First Cut at Organizing Visualization Keeps Participant Focused on Critical Logical Elements Web-enabled App to Review Logical Elements of Source Code Under Review Updated to New Kinect TM for Windows (not Xbox Version)

7. Objectives Initially: Grow Interest in the Approach Refine Methods to Graphically Illustrate Logical Flow of Program Being Evaluated Crowdsource Participants Can Quickly See Potential Problem Areas Relying on Intuitive Sense That an Automated Tool Would Likely not be Capable of Highlighting Leverage Power of Crowdsourcing to Gain Aggregation of Results, Comparison of Individual Findings Improve Quality and Speed of IV&V Effort Future: Substantial Improvement in Both Speed and Quality of any Given Software IV&V Effort Use of Crowd Sourcing + a Radically Improved Input/Output Interface (Kinect TM ) Need to Focus on Classes of Errors That Would Benefit From Rapid Cognition of Inconsistencies, Inefficiencies Looking for Findings not Otherwise Lending Themselves to Automated Correction or Flagging What is Being Consistently Overlooked or Underperforming in Current State-of- Art Code Reviews?

8. Outcomes Demonstration Metrics / Results

9. Next Steps Enhance Metrics in the App Continued Work on App Re-configurability Crowdsourcing Approach / Process Improvements Comments from “The Crowd”?

10. References Black, Rex, Managing the Testing Process—Practical Tools and Techniques for Managing Hardware and Software Testing, New York: John Wiley & Sons, 2002. Print. Borenstein, Greg, Making Things See, Sebastopal, CA: O’Reilly Press, 2012. Print. Howe, Jeff, Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business, New York: Three Rivers Press, 2009. Print. Kramer, Jeff, Nicolas Burrus, Florian Echtler, Daniel Herrera C., and Matt Parker, Hacking the Kinect, New York: Springer Science + Business Media, 2012. Print. Sloane, Paul (ed), A Guide to Open Innovation and Crowdsourcing: Practical Tips Advice and Examples from Leading Experts in the Field, United Kingdom, Pennsylvania, PA & New Delhi: Kogan Page Limited, 2011. Print. Webb, Jarrett & James Ashley, Beginning Kinect Programming with the Microsoft Kinect SDK, New York: Springer Science + Business Media, 2012. Print.