Electrical & Computer Engineering, ECE Faculty Advisor Wayne Burleson Team Members Chinedu Okongwu Andrew Maxwell Awais Kazi Collaborators W. Richards (Rick) Adrion, Professor of Computer Science Paul Dickson, Computer Science PHD Student Snapshot Collaborators W. Richards (Rick) Adrion Paul Dickson

2 Electrical & Computer Engineering, ECE Ever wanted to have your own multimedia production of a computer based presentation that was compact, easy to share and portable? WE ALL HAVE! –Lecture –Application Demo –Annotations –MDR Presentation “SNAPSHOT” BACKGROUND

3 Electrical & Computer Engineering, ECE History, parties involved Multimedia production at UMASS –Started in Video classroom in Marston –Delivers in class material and feel to distance learning students –Driven by Professor Wayne Burleson, ECE –Proved to be cumbersome and costly CD MANIC, RIPPLES, Ken Watts –Multimedia Asynchronous Networked Individualized Courseware –Playback engine for course material –Full semester course delivered on CD’s jMANIC, RIPPLES, Byron Wallace –Java driven –Networked and Web capable –Cross Platform

4 Electrical & Computer Engineering, ECE SNAPSHOT, leveraging UMASS research  Taking multimedia to the next level Utilizing previously developed software Integrating with new research Automating process  Paul Dickson’s computer capture software Automatically captures presentation material Provides timing, and indexing SNAPSHOT provides the production!

5 Electrical & Computer Engineering, ECE What is “SNAPSHOT” Snapshot is... Portable, easy to use device that automatically Captures multimedia material in real time Produces Delivers stand-alone or networked playback Why the name “Snapshot”? “Snapshot” because Captures high resolution “SNAPSHOTS” off computer Delivers screenshots of the presentation at specific times in event

6 Electrical & Computer Engineering, ECE Haven't I seen this before?  Yes Can’t I do this with my own laptop and web cam? Yes, but not interactive Takes valuable time to produce Microsoft PowerPoint Narration and timing feature Supports audio, no video Not a production, still only presentation TechSmith Camtasia Integrates with PowerPoint Supports audio and video Extra costs to publish and host material

7 Electrical & Computer Engineering, ECE Haven’t I seen this before? AnySteam Apreso Classroom Networked System Only Audio, no video Long time to load Indexed based on arbitrary times Sonic Foundry Mediasite Audio and video Internal Storage Indexed based on arbitrary times Web access via mediasite servers only $$$ (All for a “small” fee)

8 Electrical & Computer Engineering, ECE But not like “Snapshot” Captures presentation exactly as it happens Networked or stand-alone (portable) Audio & video Quick load, all at once Added Benefits, ONLY SNAPSHOT provides together Indexing Printing Searching Note taking Synchronized screenshots

9 Electrical & Computer Engineering, ECE Set-up Design & Develop –Complete documentation and specifications User Guide –Two working prototypes Laptop driven All-in-one system –Validation Real-world testing scenarios –Lectures (Main testing scenario) –Review sessions –Guest speakers –Media events Camera Projector Capture Laptop Presenter Laptop Presentation Screen VGA2USB Capture Device VGA Splitter

10 Electrical & Computer Engineering, ECE Set-up “Snapshot” All-in-One System Camera Projector Presentation Screen Presenter Laptop VGA Splitter

11 Electrical & Computer Engineering, ECE Principle of Operation 3-Step Process Capture Production Playback Capture Playback Production

12 Electrical & Computer Engineering, ECE CAPTURE Capture needed information 2 or 3 Inputs Laptop SCREENSHOTS are taken via VGA2USB framegrabber Video & Audio Recorded via video camera Enhance audio with wireless microphone

13 Electrical & Computer Engineering, ECE PRODUCTION Real-time processing of lecture materials Computer Capture Software Generates SCREENSHOTS of lecture material Timing data Process Audio and Video Break up video and audio into SNAPSHOTS of them from timing data Merge all 3 into JMANIC Presentation JMANIC is Courseware developed by UMass CompSCI department for distance learning

14 Electrical & Computer Engineering, ECE PLAYBACK Final Product JMANIC Presentation Final files composed in one directory Slide window SNAPSHOTS of lecture material Video window Clickable table of contents Navigation through presentation Output Save to thumb drive via USB Playback by simply selecting one file

15 Electrical & Computer Engineering, ECE System Diagram

16 Electrical & Computer Engineering, ECE System Diagram with Data types and rates PNG files AVI/WAV files PNG files Video and audio captured at 320x240 resolution At 15 FPS About 200MB SVG files AVI/WAV files M4A files WAV files JAVA file

17 Electrical & Computer Engineering, ECE What we will do

18 Electrical & Computer Engineering, ECE Who is doing what? Andrew Overall merging/streamline programming Chinedu Video and Audio processing Programming required for video/audio breakdown Kazi Board research and integration Equipment enthusiast Final product preparation

19 Electrical & Computer Engineering, ECE Equipment Epiphan VGA 2 USB –Sends analog VGA signal through the USB 2.0 bus after converting it into a digital image Camera –Can use whatever video camera preferred –Will be captured after presentation

20 Electrical & Computer Engineering, ECE Equipment & Costs All-in-one System Embedded Linux Boards (ongoing research) Needs to have USB Ports (At least 2) LCD Display/VGA out Video capture card Audio in/out ports Costs Epiphan VGA2USB - $200 Board - $200-$300 Video capture card - $200 Total about $600 - $700

21 Electrical & Computer Engineering, ECE MDR Specifications Demonstrate the live capture of presentation graphics with timing information using a beta version of Paul Dixon's capture software Demonstrate our automated and stream- lined multimedia capture flow with pre- recorded (i.e. not live) audio and video. Demonstrate JMANIC multimedia playback engine using a pre-recorded multimedia presentation.

22 Electrical & Computer Engineering, ECE MDR Specifications All Met!!

23 Electrical & Computer Engineering, ECE Where to from here?  MDR II (2/12 – 2/16/07) Acquired needed equipment Developing on embedded board Streamlined production process  PDR II (3/7 – 3/9/07) Implemented capture software on board Begin testing scenarios  CDR (4/18 – 4/20/07) All-in-One system completed