1. Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn Neil Arellano Sergio Mendoza Evan Tsai Gabriel Nunez JohnPaul Adigwu Jorge Estrada Adrienne Lam Sergio Beltran Alexander Alegre NASA Grant URC NCC NNX08BA44A16/13/2015

2. Why ? Information and tools are scattered Traditional technologies have difficulty in meeting collaborative working environments Displaying objects in a 2-Dimensional space is not practical for concepts that exist in 3-Dimensional space 6/13/20152NASA Grant URC NCC NNX08BA44A

3. Overview NASA Grant URC NCC NNX08BA44A3 Hardware Layout Distributed server network Multi-platform compatibility Application Layout Organizing and relating nodes of information based on their meaning Connecting users across different platforms & network access capabilities Synchronizing data across servers 6/13/2015

4. Component Dependency Diagram 6/13/20154NASA Grant URC NCC NNX08BA44A

5. Application Process Diagram Server TupleSpace Database QT Fileserver Active Directory 6/13/20155NASA Grant URC NCC NNX08BA44A

6. 23 Los Angeles Aerospace 24 Los Angeles Electrical IDCityDept 23Los Angeles Aerospace 24Los Angeles Electrical 25San DiegoChemical “Select * from uvc_users where City = ‘Los Angeles’”; QSqlQuery Query( QString Query) XmlResultsWriter(QSqlQuery Result) XML Code (Sent via QTcpSocket using Tuple Space supplied parameters) Database DB API DB API-Database Interaction: Queries 6/13/20156NASA Grant URC NCC NNX08BA44A

7. Tuple Space QT Tuple Space-DB API Interaction Qt interprets tuple parameters to carry out appropriate DB query (Tuple parser function) Tuple provides information to QT including: sql query, ipaddress, port QT 6/13/20157NASA Grant URC NCC NNX08BA44A

8. DB API-Database Interaction: Status Component% CompletedDependencies XmlWriter100%None QSqlQuery100%QSqlDriver Postgres QTcp Client Comm.100%Tuple Parameters QTcpSocket class methods for TCP transmission Database DB API PostGre SQL 6/13/20158NASA Grant URC NCC NNX08BA44A

9. Tuple Space-Qt Interaction Status Component% CompletedDependencies TupleParser15%Knowledge of Tuple- Space code (incoming hash tag) Tuple Space QT 6/13/20159NASA Grant URC NCC NNX08BA44A

10. Semantic Network Component Update Scraping Tool (Client Side) Tuple Space Q Key Features Video playback of dragged video Thumbnail preview of dragged images Objects can be created without internet connection (locally) 6/13/201510NASA Grant URC NCC NNX08BA44A

11. Semantic Network Component Update (continued) Key Features Basic Object Tables Complete Allows table inheritance Commutates with Client (QT) application) Communication with Tuple Space successful 6/13/201511NASA Grant URC NCC NNX08BA44A

12. Main Pending Tasks: - Audio Transmission/Compression MP3 - FTP Client/Server Establishment Ubiquitous Video Conferencing Present Status: - Memory (RAM) Measurements (Completed) - Bandwidth Measurements(Completed) 01/13/201112NASA Grant URC NCC NNX08BA44A

13. Memory Tests on the Client System The experiment was conducted in order to calculate the memory utilization per single FFMPEG stream in the UVC Application. Several other non-UVC applications where left on purpose to simulate multi-tasking environment. 01/13/2011NASA Grant URC NCC NNX08BA44A 13 Number of Parallel Decoded Video Files RAM (MB) Exp. 1 RAM (MB) Exp. 2 RAM (MB) Exp. 3 Average RAM (MB) 228303122.8 35442 46.0 464676063.7 571737472.0

14. Multiple Video Streaming 01/13/2011NASA Grant URC NCC NNX08BA44A14

15. Memory Tests on the Client System 01/13/2011NASA Grant URC NCC NNX08BA44A15

16. Bandwidth Tests on the Client System Network Utilization was used to determine the activity state of the network port on the client system. Three experiments have been performed in order to find the average ratio of the network usage to the maximum traffic for a LAN with 100Mbps. When Network Utilization exceeds threshold of 100%, it causes problems such as the drop in transmission speed, and increases the chances of intermittence and request delay. 01/13/2011NASA Grant URC NCC NNX08BA44A16

17. Bandwidth Experiment # 1 - 100Mbps Network 01/13/2011NASA Grant URC NCC NNX08BA44A17 FPS Network Utilization (Mbps)

18. Bandwidth Experiment # 2 – 25 fps 01/13/2011NASA Grant URC NCC NNX08BA44A18 Number of Parallel Video Streams Network Utilization Exp. 1 (Mbps) Network Utilization Exp. 2 (Mbps) Network Utilization Exp. 3(Mbps) Average Network Utilization (Mbps) 19.499.089.879.5 222.9923.5123.0423.2 338.2936.5535.6236.8 442.2043.040.7042.0.

19. Average Network Utilization versus Number of Parallel Video Streams 01/13/2011NASA Grant URC NCC NNX08BA44A19

20. Audio 1)Audio Needs 2)FFMPEG 3)Phonon 4)QtMultimedia 206/13/2015NASA Grant URC NCC NNX08BA44A

21. Audio Needs 216/13/2015NASA Grant URC NCC NNX08BA44A Synchronization Quality

22. FFserver 226/13/2015NASA Grant URC NCC NNX08BA44A Multimedia streaming server for live broadcasts Limited to conventional audio players Limited sync window Limited update time Different behavior on different players and versions

23. Phonon 236/13/2015NASA Grant URC NCC NNX08BA44A Multimedia framework class module (MediaSource) “basic functions” Limited but open for specific needs

24. QtMultimedia 246/13/2015NASA Grant URC NCC NNX08BA44A Low-level multimedia function class module (QAudioInput, QAudioOutput) More options to expand on Phonon Conflict with current version

25. Audio 256/13/2015NASA Grant URC NCC NNX08BA44A

26. Audio Key Goals Phonon/Qt compatibility // Complete Successfully record/play an analog signal using Phonon // Complete Successfully open audio files // Complete Transmit encoded audio stream // In Progress Decode received streamed audio // In Progress Negate/minimize sync problems // Future Implementation 266/13/2015NASA Grant URC NCC NNX08BA44A

27. 3D 276/13/2015NASA Grant URC NCC NNX08BA44A Applications iTV Googles NVIDIA 3D Vision

28. Applications 286/13/2015NASA Grant URC NCC NNX08BA44A Educational Visual

29. iTV Goggles 296/13/2015NASA Grant URC NCC NNX08BA44A 80” Virtual Screen 3D Support Testing environments/applications

30. iTV Goggles 306/13/2015NASA Grant URC NCC NNX08BA44A

31. NVIDIA 3D Vision 316/13/2015NASA Grant URC NCC NNX08BA44A Shutter Glasses Panasonic HDC-SDT750 3D Camcorder MAGIX Movie Edit Pro 17 Plus Testing environments/applications

32. NVIDIA 3D Vision 326/13/2015NASA Grant URC NCC NNX08BA44A

33. NVIDIA 3D Vision 336/13/2015NASA Grant URC NCC NNX08BA44A

34. 3D Key Goals NVIDIA operational // Complete Successfully record/play 3D files using Panasonic camera // Complete iTV operational // In Progress Initialize 3D applications/functions // Future Implementation 346/13/2015NASA Grant URC NCC NNX08BA44A

35. What is OpenGL? Open Graphics Library (OpenGL) is a cross platform, C based standard Application Programming Interface (API) for rendering 3D graphics. OpenGL is used in CAD, virtual reality environments, and flight simulators. Purpose: To implement a touch screen enabled Graphical User Interface (GUI) that facilitates the interaction amongst application components. 6/13/2015NASA Grant URC NCC NNX08BA44A35

36. Investigation Flash vs. OpenGL Flash is a multimedia platform that can render 3D graphics, audio, and video content. Our target audience is everyone connected to the web, even cell phone users. Qt allows us this flexibility. On the other hand not all phones use Flash as a means to render their graphics. We will be implementing OpenGL since it is a library that is part of the Qt platform and will allow easy integrate any 3D rendering that we will need. 6/13/2015NASA Grant URC NCC NNX08BA44A36

37. Implementation and Future Work 6/13/2015NASA Grant URC NCC NNX08BA44A37

38. 2010-2011 Timeline 38NASA Grant URC NCC NNX08BA44A6/13/2015 20102011 MARAPRMAYJUNJULAUGSEPOCTNOVDECJANFEBMAR Sergio Beltran Active Directory DocumentationTesting and Optimization of Protocols Jorge Estrada Qt UDP Protocol Implementation Object Search Engine Multithreading Implementation Testing and Application Optimization Aleks Milshteyn Qt UDP Protocol Implementation Object Search EngineMPEG-2 Compression Implementation Active Directory Expansion FTP Implementation into UVC Adrienne Lam Tree Structure Implementation of Data Model Client side Tree Structure Implementation of Data Model Server Side Modification and Improved Functionality of GUI Testing and Application Optimization John Paul Tree Structure Implementation of Data Model Client Side Tree Structure Implementation of Data Model Server Side PostgreSQL Database Implementation Testing and Application Optimization Neil Arellano N/A Phonon Module / Player functionality Video/Audio Synchronization Sergio Mendoza N/A Phonon Module / Player functionality Video/Audio Synchronization

39. 2011 Timeline 6/13/2015NASA Grant URC NCC NNX08BA44A39 20112012 MARAPRMAYJUNJULAUGSEPOCTNOVDECJANFEBMAR Jorge Estrada System Integration and Optimization TBD Adrienne Lam Data MiningData Mining Optimization TBD John Paul Data MiningData Mining Optimization TBD Neil Arellano Audio Transmission and Compression Audio Optimization TBD Sergio Mendoza 3D Interface Prototypes 3D GUI Integration and Optimization TBD Gabriel Nunez OpenGL 3D GUI Development 3D GUI Integration and Optimization TBD Evan Tsai Audio Transmission and Compression Audio OptimizationTBD Aleks Milshteyn System Integration and Optimization TBD

40. Questions? 6/13/2015NASA Grant URC NCC NNX08BA44A40