1. Object Design Michael Fortson Augmented Reality/UI Team STARS Project
15-413
Object Design
Michael Fortson
Augmented Reality/UI Team
STARS Project
Carnegie Mellon University
23 November 1999 2
23 November 1999
Sticky Technology for Augmented Reality Systems

2. Presentation Overview
Scenario from Project Agreement
Hardware / Software Allocation
AR Subsystem Object Model
API Decisions
Sequence Diagram for Scenario
Development Status
23 November 1999
Sticky Technology for Augmented Reality Systems

3. Scenario – Initialization
Herb turns on his PEDD and establishes a network connection
He selects “Get Workorder” from the pulldown menu.
An authentication window appears, requesting username/password
After authentication, a workorder is retrieved, the UI is configured for an inspection.
23 November 1999
Sticky Technology for Augmented Reality Systems

4. Initialization – Continued
A calibration panel is added to the display
A model view is added to the display
The current view is from the front of the plane, approximately 5 feet from the ground
Herb walks to the front of the plane and aligns his own view with the plane
Herb clicks “finish calibration.”
Herb’s position/orientation are now reflected in the model view.
23 November 1999
Sticky Technology for Augmented Reality Systems

5. Sticky Technology for Augmented Reality Systems
Hardware Allocation
Diagram only
23 November 1999
Sticky Technology for Augmented Reality Systems

6. Sticky Technology for Augmented Reality Systems
Hardware Allocation
AR concerned with managing
HMD
PEDD
Orientation device
Positioning device
Other hardware is managed by other subsystems
23 November 1999
Sticky Technology for Augmented Reality Systems

7. Sticky Technology for Augmented Reality Systems
Object Model
UserInterface
UserInterfaceManager
AREvents
AREventListeners
Position and Orientation classes
Initiate or end calibration
23 November 1999
Sticky Technology for Augmented Reality Systems

8. Sticky Technology for Augmented Reality Systems
UserInterface
Clients provide two user interfaces
Full-Screen View
Large buttons
Detailed information
Windowed View
Minimal information
Designed to fit into one of the smaller panels.
23 November 1999
Sticky Technology for Augmented Reality Systems

9. Sticky Technology for Augmented Reality Systems
User Interface Mockup
23 November 1999
Sticky Technology for Augmented Reality Systems

10. UserInterfaceManager
UI Manipulation
Add (register) UI
Remove (unregister) UI
Change display status of UI
Subscribe to event classes
23 November 1999
Sticky Technology for Augmented Reality Systems

11. Sticky Technology for Augmented Reality Systems
Events
StickyEvent
Indicate placement of stickies.
VectorEvent
Indicate a changed position or orientation of the mechanic
UIStatusEvent
Indicates a change in the display of a UI element.
23 November 1999
Sticky Technology for Augmented Reality Systems

12. Sticky Technology for Augmented Reality Systems
EventListeners
Use addEventListener() from the UserInterfaceManager class to listen to events.
23 November 1999
Sticky Technology for Augmented Reality Systems

13. Position & Orientation
VectorDevice:
PositionDevice
Hardware device (GPS) or,
ScriptPosition may simulate movements.
OrientationDevice
Hardware device (3-axis Gyroscope) or,
ScriptOrientation may simulate head movements.
23 November 1999
Sticky Technology for Augmented Reality Systems

14. Sticky Technology for Augmented Reality Systems
AR Javadocs
Javadocs
23 November 1999
Sticky Technology for Augmented Reality Systems

15. Sticky Technology for Augmented Reality Systems
Services used by AR
Constructors and Destructors for:
DBClient
Created at initialization
Handles authentication and retrieval of data for other subsystems.
MaintananceControl
Responsible for beginning an inspection/repair session.
23 November 1999
Sticky Technology for Augmented Reality Systems

16. Sticky Technology for Augmented Reality Systems
Decorated Scenario
23 November 1999
Sticky Technology for Augmented Reality Systems

17. Sticky Technology for Augmented Reality Systems
Development Status
Analysis
Completed
Event model
User interface management
Doesn’t include a specific user interface, however
Initialization and termination sequence
Incomplete
User interface design
Many dependencies on the other subsystems
23 November 1999
Sticky Technology for Augmented Reality Systems

18. Sticky Technology for Augmented Reality Systems
Status – System Design
Completed except for specific user interface issues.
The newly formed/recognized UI subsystem is intended to complete this analysis and design.
23 November 1999
Sticky Technology for Augmented Reality Systems

19. Sticky Technology for Augmented Reality Systems
Status – Object Design
Completed except for miscellaneous implementation objects.
To be handled during implementation.
23 November 1999
Sticky Technology for Augmented Reality Systems

20. Status – Implementation
Begins ASAP (after Thanksgiving)
23 November 1999
Sticky Technology for Augmented Reality Systems