AMIPS: The Anywhere, Multipurpose Image Projection System Nicholas Lord Budirijanto Purnomo Paul Alan Roberts Johns Hopkins University Department of Computer Science CISST Division CISST Division

What’s Been Done February Obtained access to CIRL Lab and ERC Installed necessary environment for XVision, Matlab, and Mathematica Performed Camera Calibration with Matlab

March 1 st -15 th Used XVision to manipulate raw images obtained from live video camera Wrote simple program that can capture images via firewire camera and manipulate Built a prototype of AMIPS display board Experimentation of color segmentation with XVision

March 15-Present Day Project split 3D Pose estimation (Paul) Smarter presentation implementation (Nick) Correcting Distortions using Graphics Hardware (Budi )

3D Pose It is necessary to calculate the 3d position to calculate the prewarp map for the hardware rendering. Currently the equation solutions are handled with mathematica programming

U1 = X1*f/Z1, U2=x2*f/Z2… up to U4 V1= Y1/*f/Z1…up to V4 Thus we have 8 equations and 12 unknowns Constrain system by incorporation of the known size of the board L = sqrt( [x1-x2]^2 + [Y1-Y2]^2 + [Z1-Z2]^2)

Progress 3D Pose Early theory success Structure of algorithm 12 nonlinear simultaneous equations that constrain the position. Mathematica solver Condition: 8/10

Correcting Distortions caused by Oblique Projection using Graphics Hardware Basic goal: Take an image and texture map the distorted image onto the image thereby removing the artifacts and distortions

Progress Graphics Hardware Algorithm nearly completed: –We have a working model which dewarps the image Possible problems: Condition 9/10

Smarter Presentation If the projection screen is flat, it is possible to directly establish the relationship between the camera and projector through comparing camera images and projector slides

Pictorial Representation

Progress Smarter Presentation Current position: Prewarp mapping calculated Work to complete: – Debugging –Blend Algorithm Condition: 6/10

What’s next? Stringing these methods together Testing Implementation. Solving the broad projection problem

Solution Find part of image that needs to be projected Project only that small part onto the board

Dependencies Continued use of computer labs and funding. IBM dependency totally removed. Continued use of projector and camera for project

Final Words We are in a very pivotal position at the current time. One major goal to accomplish –Three goals to wrap up