Image Processing In Physics By: Patrick Tracey and Austin Mann Summer Bridge, 2012 Appalachian State University

Pre-processing Re-sampling ❖ Change size ❖ Change resolution Noise Reduction ❖ Removes interference Normalization ❖ Converts information into coherent, relevant data Sharpening ❖ Increases resolution How Image Processing Works

Normal Processing Pixel counting Segmentation ❖ More relevant ❖ Easier to Analyze Edge Detection ❖ Identify specific objects Thresholding ❖ Simplest Segmentation ❖ Foreground vs. background ❖ Reduces Storage How Image Processing Works

Table of recorded data Graph of Collected Data MapGraphOriginal

Object Tracking Algorithms Used to track objects. Can track objects based on many variables. Many times, a Kalman Filter is used. Simplicity and Low Computational Demand Two types of Kalman Filters: − Extended Kalman Filter Has had success in Helicopter-like UAVs − Unscented Kalman Filter: Is linear, thus has had better prediction success.

SLAM Simultaneous Localization and Mapping algorithms Uses Landmarks and Terrain-aided navigation systems to build a “map” for the UAV

Simulated Navigation By analyzing the location of the orange cones, the computer was able to calculate the necessary path for the “UAV”. The Blue dots are the exact locations of the orange cones. The Red dots are the estimations of where the orange cones are based on the photographs analyzed. The Thin Red Line is the position of the “UAV” over time. Used UKF, a Stereo Camera, and an Inertial Measurement Unit to calculate a path in a Land marked laboratory. Dr. Langelaan Held the components in his hand, while a computer took pictures, analyzed the pictures, and predicted a path for Dr. Langelaan to follow.

Hand held devices & Reality Our Hand held devices are becoming more sophisticated. Many now come with Cameras, Gyro meters, accelerometers, and more. With these new devices, we can overlay Graphical User Interfaces over what we already can see. This enables us to augment what we see in many ways. We can now track with precision variables that were difficult for the human eye alone to track. We can use this in applications like games and education.

STUDIERSTUBE ES A platform for creating Augmented Reality applications. Created by Dr. Dieter Schmalstieg and Dr. Daniel Wagner of the Graz University of Technology. EXPEDITION SCHATZSUCHE An educational game developed for the Carinthia State Museum. Developed on STUDIERSTUDE ES. Tracks objects and markers to lead patrons through tasks and exhibits.

Below, a picture is taken of a piano. The hand held is able to analyze the picture and identify the piano, completing an task for the patron. Above, the hand held is able to use a marker as a reference point. Using the marker, it is able to judge which keys a patron needs to press in order to play music.

[1] LabAutoPedia. “Digital imaging/image analysis.” (accessed 7/19/12) [2] McAteer, James R.T. “Advanced Image Processing for Solar Physics.” (accessed 7/20/12) [3] Bovik, A. C. Handbook of Image and Video Processing (Communications, Networking and Multimedia) Elsevier Academic Press, 2005, p. 491 – 494 [4] Bento, Maria De Fatima. “Unmanned Aerial Vehicles: an Overview.” df (accessed ) df [5] Langelaan, J., Rock, S.: Navigation of Small UAVs Operating in Forests, Guidance, Navigation and Control Conference, August 16-19, 2004 [6] Langelaan, J., Rock, S.: Passive GPS-Free Navigation for Small UAVs, IEEE Aerospace Conference, Big Sky, Montana 2005 [7] Schmalstieg, D., Wagner, D.: “Mobile Phones as a Platform for Augmented Reality” (accessed ) [8] Schmalstieg, D., Wagner, D.: “Experiences with Handheld Augmented Reality” %2Fwww.icg.tu- graz.ac.at%2Fpublications%2Fpdf%2Fismar07keynotepaper%2Fat_download%2Ffile&ei=ODgUUIifIIau8QTbn 4CQBg&usg=AFQjCNGpOrpG4w47MNn1ZEJQ8uGmLQmnpA (accessed ) %2Fwww.icg.tu- graz.ac.at%2Fpublications%2Fpdf%2Fismar07keynotepaper%2Fat_download%2Ffile&ei=ODgUUIifIIau8QTbn 4CQBg&usg=AFQjCNGpOrpG4w47MNn1ZEJQ8uGmLQmnpA References

The National Science Foundation and the Summer Bridge Program for providing the opportunity for funding and learning. Dr. Rahman Tashakkori Dr. Barry Kurtz Dr. Alexander Schwab Dr. Jennifer Burris Any Questions? Acknowledgments