Next Generation 4-D Distributed Modeling and Visualization of Battlefield Next Generation 4-D Distributed Modeling and Visualization of Battlefield Avideh.

Slides:



Advertisements
Similar presentations
Aerospace Engineering Department Texas A&M University, May/17/2002 VISNAV 3D (In Brief) Texas A&M University Aerospace Engineering Department May/17/2002.
Advertisements

Reported by Sujing Wang UH-DMML Group Meeting Nov. 22, 2010.
Introduction To Tracking
Location and Tracking Spring 2004: Location Recognition Larry Rudolph Location of what? Services applications, resources, sensors, actuators where.
(Includes references to Brian Clipp
DESIGN OF A GENERIC PATH PATH PLANNING SYSTEM AILAB Path Planning Workgroup.
Oklahoma State University Generative Graphical Models for Maneuvering Object Tracking and Dynamics Analysis Xin Fan and Guoliang Fan Visual Computing and.
AirMessages interactive density exploration Steven Strachan Hamilton Institute Roderick Murray-Smith University of Glasgow and Hamilton Institute
Haptic Rendering using Simplification Comp259 Sung-Eui Yoon.
GeoInformatics Discussion Group Betty Salzberg & Peggy Agouris.
Tracking and Data Fusion for 4D Visualization Ulrich Neumann Suya You Computer Science Department Integrated Media Systems Center University of Southern.
1 MURI review meeting 09/21/2004 Dynamic Scene Modeling Video and Image Processing Lab University of California, Berkeley Christian Frueh Avideh Zakhor.
Interactive and Collaborative Visualization and Exploration of Massive Data Sets ---- UC Davis Visualization Investigators: Bernd Hamann, Ken Joy, Kwan-Liu.
Direct Methods for Visual Scene Reconstruction Paper by Richard Szeliski & Sing Bing Kang Presented by Kristin Branson November 7, 2002.
Automated 3D Model Construction for Urban Environments Christian Frueh John Flynn Avideh Zakhor Next Generation 4D Distributed Modeling and Visualization.
Consistent Visualization and Querying of GIS Databases by a Location-Aware Mobile Client Luke Benedict SE521 March 4, 2009 A Look at the 2003 Paper by.
Testbed for Mobile Augmented Battlefield Visualization: Summing Up May 10, 2006.
1 Temporal Uncertainty Computation, Fusion, and Visualization in Multisensor Environments Pramod K. Varshney Kishan G. Mehrotra C. Krishna Mohan Electrical.
Uncertainty Quantification and Visualization: Geo-Spatially Registered Terrains and Mobile Targets Suresh Lodha Computer Science, University of California,
Visual Odometry for Ground Vehicle Applications David Nister, Oleg Naroditsky, James Bergen Sarnoff Corporation, CN5300 Princeton, NJ CPSC 643, Presentation.
Next Generation 4-D Distributed Modeling and Visualization of Battlefield Next Generation 4-D Distributed Modeling and Visualization of Battlefield Avideh.
Decision Making and Reasoning with Uncertain Image and Sensor Data
Virtual Worlds Lab Testbed for Mobile Augmented Battlefield Visualization September, 2003 Testbed for Mobile Augmented Battlefield Visualization September,
Uncertainty Quantification and Visualization: Geo-Spatially Registered Terrains and Mobile Targets Suresh Lodha Computer Science, University of California,
Uncertainty Processing and Information Fusion for Visualization Pramod K. Varshney Electrical Engineering and Computer Science Dept. Syracuse University.
InerVis Mobile Robotics Laboratory Institute of Systems and Robotics ISR – Coimbra Contact Person: Jorge Lobo Human inertial sensor:
Overview and Mathematics Bjoern Griesbach
MACHINE VISION GROUP Multimodal sensing-based camera applications Miguel Bordallo 1, Jari Hannuksela 1, Olli Silvén 1 and Markku Vehviläinen 2 1 University.
© Copyright 2005 Synthosys Synthosys 1 Federal Street L3 Ops Communications Bldg - ACIN Camden, NJ Contact: Linda Yu, President CEO (610)
Satellites in Our Pockets: An Object Positioning System using Smartphones Justin Manweiler, Puneet Jain, Romit Roy Choudhury TsungYun
INCAPS An Intelligent Camera-Projection System Framework Roberto Valenti Jurjen Pieters.
Reading Notes: Special Issue on Distributed Smart Cameras, Proceedings of the IEEE Mahmut Karakaya Graduate Student Electrical Engineering and Computer.
Consistent Visual Information Processing Axel Pinz EMT – Institute of Electrical Measurement and Measurement Signal Processing TU Graz – Graz University.
KinectFusion : Real-Time Dense Surface Mapping and Tracking IEEE International Symposium on Mixed and Augmented Reality 2011 Science and Technology Proceedings.
A General Framework for Tracking Multiple People from a Moving Camera
Exploitation of 3D Video Technologies Takashi Matsuyama Graduate School of Informatics, Kyoto University 12 th International Conference on Informatics.
Monitoring, Modelling, and Predicting with Real-Time Control Dr Ian Oppermann Director, CSIRO ICT Centre.
DTI Management of Information LINK Project: ICONS Incident reCOgnitioN for surveillance and Security funded by DTI, EPSRC, Home Office (March March.
Adaptively Sampled Distance Fields Representing Shape for Computer Graphics Ronald N. Perry and Sarah F. Frisken Mitsubishi Electric Research Laboratories.
1 Digital Design Center, College of Architecture, University of North Carolina at Charlotte The Charlotte Visualization Center, College of Computing and.
Next Generation 4-D Distributed Modeling and Visualization of Battlefield Next Generation 4-D Distributed Modeling and Visualization of Battlefield Avideh.
Use of GIS Methodology for Online Urban Traffic Monitoring German Aerospace Center Institute of Transport Research M. Hetscher S. Lehmann I. Ernst A. Lippok.
Forward-Scan Sonar Tomographic Reconstruction PHD Filter Multiple Target Tracking Bayesian Multiple Target Tracking in Forward Scan Sonar.
MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation 1 Dynamic Sensor Resource Management for ATE MURI.
A Brief Review of Theory for Information Fusion in Sensor Networks Xiaoling Wang February 19, 2004.
Summary of “Data Processing Algorithm for Generating 3D building Facade Meshes From Laser Scans and Camera Images”. An article by Christian Frueh, Siddharth.
 proposed work This project aims to design and develop a framework for terrain visualization flexible enough to allow arbitrary visualization of terrain.
Spring 2015 CSc 83020: 3D Photography Prof. Ioannis Stamos Mondays 4:15 – 6:15
Face Modeling, Expression Analysis, Caricature uncalibrated images Reconstructed 3D model Expression analysis from region models automated caricature Model.
Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.
HCI 입문 Graphics Korea University HCI System 2005 년 2 학기 김 창 헌.
Daniele D’Agostino CNR - IMATI - Sezione di Genova
AUTOMATIC TARGET RECOGNITION AND DATA FUSION March 9 th, 2004 Bala Lakshminarayanan.
Augmented Reality Authorized By: Miss.Trupti Pardeshi. NDMVP, Comp Dept. Augmented Reality 1/ 23.
Jack Pinches INFO410 & INFO350 S INFORMATION SCIENCE Computer Vision I.
Georgia Tech GVU Center Mobile Visualization in a Dynamic, Augmented Battlespace Mobile Visualization in a Dynamic, Augmented Battlespace William Ribarsky.
Uncertainty Computation,Visualization, and Validation Suresh K. Lodha Computer Science University of California, Santa Cruz (831)
10/31/ Simultaneous Estimation of Aircraft and Target Position With a Control Point Professor Dominick Andrisani Purdue University, School of Aeronautics.
Image-Based Rendering CS 446: Real-Time Rendering & Game Technology David Luebke University of Virginia.
Su-ting, Chuang 1. Outline Introduction Related work Hardware configuration Finger Detection system Optimal parameter estimation framework Conclusion.
3-D Mesh Morphing By Newton Der.
What is Multimedia Anyway? David Millard and Paul Lewis.
Next Generation 4D Distributed Modeling and Visualization Avideh Zakhor (UCB) Ulrich Neumann (USC) William Ribarsky (Georgia Tech) Pramod Varshney (Syracuse)
Kalman Filter and Data Streaming Presented By :- Ankur Jain Department of Computer Science 7/21/03.
Visual Information Processing. Human Perception V.S. Machine Perception  Human perception: pictorial information improvement for human interpretation.
BRAIN Alliance Research Team Annual Progress Report (Jul – Feb
SENSOR FUSION LAB RESEARCH ACTIVITIES PART I : DATA FUSION AND DISTRIBUTED SIGNAL PROCESSING IN SENSOR NETWORKS Sensor Fusion Lab, Department of Electrical.
Image Based Modeling and Rendering (PI: Malik)
On-board Perception for Intersection Safety Sergiu Nedevschi, Technical University of Cluj-Napoca, Romania European Commission.
Closing Remarks.
Presentation transcript:

Next Generation 4-D Distributed Modeling and Visualization of Battlefield Next Generation 4-D Distributed Modeling and Visualization of Battlefield Avideh Zakhor UC Berkeley June, 2002

Participants yAvideh Zakhor, (UC Berkeley) yBill Ribarsky, (Georgia Tech) yUlrich Neumann (USC) yPramod Varshney (Syracuse) ySuresh Lodha (UC Santa Cruz)

Battlefield Visualization zGoal: Detailed, timely and accurate picture of the modern battlefield zMany sources of info to build “picture”: yArchival data, roadmaps, GIS and databases: static ySensor information from mobile agents at different times and location: dynamic. yMultiple modalities: fusion zHow to make sense of all these without information overload?

Major Challenges: Data zDisparate/conflicting sources zLarge volumes. zInherently uncertain: resulting models also uncertain. zNeed to be visualized on mobiles with limited capability. zTime varying, time dependent and dynamic.

Mobile AR Visualization Laser Lidar Radar Camera GPS Maps Gyroscope-- 3D model construction with texture Visualization Database Model update Mobiles with augmented reality sensors Fusion/ Decision Making UNCERTAINTY

Research Agenda zModel construction and update zSensor tracking and registration zReal time visualization and multi-model interaction zUncertainty processing and visualization: zFusion used in all of the above.

Visualization Pentagon Information Fusion Information Fusion Uncertainty Processing/ Visualization Uncertainty Processing/ Visualization 4D Modeling/ Update 4D Modeling/ Update Visualization Database Visualization Database Tracking/ Registration Tracking/ Registration

Mobile AR Visualization Laser Lidar Radar Camera GPS Maps Gyroscope-- 3D model construction with texture Visualization Database Model update Mobiles with augmented reality sensors Decision Making

Model Construction for Visualization zDevelop a framework for 3D model construction for urban areas: y Easy, fast, accurate, automatic y Compact to represent; y Easy to render; zStrategy: yFusion of multiple data sources: intensity, range, heading, speedometer, panoramic cameras. yIncorporate apriori models, e.g. digital roadmaps. yRegistration, tracking and calibration.

3D Modeling: z Close-range modeling: y Ground based vehicle with multiple sensors z Far-range modeling: y Aerial/satellite imagery y Airborne Lidar data z Fusion of close range and far range info at multiple levels: y Data and models.

Combining Aerial and Ground Based Models Highly detailed model of street scenery & building façades 3D Model of terrain and building tops Complete 3D City Model Fusion Airborne Modeling Laser scans/images from plane Ground Based Modeling Laser scans & images from acquisition vehicle

Laser range scanners Digital roadmaps Aerial photos Ground Level Based Data Acquisition 2D laser scanners: horizontal and vertical Intensity camera (UCB) Hybrid DGPS Inertial sensors Cameras (USC)

Processing Ground Based Laser Data Histograms Segmentation Layer separation Interpolation

Resulting Models from Hole Filling Before hole filling After hole filling

Fusing Airborne model with ground based model Airborne Point cloud Ground based facade Merged airborne /façade model

6 DOF Pose Estimation for texture mapping with 3 DOF pose with 6 DOF pose

Static Texture Mapping Copy texture of all triangles into “collage” image Typical texture reduction: factor

Aerial view of projected image texture (campus of Purdue University) Sensor Image plane View frustum Dynamic Texture Projection on LiDAR Data Enables Real Time, Multi Source Data Fusion Requires accurate 3D model, sensor model, and texture/model registration Tracking and registration algorithms

Mobile AR Visualization Laser Lidar Radar Camera GPS Maps Gyroscope-- 3D model construction with texture Visualization Database Model update Mobiles with augmented reality sensors Decision Making

Hierarchical, multiresolution methods for interactive visualization of extended, detailed urban Scenes Block Façade 1 … Façade N LOD Hierarchy … … … Object M … … … Object 1 … … … … … … … City- organized hierarchy

Mobile AR Visualization Laser Lidar Radar Camera GPS Maps Gyroscope-- 3D model construction with texture Visualization Database Model update Mobiles with augmented reality sensors Decision Making

Multimodal Interface to Augmented Reality Systems Speech and gesture multimodal interface test setup Multimodal interface in action Infrared lights Camera with Infrared filter Gesture pendant (worn on chest) Demonstration of use of gesture pendant to recognize hand gestures

Mobile AR Visualization Laser Lidar Radar Camera GPS Maps Gyroscope-- 3D model construction with texture Visualization Database Model update Mobiles with augmented reality sensors Decision Making UNCERTAINTY

Visualization of Uncertain Particle Movement zUncertainty in initial position, direction and speed zUncertainty modeled by Gaussian distribution

Modeling and Visualization of Uncertainty zSpatio-temporal GPS uncertainty models : yNumber of accessible/used satellites ySNR (Signal to Noise Ratio) yDOP (Dilution of Precision) zReal-time visualization of GPS-tracked objects and associated uncertainty within VGIS

Low Uncertainty Line Preserving Compression OriginalUnconstrained Coastline preserving

Hierarchical Line Simplification Intersection preserving simplification

Mobile AR Visualization Laser Lidar Radar Camera GPS Maps Gyroscope-- 3D model construction with texture Visualization Database Model update Mobiles with augmented reality sensors Fusion/ Decision Making

Bayesian Networks with Temporal Updates Information flow Objective: To incorporate time-dependence of observations and evidence in Bayesian inference networks.

Temporal Fusion in Multi-Sensor Target Tracking Systems For a multi-sensor tracking system, sensors can be either synchronous or asynchronous (temporally staggered) T: Sampling interval of synchronous sensors T1: Time difference between sensor 1 and sensor 2 in asynchronous- sensor case T=T1+T2

Distributed Sequential Detection: minimize time/bandwidth needed for detection is the amount of bandwidth (bits) assigned to sensor i=1,2,…,M Local Sensor #1 Local Sensor #2 Local Sensor #M Fusion Center

Transitions (1) yGovernment: xInteractions with AFRL, ONR, NASA, NIMA xPresentations to President Bush and Gov. Ridge xPresentations to program directors at STRICOM yIndustry: x Raytheon, Lockheed Martin, Boeing, Sarnoff x HJW, Sick, Bosch, Astech, Airborne 1 x Sensis, Andro computing solutions x Olympus x Rhythm and Hues Studio

Publications (1) z C. Früh and A. Zakhor, "3D model generation for cities using aerial photographs and ground level laser scans", Computer Vision and Pattern Recognition, Hawaii, USA, 2001, p. II-31-8, vol.2. z H. Foroosh, “ A closed-form solution for optical flow by imposing temporal constraints”, Proceedings 2001 International Conference on Image Processing, vol.3, pp z C. Früh and A. Zakhor, "Data processing algorithms for generating textured 3D building façade meshes from laser scans and camera images”, accepted to 3D Data Processing, Visualization and Transmission, Padua, Italy, 2002 z John Flynn, “Motion from Structure: Robust Multi-Image, Multi-Object Pose Estimation”, Master’s thesis, Spring 2002, U.C. Berkeley z S. You, and U. Neumann. “Fusion of Vision and Gyro Tracking for Robust Augmented Reality Registration,” IEEE VR2001, pp.71-78, March 2001 z B. Jiang, U. Neumann, “Extendible Tracking by Line Auto-Calibration,” submitted to ISAR 2001 z J. W. Lee. “Large Motion Estimation for Omnidirectional Vision,” PhD thesis, University of Southern California, 2002

Publications (2) z J. W. Lee, B. Jiang, S. You, and U. Neumann. “Tracking with Vision for Outdoor Augmented Reality Systems,” submitted to IEEE Journal of Computer Graphics and Applications, special edition on tracking technologies, 2002 z William Ribarsky, “Towards the Visual Earth,” Workshop on Intersection of Geospatial and Information Technology, National Research Council (October, 2001). z William Ribarsky, Christopher Shaw, Zachary Wartell, and Nickolas Faust, “Building the Visual Earth,” to be published, SPIE 16 th International Conference on Aerospace/Defense Sensing, Simulation, and Controls (2002). z David Krum, William Ribarsky, Chris Shaw, Larry Hodges, and Nickolas Faust “Situational Visualization,” pp , ACM VRST 2001 (2001). z David Krum, Olugbenga Omoteso, William Ribarsky, Thad Starner, and Larry Hodges “Speech and Gesture Multimodal Control of a Whole Earth 3D Virtual Environment,” to be published, Eurographics-IEEE Visualization Symposium Winner of SAIC Best Student Paper award. z William Ribarsky, Tony Wasilewski, and Nickolas Faust, “From Urban Terrain Models to Visible Cities,” to be published, IEEE CG&A. z David Krum, Olugbenga Omoteso, William Ribarsky, Thad Starner, and Larry Hodges “Evaluation of a Multimodal Interface for 3D Terrain Visualization,”submitted to IEEE Visualization 2002.

Publications (3) z Justin Jang, William Ribarsky, Chris Shaw, and Nickolas Faust, "View-Dependent Multiresolution Splatting of Non-Uniform Data," pp , Eurographics-IEEE Visualization Symposium 2002 z C. K. Mohan, K. G. Mehrotra, and P. K. Varshney, ``Temporal Update Mechanisms for Decision Making with Aging Observations in Probabilistic Networks’’, Proc. AAAI Fall Symposium, Cape Cod, MA, Nov z R. Niu, P. K. Varshney, K. G. Mehrotra and C. K. Mohan, `` Temporal Fusion in Multi-Sensor Target Tracking Systems’’, to appear in Proceedings of the Fifth International Conference on Information Fusion, July 2002, Annapolis, Maryland. z Q. Cheng, P. K. Varshney, K. G. Mehrotra and C. K. Mohan, ``Optimal Bandwidth Assignment for Distributed Sequential Detection’’, to appear in Proceedings of the Fifth International Conference on Information Fusion, July 2002, Annapolis, Maryland. zSuresh Lodha, Amin P. Charaniya, Nikolai M. Faaland, and Srikumar Ramalingam, "Visualization of Spatio-Temporal GPS Uncertainty within a GIS Environment" to appear in the Proceedings of SPIE Conference on Aerospace/Defense Sensing, Simulation, and Controls, April zSuresh K. Lodha, Nikolai M. Faaland, Amin P. Charaniya, Pramod Varshney, Kishan Mehrotra, and Chilukuri Mohan, "Uncertainty Visualization of Probabilistic Particle Movement", To appear in the Proceedings of The IASTED Conference on Computer Graphics and Imaging", August 2002.

Publications (4) zSuresh K. Lodha, Amin P. Charaniya, and Nikolai M.Faaland, "Visualization of GPS Uncertainty in a GIS Environment", Technical Report UCSC-CRP-02-22, University of California, Santa Cruz, April 2002, pages zSuresh K. Lodha, Nikolai M. Faaland, Grant Wong, Amin Charaniya, Srikumar Ramalingam, and Arthur Keller, "Consistent Visualization and Querying of Geospatial Databases by a Location-Aware Mobile Agent", In Preparation, to be submitted to ACM GIS Conference, November zSuresh K. Lodha, Nikolai M. Faaland, and Jose Renteria, ``Hierarchical Topology Preserving Simplification of Vector Fields using Bintrees and Triangular Quadtrees'', Submitted for publication to IEEE Transactions on Visualization and Computer Graphics. zLilly Spirkovska and Suresh K. Lodha, ``AWE: Aviation Weather Data Visualization Environment'', Computers and Graphics, Volume 26, No.~1, February 2002, pp.~ zSuresh K. Lodha, Krishna M. Roskin, and Jose Renteria, ``Hierarchical Topology Preserving Compression of 2D Terrains'', Submitted for publication to Computer Graphics Forum.

Publication (5) zSuresh K. Lodha and Arvind Verma, ``Spatio-Temporal Visualization of Urban Crimes on a GIS Grid'',Proceedings of the ACM GIS Conference, November 2000, ACM Press, pages zChristopher Campbell, Michael Shafae, Suresh K. Lodha and D. Massaro, ``Multimodal Representations for the Exploration of Multidimensional Fuzzy Data", Submitted for publication to Behavior Research, Instruments, and Computers. zSuresh K. Lodha, Jose Renteria and Krishna M. Roskin, ``Topology Preserving Compression of 2D Vector Fields'', Proceedings of IEEE Visualization '2000, October 2000, pp

Cross Collaboration UCBUSCG.T.SYRUCSC Model const. & texture X X x Tracking & reg. & pose est. X X x Visualiza tion,rend ering x x X x Uncertain. processing x X x Uncertain. Visualizati on. x x X

Outline of Talks zA. Zakhor, U.C. Berkeley, "Overview" zC. Freuh, U.C. Berkeley, "Fast 3D model construction of urban environments" zU. Neuman, USC, "Tracking and Data Fusion for 4D Visualization" zBill Ribarsky, Georgia Tech, "4D Modeling and Mobile Visualization" z Lunch zPramod Varshney, Syracuse, "Temporal Uncertainty Computation, Fusion, and Visualization in Multisensor Environments" zS. Lodha, U.C. Santa Cruz, "Uncertainty Quantification and Visualization: Mobile Targets within Geo-Spatially Registered Terrains" zDiscussion, Feedback from Government