2001 Fall Simulation Interoperability Workshop Experiences with Data Distribution Management in Large-Scale Federations Bill Helfinstine Mark Torpey Deborah.

Slides:



Advertisements
Similar presentations
What Is An Operating System?. Before Operating Systems u What do you do with just computer hardware? –If someone gives you a computer with no software.
Advertisements

Kernel memory allocation
Towards Autonomic Adaptive Scaling of General Purpose Virtual Worlds Deploying a large-scale OpenSim grid using OpenStack cloud infrastructure and Chef.
7-1 INTRODUCTION: SoA Introduced SoA in Chapter 6 Service-oriented architecture (SoA) - perspective that focuses on the development, use, and reuse of.
Cache Coherent Distributed Shared Memory. Motivations Small processor count –SMP machines –Single shared memory with multiple processors interconnected.
Location Based Social Networking For All Presenter: Danny Swisher.
Artificial Learning Approaches for Multi-target Tracking Jesse McCrosky Nikki Hu.
CSC1016 Coursework Clarification Derek Mortimer March 2010.
Reference: Message Passing Fundamentals.
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
15-441: Computer Networking Lecture 26: Networking Future.
Parallel Simulation etc Roger Curry Presentation on Load Balancing.
Secure Multimedia Multicast: Interface and Multimedia Transmission GROUP 2: Melissa Barker Norman Lo Michael Mullinix server router client router client.
Network Traffic Measurement and Modeling CSCI 780, Fall 2005.
RFC 2453 RIP 2 (Routing Information Protocol) Daher Kaiss.
DDoS Attack Prevention by Rate Limiting and Filtering d’Artagnan de Anda CS239 Network Security 26 Apr 04.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
1 By Vanessa Newey. 2 Introduction Background Scalability in Distributed Simulation Traditional Aggregation Techniques Problems with Traditional Methods.
7/14/2015EECS 584, Fall MapReduce: Simplied Data Processing on Large Clusters Yunxing Dai, Huan Feng.
Garbage Collection and High-Level Languages Programming Languages Fall 2003.
Cutting the Electric Bill for Internet-Scale Systems Andreas Andreou Cambridge University, R02
Slide - 1 Dr Terry Hinton 6/9/05UniS - Based on Slides by Micro Analysis & Design An example of a Simulation Simulation of a bank: Three tasks or processes:
31 January 2007Craig E. Ward1 Large-Scale Simulation Experimentation and Analysis Database Programming Using Java.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved Chapter 6 Synchronization.
B.Ramamurthy9/19/20151 Operating Systems u Bina Ramamurthy CS421.
Military Simulation Case Study
5.1 Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED.
A Scalable Bandwidth Management Architecture for Supporting VoIP Applications Using Bandwidth Broker Zhenhai Duan, Zhi-Li Zhang University of Minnesota.
Presented by Xiaoyu Qin Virtualized Access Control & Firewall Virtualization.
14.1 – Policy and Strategy Issues
Architectural Support for Fine-Grained Parallelism on Multi-core Architectures Sanjeev Kumar, Corporate Technology Group, Intel Corporation Christopher.
Data Distribution Dynamic Data Distribution. Outline Introductory Comments Dynamic (Value based) Data Distribution: HLA Data Distribution Management –Routing.
Developments in networked embedded system technologies and programmable logic are making it possible to develop new, highly flexible data acquisition system.
Lecture Week 3 Frame Relay Accessing the WAN. 3.1 Basic Frame Relay Concepts Accessing the WAN.
1-1 Copyright © 2015, 2010, 2007 Pearson Education, Inc. Chapter 10, Slide 1 Chapter 10 Understanding Randomness.
1 Distributed Energy-Efficient Scheduling for Data-Intensive Applications with Deadline Constraints on Data Grids Cong Liu and Xiao Qin Auburn University.
Interpreting Demand and Capacity for Street and Highway Design Lecture 6 CE 5720 Norman Garrick Norman W. Garrick.
A Web-based Distributed Simulation System Christopher Taewan Ryu Computer Science Department California State University, Fullerton.
NHS – Enabling Change Improving processes and adding value 5th February 2015 Ian Quinnell Associate Director for Programme Management and Service Improvement.
Multicast instant channel change in IPTV systems 1.
1 Virtual Memory Main memory can act as a cache for the secondary storage (disk) Advantages: –illusion of having more physical memory –program relocation.
1 MMORPG Servers. 2 MMORPGs Features Avatar Avatar Levels Levels RPG Elements RPG Elements Mission Mission Chatting Chatting Society & Community Society.
Client/Server Model: A Business View The different Client/server implementations differ according to: 1.Where the processing for the presentation of information.
UNIT 2 LESSON 3 CS PRINCIPLES. OBJECTIVES Students will be able to: Construct a binary communication protocol for playing Battleship using the Internet.
1 Firewall Rules. 2 Firewall Configuration l Firewalls can generally be configured in one of two fundamental ways. –Permit all that is not expressly denied.
Overview of Jini CS Fall 2000 Jason I. Hong.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
IP Internet Protocol Fundamental packet format that computers use to exchange information. Is a set of technical rules that defines how computers communicate.
Computer Simulation of Networks ECE/CSC 777: Telecommunications Network Design Fall, 2013, Rudra Dutta.
Data Distribution. Outline Fundamental concepts –Name space –Description expressions –Interest expressions Static Data Distribution: HLA Declaration Management.
An Efficient Gigabit Ethernet Switch Model for Large-Scale Simulation Dong (Kevin) Jin.
Parallel and Distributed Simulation Data Distribution II.
Million Entity Distributed Simulations Improving network load by eliminating broadcast interest groups Presented by: David Prody.
1998 Spring Simulation Interoperability Workshop An approach to HLA Gateway/Middleware Development Naval Air Warfare Center Training Systems Division [Daniel.
Improving Primary Frequency Response Bob Green PDCWG August 3, 2011.
Diistributed Data Management DDM in HLA. Distributed Data Management HLA by default does one sort of interest management: functional. Your federate can.
DS-Grid: Large Scale Distributed Simulation on the Grid Georgios Theodoropoulos Midlands e-Science Centre University of Birmingham, UK Stephen John Turner,
Parallelizing Functional Tests for Computer Systems Using Distributed Graph Exploration Alexey Demakov, Alexander Kamkin, and Alexander Sortov
ASTRONAUT ROBOT MISSION SIMULATOR Presenter Corey Casado: Undergraduate Computer Science Major, Japanese Minor Mentors Winslow Burleson: Assistant Professor.
Christoph F. Eick: Thoughts on the Rook Project Challenges of Playing Bridge Well 
High throughput biology data management and data intensive computing drivers George Michaels.
Meeting with University of Malta| CERN, May 18, 2015 | Predrag Buncic ALICE Computing in Run 2+ P. Buncic 1.
Fall ‘99 Simulation Interoperability Workshop RTI Interoperability Study Group Final Report Michael D. Myjak, Chair.
By: Brett Belin. Used to be only tackled by highly trained professionals As the internet grew, more and more people became familiar with securing a network.
ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,
EE 193: Parallel Computing
Computer Simulation of Networks
CSCI1600: Embedded and Real Time Software
Death Match ’92: NUMA v. COMA
CSCI1600: Embedded and Real Time Software
Presentation transcript:

2001 Fall Simulation Interoperability Workshop Experiences with Data Distribution Management in Large-Scale Federations Bill Helfinstine Mark Torpey Deborah Wilbert Wayne Civinskas Lockheed Martin Information Systems Joint Experimentation and how it takes advantage of DDM and IP Multicasting

2001 Fall Simulation Interoperability Workshop What is Joint Experimentation and what makes it difficult? Exploration of possible changes in doctrine, organization, training, material, leadership and people to improve joint operations In order to explore jointness in an interesting way, a large scenario is needed Large geographic playbox Large number of vehicles to populate the playbox In order to support operators in the loop, real-time operation is needed In order to support large scenarios, large amounts of hardware and therefore space are needed Simulation distributed around the country to reduce cost

2001 Fall Simulation Interoperability Workshop What do we mean by “Large-scale federations” Large number of objects (> 30,000) Large number of federates (> 100) Large number of sites around the country (5 or more) Simulation synchronized with real-time clock Therefore, there is a very large amount of data in play which must be handled quickly and efficiently

2001 Fall Simulation Interoperability Workshop How can DDM help? DDM provides a means to tell the RTI what the federate is interested in. The RTI will do filtering on the data before the federate needs to get involved Provides a means to dynamically control the flow of data to the simulations The dynamicism of DDM provides a way to adapt to the changing data requirements of each simulation as the scenario progresses In a joint exercise, DM is often not powerful enough to describe the data requirements fully

2001 Fall Simulation Interoperability Workshop Example Geographic interest regions A B D C

2001 Fall Simulation Interoperability Workshop RTI implementations of DDM Distribute all subscription region information around to all federates, and do source filtering Include publication region information with each update/interaction and do receiver filtering Snap publication region to a grid and use the grid to do coarse filtering using the network itself With a gridded implementation of the DDM, IP multicasting can be employed IP multicast lets some or all of the filtering be done by the network hardware and operating system, to reduce load on the federate’s process. Just doing coarse filtering breaks the spec

2001 Fall Simulation Interoperability Workshop How has DDM helped Joint Experimentation? In previous JE events, total object count was much higher than a single federate could accept AO J STOW97 MaxObjects PerFederate Object Count Vehicle Count Federate Count Event

2001 Fall Simulation Interoperability Workshop MC02 challenges for DDM use Millennium Challenge 2002 will be run using RTI-NG, which does perfect filtering on receive, which interacts poorly with our historical use of DDM We have not come up with a solution yet that gives us the flexibility and scalability we have enjoyed in the past, due to RTI-s and its tuning specifically for scalability and its implementation of inset grids JSAF’s “Hyperspace” DDM scheme is hard to explain to other federate developers Some sort of DDM will probably be necessary due to the data requirements (>30,000 objects at >10 sites) Gateways to DIS or private protocols make DDM work very poorly

2001 Fall Simulation Interoperability Workshop Caveats of using DDM The design of the DDM scheme is fairly scenario- specific The operational design of the simulation usually does not take DDM into account Placement of opfor Centralized data collection Operational split by service means joint interaction happens over the WAN Many federates are designed to require all the data It is not easy to implement DDM support in a federate IP multicasting is not well supported by quite a bit of networking hardware

2001 Fall Simulation Interoperability Workshop Caveats continued Loggers and wide-range viewers make DDM ineffective Since they need to receive almost everything, DDM provides no filtering Clever data collection design can reduce the data an individual logger receives Exercise controllers really like map displays with everything on them The HLA 1.3 spec has a number of requirements that we have heretofore ignored, which significantly reduce flexibility and performance