1. 1 Simulation Needs for Cyber Analytics 28-30 October PNNL-SA-63095

2. 2 Introduction Simulation Group Leads –Sandy Thompson –Laura Nolan

3. 3 Overview One of the Discipline Groups Group will –examine the analytical issues from the tracks –Identify issues that simulation can help address –Propose simulation solutions to address issues DCO session goal is to identify –Current capabilities –Requirements –Capability needs –General Information

4. 4 Please rate (high, med, low) how Simulation is doing in… TracksOverallWell defined need Requires research Importance Cyber Environment & 4 th Gen Cyber Situational Awareness & C2 Cyber Defense Cyber Exploitation and Offensive Ops Cyber Deterrence DoD Cyber Policy

5. 5 Current Capabilities What are current simulation tools? Characteristics of good tools –Fidelity, –Ease of use, –Cost,... Should tools be accredited by IO JMEMS? What sort of V&V is/should be required for Cyber Simulation tools?

6. 6 Simulation Questions 1. What variables need to be accounted for in simulations? –Human interfaces with networks –Applications (email, chat, VTC, …) –Data packets –Data flows –Network characteristics (bandwidth, routes, …) –Defensive countermeasures –Adversary activities (tools, culture, decisions, …) –Mission and Campaign impact (translation from technical effect) –Second and third order effects (connected systems)

7. 7 Simulation Questions 2. What systems should be simulated and where? –Computer network –Critical Infrastructures –Process control systems –Others –On the IO Range –Other ranges and testbeds

8. 8 Simulation Questions 3. Who is the target audience for cyber simulations? –Network/Software/Hardware designers –Network builders –System administrators –Cyber Ops planners and decision makers –Campaign analysts –Other analysts (Cyber Ops, vulnerability, network, system-of- systems, …) –End-host users –Business managers –POM Justification for funding requires translation from “geek-speak,” transparent methodology, and clear return on investment –…

9. 9 Requirements for Simulation Tools What sets of requirements are applicable? –Air Force –IO JMEM –… What requirements should be added?

10. 10 Needed Capabilities Areas in need of simulation –Campaign-level meaning Prototype tools Restrictions on cyber simulation –Minimal data (SAP/SAR/uncollected) Accreditation process –What should be included –Who should lead or participate

11. 11 General Needs Identify organizations who fund cyber simulation research Identify organizations who do or would be interested in cyber simulation research

12. 12 What are we missing?