Presentation is loading. Please wait.

Presentation is loading. Please wait.

AQUAINT R&D Program: Phase I 18-Month Workshop WELCOME.

Similar presentations


Presentation on theme: "AQUAINT R&D Program: Phase I 18-Month Workshop WELCOME."— Presentation transcript:

1 AQUAINT R&D Program: Phase I 18-Month Workshop WELCOME

2 Advanced Question Answering Scenario Exercise Dr. John D. Prange AQUAINT Program Manager jprange@nsa.gov 301-688-7092 http://www.ic-arda.org

3 3 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Information Exploitation (Info-X) Presentation and Visualization Information Discovery Analytic Knowledge Information Retrieval Information Understanding Assessment and Interpretation Content Data Mark-up Content Data Transformation Synthesis and Fusion IC Analysts Data Filtering & Selection Reporting and Dissemination What Functions Does It Include? Info-X is Focused on Informational Content & Its Meaning And on Enhancing the IC Analyst’s Interaction with these Info-X Functions

4 4 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 “Providing answers to the questions analysts ask” “Pulling” Information Accept complex “Questions” in a form natural to the analyst Translate “Question” into multiple queries appropriate to the various data sets to be searched Find relevant information in distributed, multimedia, multilingual, multi-agency data sets Analyze, fuse and summarize information into a coherent “Answer” Provide “Answer” to analyst in the form they want I have plenty of Questions; It’s Answers that I need!! IC ANALYST

5 5 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 AQUAINT Advanced QUestion Answering for INTelligence What it is and What it is not... –Question & Answering Aimed at the “Information Professional” --- Not just the Casual User

6 6 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 For ARDA they are: –Government and Military Analysts But they could also be: –Investigative / “CNN-type” Reporters –Financial Industry Analysts / Investors –Historians / Biographers –Lawyers / Law Clerks –Law Enforcement Detectives –And Others Professional Information Analysts: Target Audience for AQUAINT -- Who are They? Professional Information Analysts

7 7 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 They are far more than just casual users of information They work in an information rich environment where they have access to large quantities of heterogeneous data They are almost always subject matter experts within their assigned task areas They track and follow a given event, scenario, problem, or situation for an extended period of time They are focused on their assigned task or mission and will do whatever it takes to accomplish it The end product that results from their analysis is often judged against the standards of: Timeliness AccuracyUsability Completeness Relevance Professional Information Analysts: What do They have in Common? Professional Information Analysts

8 8 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 AQUAINT Advanced QUestion Answering for INTelligence What it is and What it is not... –Question & Answering Aimed at the “Information Professional” --- Not just the Casual User –Full Range of Questions --- Not just Factoid Questions

9 9 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Increasing Complexity Levels of Questions & Answers Level 1 ”Simple Factual QA’s" Level 2 "Template & Multi-valued QA’s” Level 3 “Cross Media & Cross Document QA’s" Level 4 ”Context-Based QA Scenarios” Current Near TermMid TermLong Term AQUAINT: Intermediate Goals

10 10 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 AQUAINT Advanced QUestion Answering for INTelligence What it is and What it is not... –Question & Answering Aimed at the “Information Professional” --- Not just the Casual User –Full Range of Questions --- Not just Factoid Questions –Rich, Contextually-based Question Scenarios --- Not just Isolated Questions

11 11 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Overarching Context / Operational Requirement Who is this advisor? What do we know about him/her? What are his/her views? What influence does he/she have on FM? And still more questions ??? In a foreign news broadcast a team of analysts observe a previously unknown individual conferring with the Foreign Minister. They suspect that he/she is really a new senior advisor. Does this signal that other policy changes are coming? Intelligence Analysts AQUAINT Advanced QUestion Answering for INTelligence

12 12 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Overarching Context / Operational Requirement Advanced QA Extract & Analyze Results Deeper Automated Understanding Answers Interpret Results & Formulate the Answers Provide Answers in a Form Analysts Want Ranked Lists of “Relevant” Data Objects System Specific Queries; Fully Tailored to Series of Questions Extend Traditional Information Retrieval Multiple Heterogeneous Data Sources..... Multi-Media Structured Other Text Voice Interpreting Complex QA Scenario within a Larger Context Factoid Questions ? Why Questions ? Interpretive Questions? Judgement Questions? Other Questions? Information Analysts Predictive Questions ? AQUAINT Advanced QUestion Answering for INTelligence

13 13 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 AQUAINT Advanced QUestion Answering for INTelligence What it is and What it is not... –Question & Answering Aimed at the “Information Professional” --- Not just the Casual User –Full Range of Questions --- Not just Factoid Questions –Rich, Contextually-based Question Scenarios --- Not just Isolated Questions –Open Domain, Multiple Media, Multiple Languages, Multiple Genre, Structured and Unstructured Data --- Not just a Focused Data Environment

14 14 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 AQUAINT: Data Types Structured / Semi-Structured KB’sDB’s “Tagged Data” (e.g. Web Data) Unstructured Human Language Media Sensor Economic Geospatial Visual Data Video Still Images Text Documents Speech Multi-Media Technical / Abstract Other Newswire / News Broadcast Technical Formal / Informal Communication Other Language English Foreign Language 1 Foreign Language 2 Foreign Language N Genre

15 15 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 AQUAINT: Data Types Structured / Semi-Structured KB’sDB’s “Tagged Data” (e.g. Web Data) Unstructured Human Language Media Sensor Economic Geospatial Visual Data Video Still Images Text Documents Speech Multi-Media Technical / Abstract Other Language English Foreign Language 1 Foreign Language 2 Foreign Language N TREC QA Track DARPA’s RKF Commercial “Ask Jeeves” ARDA’s VACE ARDA’s GI2Vis DATA FOCUS OF RELATED QA PROGRAMS / ACTIVITIES DARPA’s DAML Newswire / News Broadcast Technical Formal / Informal Communication Other Genre DARPA’s TIDES & TDT

16 16 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 AQUAINT Advanced QUestion Answering for INTelligence What it is and What it is not... –Question & Answering Aimed at the “Information Professional” --- Not just the Casual User –Full Range of Questions --- Not just Factoid Questions –Rich, Contextually-based Question Scenarios --- Not just Isolated Questions –Open Domain, Multiple Media, Multiple Languages, Multiple Genre, Structured and Unstructured Data --- Not just a Focused Data Environment –Tackling fundamental, very difficult Information Exploitation Challenges

17 17 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Attacking the Data Chasm Future Fully Intersected; Automatically Generated; Variable Structure/ Format; Full Context Responses Full Context-Based Question Scenario Level III Full Context-Based Question Scenario Fully Intersected; Automatically Generated; Variable Structure/ Format; Full Context Responses Level II Variable Narrative Summary; Multi-Media Presentations; Simple Interpreted Results Cross Media Cross Document Simple Judgement Level I Fixed Templates or Tabular Lists Mulit-Valued Factual Questions Questions Answers Today 50/250 Byte Passage from Single Text Document Single Factual Isolated Questions Data Chasm Missing Data MANY Heterogeneous Data Sources; All Types, Sizes, Locations Increasing Volumes (Petabyte & up) Synthesis Across “Documents”/Media Contradictory Data Reliability of Data Multiple Perspectives

18 18 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Advanced Question Answering Scenario Exercise Analytic Task / Scenario Analyst Questions System Questions System Answers 2 Recorders Facilitator Researcher Analyst Participating Observers Advanced QA System Of the Future Analytic Strategy

19 19 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Advanced Question Answering Scenario Exercise Analytic Task / Scenario Analyst Questions System Questions System Answers 2 Recorders Facilitator Researcher Analyst 2 Oracles Participating Observers Analytic Strategy

20 20 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Advanced Question Answering Scenario Exercise Analytic Task / Scenario Analyst Questions System Questions System Answers 2 Recorders Facilitator Researcher Analyst 2 Oracles Participating Observers Advanced QA System Of the Future Analytic Strategy

21 21 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Analytic Tasks / Scenarios Common Characteristics: –Description of multi-faceted Information Need –Description of type and scope of the Analytic Output desired; Who is the ultimate customer; What Timeframe is available –Description of the Analyst and his/her background; Previous work experience that is relevant to current task –Three Different Scenario Focuses Scenario #1: Multiple Perspectives Scenario #2: Individual of Interest Scenario #3: Long Term Study of a Topical Area

22 22 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Analytic Strategy Analyst Describes Overarching Strategy for completing Assigned Analytic Task / Scenario; For Example this Strategy might include: –Types of information sources that might be consulted –What is his/her general expectation of the breadth/depth of information that needs to be collected, analyzed and then included in the final product –A breakdown of your total information needs required to complete the task – preferably in question form –The nature of the final product that is the target of the given scenario –How his/her time & effort would be allocated –The degree of review/consultation

23 23 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Subtask 1: Analyst’s “Questions” Using Analytic Strategy, Analyst chooses the first subtask to be completed and identifies a set of questions whose answers the analyst believes will allow the analyst to complete this subtask. –Analysts Questions are created without regard to the “capabilities” of the “Advanced QA System of the Future” –Analyst describes the type of answers that would satisfy the analyst –Analyst identifies (optionally) any knowledge that they are assuming that the system knows about the analyst or the assigned task

24 24 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Subtask 1: System “Questions” Since the Analyst has not worked with an “Advanced QA System of the Future” before, the analyst is fortunate to have the system’s developer, an AQUAINT Researcher, who knows the full capabilities of the system. –The Researcher may ask “Clarification” Questions of the Analyst –The Researcher will create a set of “System” Questions that the researcher believes can be successfully answered by the System. For instance the “System” Questions may be a decomposition of the “Analyst’s” Questions –Researcher will identify those Analyst questions that it believes are beyond the System’s Capabilities –Researcher will describe the type of answer that the Researcher is expecting the System to provide

25 25 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Subtask 1: Oracle Generated Answers Two Oracles (One Research and one Analyst) will take System “Questions” and will behind the scene in a Wizard-of-Oz fashion generate a System Response Answer –A summary of the Oracles’ activities be recorded but will not show the results of their internal browsing/searching to either the analyst or researcher. –“You didn’t specifically ask for this, but I thought you (the Analyst) might find this of interest – Do you want me to follow-up on this information?” –“I found multiple answers to your question. This is the answer that I believe is more likely correct and here is why I believe that or I can’t determine which answer is correct, so am reporting alternative answers. What do you want me to do next? –“I can not find an answer to your question. I did (or did not) find a partial answer. How would you like me to proceed?”

26 26 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Subtask 1: Analyst Responds to “System Answers” To each Answer provided by the System (aka “the Two Oracles”), the Analyst may respond –“What is the source/date of the information contained in the answer?” –“What is the justification for a given answer?” –Ask a direct follow-up question that provides “clarification” / “fills in the blanks”. At the conclusion of given Subtask, the Analyst provides an assessment: –How well did the System’s Answers satisfy the given Subtask information needs –To what extent have future subtasks been altered because of the System’s Answers to date

27 27 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Advanced QA Scenario Exercise Other Roles Facilitator: –Keeps things moving; Exercise Driven by a single Analyst and single Researcher –Goal is to complete 2-3 Complete Subtasks –Allow about 30-minutes at end of exercise for open Team-wide discussions / observations / comments –Make sure that focus remains on analytic process, not on technical, system-related issues Two Recorders: –One records questions & answers on flip chart for all to see –Second one records other significant activities / comments / observations during exercise –Share duties during wrap-up Participating Observers –Avoid attempting to redirect exercise –Offer observations / comments / alternatives during wrap-up

28 28 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Advanced QA Scenario Exercise Logistics Nine total teams – each approximately 12-15 workshop attendees – everyone has been pre- assigned Three Different Scenarios each having three separate teams completing that given scenario Last Session on Wednesday – Each of the three teams that worked the same scenario will meet and compare / contrast their experiences Thursday morning there will be a Plenary Session during which each Scenario will report out what they learned. Assignments on Handout

29 29 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario Exercise Sample SCENARIO You are an expert on Latin America but have focused your efforts on Cuba and Brazil. You have been asked by the Under Secretary of State for Latin American Affairs to use your familiarity with Latin culture and politics to assess the current situation in Colombia and FARC’s role in destabilizing the country. The report is due by COB tomorrow. Your time is short but you need to familiarize yourself with the issues before feeling confident that you can report on FARC’s current situation.

30 30 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Analyst’s Strategy Example Sources that might be consulted: –Material from classified collection sources –Database of published intelligence products –Cable traffic from State Department and US Military –Open Internet Sources –Internal working aids –FBIS Scope of Analysis –Definition of FARC; Background –Goals of FARC –Related/Affiliated Organizations –Political Influence of FARC –US Position on FARC vis a vis FARC’s role in Columbia; vis a vis Columbian Government attempts to control the FARC Nature of Final Analytic Product –Position/Point Paper with supporting documentation

31 31 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Analyst’s Strategy  Questions 1.What does the acronym FARC stand for? 2.What is the nature of the FARC? 3.When was the FARC founded? 4.Where is it located? 5.How large is the organization, where is it located and who are some of the members? 6.What activities have they been involved in? 7.What are their goals? a.How do others view them? b.How do they view themselves? 8.Where do they get their funding? 9.What associations do they have with other organizations, inside and outside Colombia? 10.What political influence have they had in Colombia? 11.What has been the Colombian policy with respect to this group? 12.What has the Colombian government done to defeat the group? 13.What is the US position with respect to the organization? 14.Has this position changed? 15.How has the US influenced Colombian policy toward the organization?

32 32 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Subtask #1 - Analyst General Information About the FARC 1.What does FARC stand? 2.Where is it located? 3.What is the nature of the FARC? 4.When was the it founded? 5.How large is the organization and who are some of its members?

33 33 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Subtask #1 - Researcher General Information About the FARC 1.What does FARC stand? What does the acronym FARC stand for? 2.Where is it located? In what countries where the FARC has members? … conducts activities? In what geographic regions where the FARC has members? … conducts activities? In what departments …? In what cities … ? In what country (geographic region, department, city) is the largest concentration of FARC members? … of FARC associated activities? 3.What is the nature of the FARC? What type of organization is the FARC? What type of activities have been associated with the FARC? What organizations supports the FARC? What organization oppose the FARC?

34 34 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Subtask #1 - Researcher General Information About the FARC 4.When was the FARC founded? When was the FARC founded? Why was the FARC founded? Was the FARC a splinter group of another organization? If so, what organization? What was the reason for the split? Where was the FARC founded? List the names of individuals who founded the FARC? Are any of these individuals still active members of the FARC? 5.How large is the organization and who are some of its members? What is the total membership of the FARC? What is the source of this information? What is the source date of this information? Who are the leaders of the FARC? What are their positions? List the names of other members of the FARC?

35 35 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Other Possible Follow-on Subtasks Subtask #2: –The Goals and Objectives of the FARC Subtask #3: –Identify funding sources for the FARC and the FARC’s links with other organizations Subtask #4: –The Political / Economic / Military influence of the FARC –Columbian Government’s policy towards the FARC; Columbian Government’s activities aimed at defeating the FARC Subtask #5: –US Government’s evolving position on the FARC

36 36 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario #1 – Group 1 Point Loma 1 PARTICIPATING OBSERVERS PLAYING ROLES Geoff Bransford-Koons, SAIC Analyst: Chris Wachter, DoD Jamie Callan, CMU ##Researcher: Dan Moldovan, LCC Herb Gish, BBN Technologies Oracle Analyst: Mark Mollere, USNR Robert Hecht-Nielsen, Fair Isaac Corp Oracle Researcher: Bjoern Aldag, Cycorp Steve Helmreich, NMSUFacilitator: John Donelan, US Gov Paul Kantor, Rutgers Univ.Recorder #1: Pat Schone, DoD Liz Liddy, Syracuse Univ.Recorder #2: Mark Maybury, MITRE

37 37 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario #1 – Group 2 Point Loma 2 PARTICIPATING OBSERVERS PLAYING ROLES Teresa Buss, SAICAnalyst: Stephen Wiley, USNR Noah Friedland, VulcanResearcher: Kathleen McKeown, Columbia Univ. John Gilmore, Veridian Sys. Oracle Analyst: Robert Buelow, USNR Jerry Hobbs, USC-ISIOracle Researcher: Bill Ogden, NMSU Emmanuel Roche, Teragram Facilitator: Ellen Voorhees, NIST Nina Wacholder, Rutgers Univ. Recorder #1: Jean-Michel Pomarede, US Gov Howard Wactlar, CMURecorder #2: Dennis Lair, DoD

38 38 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario #1 – Group 3 Point Loma 1 PARTICIPATING OBSERVERS PLAYING ROLES Paulo Pinheiro da Silva, Stanford Univ. Analyst: John Rogers, USNR Christiane Fellbaum, Princeton Univ. Researcher: Stefano Bertolo, Cycorp Max Louwerse, Univ. of Memphis Oracle Analyst: Stephen Plaisance, USNR Teruko Mitamura, CMUOracle Researcher: Kevin Knight, USC-ISI Rong Tang, Univ. of Albany Facilitator: John Prange, ARDA Paul Thompson, Dartmouth College Recorder #1: Steve Maiorano, US Government Wayne Ward, Univ. of Colorado Recorder #2: Nahum Gershon, MITRE

39 39 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario #2 – Group 1 Point Loma 1 PARTICIPATING OBSERVERS PLAYING ROLES Tim Anderson, AFRL ##Analyst: Anita Kulman, DoD Steven Bethard, Univ. of Colorado Researcher: Tomek Strzalkowski, Univ. of Albany Alex Hauptmann, CMUOracle Analyst: Donald Maixner USNR Tanya Korelsky, CoGenTexOracle Researcher: Barbara Starr, SAIC Peter LaMonica, AFRLFacilitator: Scott Mardis, MITRE Jim Van Sciver, BBN Technologies Recorder #1: Grace Crowder, DoD Gina Taranto, SPAWARRecorder #2: Robert Means, Fair Isaac

40 40 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario #2 – Group 2 Point Loma 2 PARTICIPATING OBSERVERS PLAYING ROLES Jerome Feldman, UC Berkeley Analyst: Margaret Dillard, DoD Syrus Nemat-Nasser, Fair Isaac Researcher: Eric Nyberg, CMU Kwong Bor Ng, Rutgers Univ. ## Oracle Analyst: Michael Malone USNR Sergei Nirenberg, UMBCOracle Researcher: Sharon Small, Univ. of Albany Yves Schabes, TeragramFacilitator: Carol Van Ess-Dykema, DoD Barry Sheraw, LCCRecorder #1: Scott Miller, BBN Recorder #2: Robert Irie, SPAWAR

41 41 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario #2 – Group 3 Del Mar PARTICIPATING OBSERVERS PLAYING ROLES Ryan Ghiz, DoDAnalyst: Carmen Vazquez, DoD Robert Gottlieb, SPAWARResearcher: Daniel Marcu, USC-ISI Sanda Harabagiu, LCCOracle Analyst: Jay Peltz, DoD David Israel, SRIOracle Researcher: Boris Katz, MIT Penny Lehtola, ARDAFacilitator: Richard Tong, Tarragon Peng Song, Rutgers UnivRecorder #1: Bob Tarr, DoD Yiming Yang, CMURecorder #2: Jean Scholtz, NIST:

42 42 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario #3 – Group 1 Point Loma 1 PARTICIPATING OBSERVERS PLAYING ROLES David Evans, ClairvoyanceAnalyst: David Lee, USNR Richard Fikes, Stanford Univ. ## Researcher: Ralph Weischedel, BBN Technologies Paul Girard, SAICOracle Analyst: Kelcy Allwein, DIA Rich Quadrel, PNNLOracle Researcher: Vasileios Hatzivassiloglou, Columbia Univ. Rion Snow, Fair IsaacFacilitator: Donna Harman, NIST Ying Sun, Rutgers Univ.Recorder #1: Ruth Gee, US Government Boris Yamron, Lehman College Recorder #2: David Salak, USNR

43 43 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario #3 – Group 2 La Jolla PARTICIPATING OBSERVERS PLAYING ROLES Jaime Carbonell, CMUAnalyst: Chris Decker, US Gov. Susan Dumais, Microsoft Research Researcher: John Prager, IBM Ulf Hermjakob, USC-ISIOracle Analyst: Frank Hughes, DIA Shailesh Kumar, Fair IsaacOracle Researcher: Jim Cowie, NMSU Christopher Manning, UC Berkeley Facilitator: John Burger, MITRE Nitya Sethuraman, Northrop Grumman IT Recorder #1: Duncan McCarthy, NIMA Richard Waldinger, SRIRecorder #2: Michael Raine, USNR

44 44 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Scenario #3 – Group 3 The Bay PARTICIPATING OBSERVERS PLAYING ROLES Benoit Lavoie, CoGenTexAnalyst: Jeff Juhnke, DIA John Lehmann, LCCResearcher: Ed Hovy, USC-ISI Charles Messenger, AFRLOracle Analyst: Heather Long, DIA George Miller, Princeton Univ. ## Oracle Researcher: Bruce Croft, UMass Robert Rittman, Rutgers Univ. Facilitator: Heather McCallum- Bayliss, ARDA Bhavani Thuraisingham, NSF Recorder #1: Mike Blair, DoD Jan Wiebe, Univ. of Pittsburgh Recorder #2: Beth Sundheim, SPAWAR

45 45 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Breakout Locations BY ROOM Point Loma 1 –Group 1-1 –Group 1-3 –Group 2-1 –Group 3-1 Point Loma 2 –Group 1-2 –Group 2-2 DelMar –Group 2-3 LaJolla –Group 3-2 The Bay –Group 3-3 BY GROUP Group 1-1Point Loma 1 Group 1-2Point Loma 2 Group 1-3Point Loma 1 Group 2-1Point Loma 1 Group 2-2Point Loma 2 Group 2-3DelMar Group 3-1Point Loma 1 Group 3-2LaJolla Group 3-3The Bay

46 46 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Questions / Comments

47 47 AQUAINT Ph I 18-Month Wkshp – 9-12 June 2003 Contact Information Dr. John Prange, AQUAINT Program Director ARDA Web Pages:http://www.ic-arda.org Emailarda@nsa.gov JPrange@nsa.gov Phones:301-688-7092 800-276-3747 301-688-7410 (Fax) Mailing:ARDA (RA) Room 12A69 NBP#1 STE 6644 9800 Savage Road Fort Meade, MD 20755-6644


Download ppt "AQUAINT R&D Program: Phase I 18-Month Workshop WELCOME."

Similar presentations


Ads by Google