1 Using CDX and the Exchange Network Services Roy Chaudet US Environmental Protection Agency Office of Environmental Information 2007 STORET/WQX Conference Austin, TX November 28

2  What is the Exchange Network?  Network Nodes and Web Services  What is CDX?  Services you use with WQX  Setting Up and Using Services  Questions Topics

3  What is the Exchange Network?  Network Nodes and Web Services  What is CDX?  Services you use with WQX  Setting Up and Using Services  Questions

4 What is the Exchange Network? An Internet and standards-based method for exchanging environmental information between partners Key Components Data Standards and Standard Protocols Nodes XML Schema/Registry Trading Partner Agreements Grant Program

5 Purpose of Network  Supports automated exchange of data  Enables timely and accurate exchange  Reduces reporting burden  Improves data quality

6 Types of Data Exchanges on the Network State-to-EPA  Facility Data to FRS  Water Quality Data to WQX  Drinking Water Data to SDWIS  Haz Waste Data to RCRAInfo  Air Emissions Data to NEI  Air Quality Data to AQS EPA-to-State  TRI Data Submissions  Substance and Chemical Data  Facility Data from FRS  Air Quality Data Intrastate Environmental Data to Health Departments Drinking Water Labs to States Homeland Security/Law Enforcement Data County Water Data State-to-State  Water Quality Data  Hazardous Waste Transporters  Air Quality Data  Homeland Security Data

7 Status of State Nodes October 2007 OperationalDevelopmentPlanning NodesClientsNodesClientsNodesClients States Tribes Territories Other Partners Total Many States/Tribes have Nodes You can exchange WQX Data through these Nodes! Many States/Tribes have Nodes You can exchange WQX Data through these Nodes!

8  What is the Exchange Network?  Network Nodes and Web Services  What is CDX?  Services you use with WQX  Setting Up and Using Services  Questions Topics

9 What is a Network Node? “A simple environmental information Web service that initiates requests for information, processes authorized queries, and sends/receives the requested information in a standard format.” – Is a Server accessible on the Web – Complies with the protocols to ensure secure exchanges – Sends and receives standards-based messages – Returns requested information as XML – Each partner has only one Node

10 Node Client Applications – Simplify access to services on full Network Nodes  Cannot listen (and respond) to requests from other nodes – Human-to-Machine interaction – Easy to install and use – Available in.NET and JAVA versions – Node Client Software Developer Kit (SDK) - simplifies integrating Node client functions (web service calls) with just a few lines of script

11 Node Client EPA JAVA/Velocity

12 Node Client Lite (Windsor -.NET)

13 Network Desktop (EPA -.NET )

14 Heartland Emergency Response Client (HERE)

15 Web Service  Definition: Information sources/application components whose functionality and interfaces are exposed to consumers using standard messaging protocols including: – Extensible Markup Language (XML) for the payload or file, – Simple Object Access Protocol (SOAP) as a wrapper for the payload, – Web Services Description Language (WSDL) for network exchange functions and services, and – Hypertext Transfer Protocol (HTTP) for secure communication via the internet Basically: A machine readable message

16  What is the Exchange Network?  Network Nodes and Web Services  What is CDX?  Services you use with WQX  Setting Up and Using Services  Questions Topics

17 What is CDX?  The Central Data Exchange (CDX) is the central point through which environmental data enters the Agency  EPA’s Node on the Environmental Information Exchange Network (Inflows and Outflows of Data to Partners)

18 CDX Exchange Mechanisms  CDX Web – EPA’s site for submitting environmental information via standard Web browsers – Users submit data via Web-based forms and file uploads (flat file, XML file) – Users receive submission confirmation/processing reports  CDX Node – EPA’s Web services infrastructure on the Exchange Network – Supports machine-to-machine data exchanges – Standardized Web service protocols and XML schemas used

19 Archive Data What Functions Does CDX Provide?  User registration  Authentication  Enhanced Security  Translation  Data validation EPA & Other Systems PC & Internet Browser Distribute Translate or Edit Validate Receive Submit XML, Binary or Flat-File Submit Web Services  Data publishing  Archiving  Distribution  Messaging services  Customer support

20 CDX Services Identity/ Access Management Confirm Origin of Submission Digital signature Encryption) Translate and/or Edit Data Format Conversion Performs simple or complex edit checks on files Creates multiple / different copies Provides copies of record to submitter Distribute Data to Target Systems Uses “push” or “pull” technologies Provides a variety of connections (e.g., VPN) Sends return messages and error notifications to users at several points Submit Web Forms Official copy Archives as needed Transaction Log Data Archive Registers users Help Desk Documentation EPA Systems Distribution Content Translation or Validation Signature/ Encryption Processing Authenticate & Authorize Submit XML, Binary, or Flat Files Web Services Receive Capture and Log Submission Data Audit trail Provides receipt Scan for viruses Service Gateway CDCHHS E-AuthCertificateAuthorities NAAS Security Services Quality Assurance Services ECMS AGENCYIdentityManagementServices Pay.Gov

21 User Benefits of CDX  Responds to Industry/state/program desires for a common point of exchange with EPA  Provides common registration process for industry  Provides standard interface and formats for users  Integrates receipt, security, translation, archiving and distribution functions  Maintains centralized customer support

22  What is the Exchange Network?  Network Nodes and Web Services  What is CDX?  Services you use with WQX  Setting Up and Using Services  Questions Topics

23 WQX/STORET Data Flow

24 CDX/Exchange Network Services You Use with WQX 1. Registration (Network) 2. Authentication and Authorization (NAAS) 3. Secure Document Exchanges 4. Data Reporting 5. Data Querying 6. Messaging (status, error) 7. Quality Assurance (validation) 8. Web Service Management (Monitor Services) 9. Internal Services: Archiving, Logging, Routing, Distributing, etc. Centralized, Shareable Web Service Components

25 1. Registration Node Account Setup 1. Registration Node Account Setup 4. Data reporting 5. Data querying 6. Validation 7. Messaging 8. Monitoring 9. Internal Services 4. Data reporting 5. Data querying 6. Validation 7. Messaging 8. Monitoring 9. Internal Services 1. Registration Web Account setup 1. Registration Web Account setup 2. Authentication/ Authorization 3. Secure exchanges 2. Authentication/ Authorization 3. Secure exchanges CDX/Exchange Network Services You Use with WQX

26  What is the Exchange Network?  Network Nodes and Web Services  What is CDX?  Services you use with WQX  Setting Up and Using Services  Questions Topics

27 Network Desktop Setup Obtain Node/ NAAS ID Obtain WQX Organization ID Obtain WQX Organization ID Download and install Network Desktop Ready to Submit

28 Network Desktop Submission Login Authenticate Submit Get Status Download report, correct errors, resubmit Download report, correct errors, resubmit Receive Success Status

29 Network Node Setup Obtain Node/ NAAS ID Obtain WQX Organization ID Obtain WQX Organization ID Ready to Submit 1 2 3

30 Network Node Submission Provide XML File to Submit to Node Administrator Receive Error Report from Node Administrator, Correct Errors, Resubmit* Receive Error Report from Node Administrator, Correct Errors, Resubmit* Receive Success Status from Node Administrator Talk to Your Node Administrator! *Node 2.0 can send status to user

31 Summary  Exchange Network and CDX have services being used by 50 states and 12 tribes  You can submit and query WQX data through the Exchange Network and CDX – Using a Full Network Node – Using a Network Desktop/ Node Client  In the future, you can 1. Generate an XML file using the XML Generation Tool and 2. Submit it via CDX web

32 Resources  EPA Exchange Network  Exchange Network  CDX  Node Help Desk – – 1-(888)  WQX Help Desk – – 1-(800)

33 Questions?

34 States with Multiple Data Exchanges MT WY ID WA OR NV UT CA AZ ND SD NE CO NM TX OK KS AR LA MO IA MN WI IL IN KY TN MS AL GA FL SC NC VA WV OH MI NY PA MD DE NJ CT RI MA ME VT NH AK HI