1. Trouble-shooting with MOM
Supporting features in MOM for the evaluation of data content, data formatting, and messaging statuses

2. Background Knowledge
HL7 and XML formats Previous introduction to the MOM user interface and the Messages tab Familiar with the basic interaction between SCC and external applications

3. Presentation Description
Describe the ESB architecture and the content of the MOM user interface Messages screen
Since most installations will have ESB reporting components, the focus for this presentation will be on the TEST_RELEASED event to Result Reporting processes.
ESB-MOM replaces legacy outbound interfaces for all 4.5 Lab as well as Standalone Gene implementations
For Gene standalone implementations, legacy inbound interfaces are replaced by ESB processes as well.
Provide guidance for trouble-shooting issues of result content, formatting, and status
The MOM user interface provides a view of the stored and retrieved records created during the routing of messages between applications and databases.
Since the ESB replaces legacy outbound interfaces for all 4.5 Lab as well as Standalone Gene implementations, the MOM GUI tool is the primary tool for trouble shooting Result Reporting.
For Gene standalone implementations, legacy inbound interfaces are replaced by ESB processes as well. For the purposes of this presentation, the focus will be on Result Reporting

4. Outline MOM/ESB Integration overview
Events, sources, and destinations for Result Reporting
MOM GUI and Messages tab
First, show Result Reporting processing functions
Second, describe functions for each process
Next, go through three types of problems and where to check for data about the issue
CONTENT PROBLEMS
FORMAT PROBLEMS
STATUS PROBLEMS

5. Overview of ESB/MOM
Message Flow

6. Events, sources, and destinations
For this power point, we’ll focus on the TEST_RELEASED event, when a result in LAB/MIC is verified or a GIS report is signed out.
MOM Messages view shows:
Parent event TEST_RELEASED with Source (e.g.)
Destinations including RDC Result Data Collector
Destinations status response to MOM
Child event TEST_RELEASED based on payload from destination and routing configuration

7. Events, sources, and destinations
Viewing the same data flow in MOM Messages tab

8. TEST_RELEASED event’s Sources and Destinations
Parent TEST_RELEASED
SOURCE: BB/BIO/FLW/CTG/DXP/MOL/HLA/IWS:
DESTINATION:
“WS.ESB.RES_COLLECTOR” = Result Data Collector
Child TEST_RELEASED
SOURCE: GIS/BB
DESTINATIONS:
“WS.SCC.ESB.INT.IRR.LAB” = Result Reporting to Lab from Gene Suite or IWS
“WS.SCC.ESB.INT.UPD.SWP” = Update SoftWebPlus
“WS.SCC.ESB.INT.CLU.CSM” = Update Call list application
“WS.CLIENT.OUT.HIS.RR” = Result Reporting to HIS (for BB, Standalone Gene Suite and for Supplemental results)
Parent TEST_RELEASED with SOURCE = LAB:
“WS.SCC.ESB.INT.IWS.NOTIFY” = Notify IWS of results for test with IWS component
“DB.SCC.LAB.STATUS.MONITOR” = Update Order Status Monitor db
Child TEST_RELEASED triggered when “WS.ESB.RES_COLLECTOR” returns data
SOURCE: LAB
“WS.SCC.OUT.AR.RR” = Result Reporting to SoftAR
“WS.CLIENT.OUT.HIS.RR” = Result Reporting to HIS

9. TEST_RELEASED event’s Sources and Destinations
Destination “WS.ESB.RES.COLLECTOR”
Pulls all data regarding the ordered test into a “canonical” format
Patient data
Order data
Specimen data
Result data
Discrete for LAB/MIC
Discrete/Textual for GIS technologies
This is easiest to view with the XML link provided with the Child TEST_RELEASED event

10. TEST_RELEASED event’s Sources and Destinations
Destination “WS.SCC.ESB.INT.IRR.LAB”
Result Reporting to Lab from Gene Suite
What does this do?
Calculates status
Updates
Status: FINAL, CANCELED, PENDING/PRELIMINARY
Component result value
“See” or “InProcess” or “Final” or “Cancelled” {technology}
Verification (Sign out) TS when status FINAL/CANCELED
Verified by (Sign out user ID, not viewable in Lab GUI) when status FINAL/CANCELED
Observation TS and Observer Tech ID updated for any status (Result type only)

11. TEST_RELEASED event’s Sources and Destinations
Destination “WS.CLIENT.OUT.HIS.RR”
Result Reporting to Lab from Gene Suite
What does this do?
Does test qualify to be sent to this HIS?
Output-specific rules, e.g.
Cancelled observation format
Inclusion of comments or placement of comments
Create Lab/Mic/BB/Gene DSP segments
Re-format to HL7
Translation Services for HIS coded elements
Pull genindex information, e.g. HIS Placer number

12. Result Reporting processes
ESB SND – SCC is transitioning to an ESB-based SND communicating interface. Required for
Stand-alone Gene implementations
Outputs with an embedded PDF

13. Result Reporting processes – Other
Other exceptional processes may be defined
E.g. CCHS example which checks final status of the entire order

14. Problem Topics
Let’s look at three categories of reporting issues that might come up and how we may isolate the problem within one of these processes as viewed via the MOM Console
Data Content
Data formatting
Message processing status

15. Result Content Problems
Example: missing or incorrect result for a component: Usually, this is an output specific issue and can be found by checking the Details section of the *.RR Destination:
The Details in MOM use to be somewhat cryptic; they are getting better

16. Result Content Problems
Example: missing or incorrect result for a component:
Troubleshooting suggestion to isolate the specific TEST_RELEASED message:
Use search criteria that are specific to the order, the TEST_RELEASED event, the destination, and choose Child message only

17. Result Content Problems
Search criteria

18. Result Content Problems
Example: No URL sent with discrete result
Again, check the Details section of the Child TEST_RELEASED message. In this case, no note is viewed, so check the XML next – this is the payload provided by the Result Data Collector (RDC)

19. Result Content Problem
Example: No URL sent with discrete result
In this case, you find the clue:

20. Result Content Problem
Translation Service issues
Test codes
Field Mappings
Some Translation Service warnings are printed in the Details section. To see all in the trace, open the *.RR trace and select the Translation record:

21. Result Content Problem
Canceled Test results are converted by the *.RR interface:
Auto-default dotted results
Manually dotted results
“.XYZ” results
Check the Details or the before (XML) & after (HL7)

22. Result Format Problems
Which process creates the display formatting depends on the application:
Gene Suite display text is an ascii version of the actual report and is collected by the RES_COLLECTOR (RDC).
Look for the DSP sections in the XML of the child message

23. Result Format Problems
Which process creates the display formatting
depends on the application:
MIC display text is formatted now by the ESB *.RR interface. With legacy RR, this was performed by a MIC process and provided to the legacy RR.
BB display text is also formatted now by the ESB *.RR interface.
Go to the HL7 (Green flag) or the Destination trace to see the DSP as the XML will not have the DSP

24. Result Status Problems
Trouble-shooting a missing result or checking on a Problem List item You may want to see if a message has been sent and if not what may be holding it up in MOM. To do this, you will check to see if the messaging in MOM is in a Delivered status and if the HL7 message (Green Flag icon) has been set.

25. Result Status Problems
First, know the possible Destination statuses returned to MOM:
OK  OK
DATA_ERROR  NOT OK, required intervention
TRANSPORT ERROR  NOT OK, may be temporary
WAIT_FOR_ACK  OK, until it isn’t
UNDELIVERABLE  OK
SKIPPED = MOM skipped this destination  OK
SKIPPED_BY_DEST = Destination skipped further processing  OK
SKIP_FAILED  Warning, check Details, may be setup issue
RESOURCE_BUSY = Temporary application problem, e.g. locked record  NOT OK, often temporary
TIMEOUT_ERROR  NOT OK, often temporary

26. Result Status Problems
Message life cycle in terms of the status: when an event message is sent to MOM such as a TEST_RELEASED event:
-MOM will give it an initial SEND status.
-Once the message is sent to the Destinations, a PENDING status is assigned.
HAPPY DAY SCENARIOS
-If the message is processed without error a DELIVERED status is assigned.
-If the message has no appropriate mapping it is placed in a UNDELIVERABLE status
NOT SO HAPPY DAY SCENARIOS
-If there is a problem that requires MOM to automatically re-send, then the status of WAIT is assigned.
-But if there is a unavoidable problem or the re-send limit is exhausted, then the message is placed in a HOLD status and must be handled manually, either Canceled or Manually sent.

27. Result Status Problems
MOM will place a message in DELIVERED status when it receives the following Destination Result codes:
OK, see the green flag icon showing the HL7 message
SKIPPED_BY_DEST (Based on current configuration)
SKIP_FAILED (Skipping event does not warrant Holding up messaging)

28. Result Status Problems - WAIT
MOM will place a message in WAIT status when it receives the following Destination Result codes:
TRANSPORT ERROR (TCP communication error, transport exception in Stack trace)
RESOURCE BUSY (Record is locked)
TIMEOUT ERROR (No response by Destination)
MOM will retry sending the message at a periodic rate until message is processed or until retry max is reached and at that point the message is put in a HOLD status.
Also, if your interface is supports sending Number Assignments, the message status WAIT_ACK indicates that the messaging is waiting for the returned HIS Placer # before processing further.

29. Result Status Problems - HOLD
MOM will place a message in HOLD status when it receives the following Destination Result codes:
DATA ERROR (Missing HIS#, SOAP Fault)
Re-sending attempts reaches the max for TRANSPORT ERROR, RESOURCE BUSY, and TIMEOUT ERROR statuses.

30. SUMMARY
ESB-MOM is an architecture for integrating all applications, both internal and external
MOM user interface provides a view that reflects the message-oriented design
ESB-MOM’s RDC and RR processes mirror legacy RR functionality. The trace information is stored in a database. Display and search capabilities are an enhancement from previous flat trace files.
Filtering for the child TEST_RELEASED event will provide most trouble-shooting information with least effort
Message status HOLD will require manual intervention and will hold up delivery of subsequent events with the same grouping identifier.