1. COMP 415, Spring 2008

2. T ABLE OF C ONTENTS 1. Problem Formulation 2. Solution Features 3. Solution Architecture 4. Major Systems 5. Project Timeline 6. Conclusion

3. P ROBLEM F ORMULATION 1. Problem Formulation 2. Solution Features 3. Solution Architecture 4. Major Systems 5. Project Timeline 6. Conclusion

4. P ROBLEM F ORMULATION Messages Take Time To Travel Across a Network How Can We Find Bottlenecks? When Should We Cancel a Message?

5. P ROBLEM F ORMULATION | BASIC S OLUTION Catch Messages Correlate Store Associations Retrieve Latencies Display System Map

6. S OLUTION F EATURES 1. Problem Formulation 2. Solution Features 3. Solution Architecture 4. Major Systems 5. Project Timeline 6. Conclusion

7. S OLUTION F EATURES Relocate-Ready Components Process Abstraction Encapsulated Optimization Points Variable Correlation Multiple Visualizations

8. S OLUTION A RCHITECTURE 1. Problem Formulation 2. Solution Features 3. Solution Architecture 4. Major Systems 5. Project Timeline 6. Conclusion

9. S OLUTION A RCHITECTURE Data Flow Scalability Data Recipient Correlation Engine

10. D ATA F LOW D IAGRAM o JPM Service o Controller o Database o Manipulation o View Client

11. S CALABILITY D IAGRAM o Data Mining o Correlation o Database

12. D ATA R ECIPIENT D IAGRAM o Possibilities o Parsing o API Calls o Batching o Destinations

13. C ORRELATION E NGINE D IAGRAM o Data Reader o Data Writer

14. M AJOR S YSTEMS 1. Problem Formulation 2. Solution Features 3. Solution Architecture 4. Major Systems 5. Project Timeline 6. Conclusion

15. M AJOR S YSTEMS Correlation Messaging View

16. Correlation Engine C ORRELATION A correlation engine holds sets of messages and performs matching between the sets. Data Reader Input Messages Output Messages Server Log Data Reader Input Messages Output Messages Server Log Correlation Rules Association Store

17. A SSOCIATION G RAPH Xml Configuration File Stores configuration of association graph Information about correlation rules to use Formats of data logs Server A Server B Server C InOut InOut InOut

18. D ESIGN C HOICES In-memory correlation Correlation Rules can create their own data structures to expedite their matching Sliding Time Window Features Scalability Flexibility Efficiency

19. M ESSAGING Components not colocated Ensure recoverability Handle large volumes of data

20. V IEW Eclipse RCP framework External graphing package Wireframes

21. V IEW | E CLIPSE RCP F RAMEWORK Integration with JPMorganChase Modular design Standardized system

22. V IEW | E XTERNAL G RAPHING P ACKAGE

23. V IEW | W IREFRAMES M ULTIPLE S ERVER V IEW

24. V IEW | W IREFRAMES S INGLE S ERVER V IEW

25. P ROJECT T IMELINE 1. Problem Formulation 2. Solution Features 3. Solution Architecture 4. Major Systems 5. Project Timeline 6. Conclusion

26. P ROJECT T IMELINE Five Phases Phase 1: Due February 1 st Phase 2: Due February 15 th Phase 3: Due March 1 st Phase 4: Due April 1 st Phase 5: Due May 1 st Front-Loaded Early Integration

27. P ROJECT T IMELINE Full Interface Skeleton Stub Modules Admin API (Control) AddMessage API Correlation (Default Rules) View Path Latency Phase IPhase IIPhase IIIPhase IVPhase V

28. P ROJECT T IMELINE Phase IPhase IIPhase IIIPhase IVPhase V

29. P ROJECT T IMELINE Admin Client (Control) Correlation (Arbitrary) Message Batching Message Datastore Association Datastore Real-Time View Phase IPhase IIPhase IIIPhase IVPhase V

30. P ROJECT T IMELINE Phase IPhase IIPhase IIIPhase IVPhase V

31. P ROJECT T IMELINE Engine Scheduling Correlation Strength Data Client Admin API Graph Node Datastore View Graph Latency Phase IPhase IIPhase IIIPhase IVPhase V

32. P ROJECT T IMELINE Phase IPhase IIPhase IIIPhase IVPhase V

33. P ROJECT T IMELINE Zero & Many Correlation Parsing Module Single Message View Phase IPhase IIPhase IIIPhase IVPhase V

34. P ROJECT T IMELINE Phase IPhase IIPhase IIIPhase IVPhase V

35. P ROJECT T IMELINE Re-Correlation Recoverability Control Path Datastore Collapse Nodes (View) Phase IPhase IIPhase IIIPhase IVPhase V

36. C ONCLUSION 1. Problem Formulation 2. Solution Features 3. Solution Architecture 4. Major Systems 5. Project Timeline 6. Conclusion

37. C ONCLUSION

38. Thank You For Listening!