Project Omnigatherer Joe Briggie Kenny Trytek Abby Birkett Derek Woods CPR E SE Kingland SystemsClient

Project Goal  Create software that can take information from many sources (websites) and put the information in a central location, accessible through a web interface. Central Location Many Sources User’s Display

System Diagram Flat File Database ETL Tool Normalized Employee UI DAL No Conflicts? Client UI Web Svcs. WWW Data Scraper Tool HTML Parser PDF Parser Create Read Update Delete

 Scour sites for information and produce a de-normalized flat file for use by the ETL (Extract, Transform, Load) component.  Currently have two harvesters: one for the FDIC website, and one for the FFIEC site. Information Harvesters Many Sources Harvester Components Flat File

 Transform file created by harvesters into a format useable by the database.  Load data into the database. ETL (Extract, Transform, Load) Component Flat FileDatabase ETL

 Provides an interface for CRUD operations on the database.  Helps ensure normalization through standardization of input/output. DAL (Database Access Layer) Database With DAL

Web Services and User Interface  Expose database to a client application.  Allow users to access the data through the interface. User Interface Web Services Database With DAL

Test Plan  Test individual modules for basic functionality.  Integrate all modules.  Test individual modules for full functionality with continuous integration to accommodate changes in each module.  Final testing for validation and client approval.

Current Progress ActivityStart DateEnd Date Sept 13-19Sept Sept 27-Oct 3 Oct 4-10 Oct Oct 18-24Oct Nov 1-7 Nov 8-14 Nov 15-21Nov Nov 29-Dec 5 Dec 6-12 Dec 13-19Dec Dec 27-Jan 2 Jan 3-9 Jan 10-16Jan 17-23Jan Jan 31- Feb 6 Feb 7-13 Feb Feb Feb 28 – Mar 6 Mar 7-13 Mar 14-20Mar Mar 28 – Apr 3 Apr 4-10 Apr 11-17Apr Apr 25 – May 1 Project Plan Presentaion09/21/1009/27/10 Project Plan Rough Draft09/21/1010/05/10 Project Plan Final Draft10/05/1010/12/10 Prototyping10/05/1012/10/10 Design Document Rough Draft10/05/1011/15/10 Design Document Final Draft11/15/1012/03/10 Testing Phase01/31/1104/04/11 System Completion12/10/1004/04/11 End Product Documentation03/21/1104/04/11 Project Poster03/14/1103/28/11 Project Presentation04/25/11 Buffer04/11/114/24/11

Questions?