1. CERN – European Organization for Nuclear Research Administrative Support - Internet Development Services CET and the quest for optimal implementation and maintenance efficiency Mikael Angberg, AS-IDS with Data warehousing and J2EE Components

2. CERN IDS Outline Introduction to CET Maintenance and Implementation issues Quality Assurance Maintainability and Versatility Conclusions Questions

3. CERN IDS 8.6 km Challenges facing CERN Today Build the worlds largest scientific instrument… fewer staff… Staff Budget With less budget.. CERN IDS for more scientists… with higher expectations...

4. CERN IDS for more financial managers… with higher expectations... Challenges facing the CET Team Today Build the worlds coolest Financial Decision Support application… few staff… Staff Budget With a small budget.. CERN IDS

5. CERN IDS CERN Expenditure Tracking

6. CERN IDS CERN Expenditure Tracking 1000+ “Financial” Managers Globally Distributed Wide range of user needs High Level System Requirements Maintainability Versatility Quality Critical for CERN

7. CERN IDS CERN Expenditure Tracking

8. CERN IDS The “System Idea” Application (Java) Data Warehouse User Interface Financial Data Business Logic

9. CERN IDS Data Warehouse Quality Data and Data Warehouse Quality o Capturing the “right” data o Validating the data o Managed complexity o Error handling o Code Inspections o Coding Standards o Centralised Data

10. CERN IDS Data Warehouse Quality Financial Data Sources Data Warehouse Stores ExtractionLoading Purchase Finance Process Transform Centralize data One Place, One Format, No Redundancy Error Handling and Validation

11. CERN IDS Data Warehouse Quality Managed Complexity Reduced number of DB Objects Single Entry Point Parameterized Extraction SUM..GROUP BY Partitioned Table 2001 1999 2000

12. CERN IDS Application Quality Structured Development Process o Iterative… o Development o Testing o Deploy Coding Standards Code Inspections o Inspired by Fagan and NASA o Based on Sun’s Java Specification

13. CERN IDS Quality Framework Benefits Greatly Reduced Database Maintenance Increased production code quality (less bugs) Higher developer productivity Ensured Data Consistency Increased transparency and knowledge transfer within and between development teams Extended data quality assurance through automated validation processes

14. CERN IDS Maintainability and Versatility Objectives Satisfy a Global user community …by providing powerful analysis and reporting capabilities …consisting of more than 1000 people with different needs (and many requests) With a development team of maximum 5 people, minimum 1 - Maintainability - Versatility

15. CERN IDS Facts and Dimensions Measures / Facts Payments Commitments. Keys Partitioned Fact Table Time Order Dimension Location Supplier Dimension The Dimensional Model Data Warehouse

16. CERN IDS Maintainability and Versatility Managed Complexity SUM..GROUP BY Partitioned Table 2001 1999 2000

17. CERN IDS Aggregates and Query Rewrite Raw Data Table 2001 1999 2000 Dimension Tables Query Re-write SELECT SUM(sales) FROM raw_data; Aggregate Tables / Materialized Views 2001 1999 2000 SUM..GROUP BY

18. CERN IDS Scalability and maintained simplicity <2000 20002001 2002 Partitioned Index Partitioned Table Partitioning <2000 20002001 2002 Partitioned Index Partitioned Table

19. CERN IDS Design Conclusions DWH The data warehouse structure allows : Flexible – Easy to tune and extend Access to any aggregate level “Simple” design – Automation of recurrent maintenance Maintenance and Versatility perspective : Access to any range of data …transparently to the user Scalable – Facilitates growing with preserved simplicity

20. CERN IDS ART – the Java Reporting Framework Three Main Components “Increase maintainability, by applying existing design/code and documentation standards and ensure in-house knowledge of the product. “ “Use of the framework should be possible with knowledge of standard languages only such as Java, SQL, XML. “

21. CERN IDS ART – the Java Reporting Framework Web-based Java components XML Templates Web report Input Objects Input Validators Query Builder Report Generator XML Templates

22. CERN IDS Key “Success” Factors Design assures data quality Development process integrating quality assurance Robust yet Flexible Data Warehouse Design Simplicity - Low on maintenance Component based (Java) reporting framework

23. CERN IDS Conclusions Users World-wide, highly reliable and available Financial Decision Support Developers Decrease in maintenance efforts Faster “time-to-market” Increased productivity and quality Development focuses on solving business problems – Stable Infrastructure

24. CERN IDS Thank You Browse to: http://ais.cern.ch/ or Email: Mikael.Angberg@cern.ch For More Information

25. CERN IDS Summary of CET Web-Based, multi-lingual 20 GB Data Warehouse - 360 GB Raw Data Over 1000 active users ~ 1000 Reports per day ~ 24 / 7 Availability 100% Automated Recurrent Maintenance No Ad Hoc Querying