Census Bureau DRIS Decennial Response Integration System Date: 07/30/2007 System IPT Decennial Systems Database Modernization Support

2 Index What have we done in past 3 months What have we done in past 3 months dscmotd1 and DE101 compare dscmotd1 and DE101 compare Moved to DE101 and then to BE101 Moved to DE101 and then to BE101 And many more … And many more … Work done on DE101 Work done on DE101 Scripts creation for load Scripts creation for load Studying application for index creation Studying application for index creation UECT creation from UNM UECT creation from UNM Writing script based on state retrieval Writing script based on state retrieval Unit testing for UECT Unit testing for UECT

3 Full load Full load Full test for UECT load- successful Full test for UECT load- successful Compare times with old machine Compare times with old machine Performance and tuning Performance and tuning Partitioning tables Partitioning tables Comparing results for 2000 Comparing results for 2000 Change in retrieval criteria Change in retrieval criteria Retrieval criteria to LCO basis Retrieval criteria to LCO basis Changed scripts Changed scripts Partitioned tables based on LCO Partitioned tables based on LCO Unit testing and full testing Unit testing and full testing Taking advantage based on CPUs Taking advantage based on CPUs Running scripts in parallel Running scripts in parallel

4 Move DE101 to BE101 Move DE101 to BE101 Move scripts from DE101 to BE101 Move scripts from DE101 to BE101 Test all scripts for performance Test all scripts for performance Data modeling Data modeling Version difference Version difference Production m/c Production m/c Work around/Solution Work around/Solution Reverse Engineering effort Reverse Engineering effort

5 What have we done in past 3 months dscmotd1 and DE101 compare dscmotd1 and DE101 compare Moved to DE101 and then to BE101 Moved to DE101 and then to BE101 And many more … And many more … dscmotd1 DE101 BE101 Got acceptable and best results on DE101 Got acceptable and best results on DE101 Moved schema to DE101 Moved schema to DE101

6 Work done on DE101 Scripts created for Scripts created for Data load Data load Indexes Indexes analyzing table objects analyzing table objects Study application to create proper indexes Study application to create proper indexes Fast data retrieval Fast data retrieval Fast data update Fast data update Test data load and compare with old machine Test data load and compare with old machine Acceptable results Acceptable results Data load in 1.5 hrs for whole country compare to 30 hrs on old machine Data load in 1.5 hrs for whole country compare to 30 hrs on old machine

7 UECT creation from UNM Scripts based on state retrieval – 2000 Scripts based on state retrieval – 2000 Unit testing Unit testing Full load testing Full load testing Full test for UECT load- successful Full test for UECT load- successful Compare times with old machine Compare times with old machine UNM table UECT process Retrieval based on state

8 Performance & Tuning Results not up to the mark Results not up to the mark P & T was needed P & T was needed Data size, too high Data size, too high table partitioning table partitioning UECT process Retrieval based on state

9 Change in retrieval criteria Data retrieval based on LCO and NOT on state based Data retrieval based on LCO and NOT on state based Unit and full testing Unit and full testing Advantages of CPU bound operations Advantages of CPU bound operations Scripts run in parallel Scripts run in parallel UECT process Retrieval based on LCO

10 Moving from DE101 to BE101 Got new host Got new host DE101 - Production DE101 - Production BE101 – Beta/test BE101 – Beta/test Same configuration Same configuration Whole testing to be done Whole testing to be done

11 Data Modeling Problems Data repository was not compatible with Database version Data repository was not compatible with Database version Could not do data modeling using Oracle designer Could not do data modeling using Oracle designer Work around using third party tool. No stoppage of work Work around using third party tool. No stoppage of work Oracle db 10g Designer repository 6.x Data modelingDesktop DE101 Versions not compatible X

12 Work Around Work around using third party tool. No stoppage of work Work around using third party tool. No stoppage of work Oracle db 10g Data modeling Third party tool Desktop Scripts creation/ execution DE101 Versions compatible

13 Reverse Engineering effort – not done Oracle db Designer repository Data modelingDesktop BE104 DE101 Versions compatible

14 THE END