CrossRef Annual Member Meeting – Technical Update Chuck Koscher Director Of Technology Technical Update Annual Member Meeting September 25, 2002

CrossRef Annual Member Meeting – Technical Update Chuck Koscher Query Volume and Matching Rate

CrossRef Annual Member Meeting – Technical Update Chuck Koscher Volume # Matches % Query Rate Raw Data Old SystemNew System

CrossRef Annual Member Meeting – Technical Update Chuck Koscher Old System Volume # Matches % New System Query Rate Raw Data (cont.)

CrossRef Annual Member Meeting – Technical Update Chuck Koscher Query Rate Raw Data (cont.) Old System New System Volume # Matches %

CrossRef Annual Member Meeting – Technical Update Chuck Koscher Old System 5,312,136 Number Of DOI Records (as of 9/20) New Deposits Since 8/25 238,312 New System 5,410,206 DOIs not yet transferred from old 3,131 Total 5,550,448 DOIs with duplicate meta-data 142,286 Total 5,555,623

CrossRef Annual Member Meeting – Technical Update Chuck Koscher Records Received Current Year Back Year September 484,89156,882152,802 August (new) August (old) 42, ,704 15,55610,007 July 103,21642,12161,096 June 19,88955,17174,708 May 179,84163,970115,866 April 230,84954,670176,173 March 101,50342,56158,936 February 444,38063,783380,554 January 153,14134,423118, ,288,994471,103817, , Deposit Statistics

CrossRef Annual Member Meeting – Technical Update Chuck Koscher Observations On Performance  On The Current Hardware The System Is Performing Well  Hitting 60-80% CPU Utilization on front end and database machines  Database can be made more efficient when we have more disk space (after old MDDB is retired)  Deposit Times (dependent on size of jobs in the Queue)  Query Times (dependent on system loading)  Small batches (1-10) complete in < 2 seconds  Modest batches (10-500) complete in < 2 minutes  Large batches (17000) complete in < 30 minutes  CrossRef administrator can move jobs to the top of the queue  Wait time : - with no large jobs in the queue, typically less than 5 minutes - with many large jobs (10-15 of 1.5+Mbyte), 3-6 hours  Processing time, dependent on handle system: -45 Minutes for large jobs (1.5+ Mbyte) - Less than 5 minutes for small jobs (~25KBytes)

CrossRef Annual Member Meeting – Technical Update Chuck Koscher ‘Go-Live’ Recap  Small Problems  Medium Problems  Larger Issues  Usernames and Passwords (usually handle system)  Perl LWP and HTTP Headers (new system more strict)  Local Hoster interface and XML extraction (malformed XML)  Oracle 8i JDBC Driver bug (switched to OCI8 driver)  Two deposits / same meta-data / one with author one without – one without author blocked from being deposited  Case insensitive DOIs – mixed case restored  Duplicate meta-data / different DOIs being blocked from deposit  Prefixes not mapped to titles in MDDB.XML  Using same file name for deposits  UTF-8 conversion

CrossRef Annual Member Meeting – Technical Update Chuck Koscher Phase 1 Rewrite Completion  Data cleanup  Verify integrity of data transferred from old system  Begin a maintenance program for correcting data quality issues  Resolve identical meta-data issue  Allow multiple DOIs with the same meta-data – with a marker  Construct an administrative Replace DOI function  Resource Analysis  Access the need for additional hardware  Review our hosting situation (WCOM) and evaluate alternatives  Close out phase 1 development  Verify Book & Conference Proceeding Query Function  Move into a maintenance phase with Atypon  Correct all remaining bugs  Integrate reports with new database

CrossRef Annual Member Meeting – Technical Update Chuck Koscher Moving Forward  Identify and plan phase 2 features  Full text queries (no more pipes)  ‘Pull’ interface for asynchronous queries  Return of multiple hits for a single query  Query hit notification (registered queries)  Work with membership to transition Journal deposits  Finalize Parameter Passing  Concentrate on Schema Deposits  Ramp-up book and conference proceedings deposits  Select a technical approach and complete prototype activities  Integrity checks with the handle system