1. 1 Copy and paste your photo into your opening and closing slide Aleph Parallel Indexing Jerry Specht Senior Support Analyst Jerry.specht@exlibrisgroup.com

2. 22 Copyright Statement All of the information and material inclusive of text, images, logos, product names is either the property of, or used with permission by Ex Libris Ltd. The information may not be distributed, modified, displayed, reproduced – in whole or in part – without the prior written permission of Ex Libris Ltd. TRADEMARKS Ex Libris, the Ex Libris logo, Aleph, Alma, SFX, SFXIT, MetaLib, DigiTool, Verde, Primo, Voyager, MetaSearch, MetaIndex and other Ex Libris products and services referenced herein are trademarks of Ex Libris, and may be registered in certain jurisdictions. All other product names, company names, marks and logos referenced may be trademarks of their respective owners. DISCLAIMER The information contained in this document is compiled from various sources and provided on an "AS IS" basis for general information purposes only without any representations, conditions or warranties whether express or implied, including any implied warranties of satisfactory quality, completeness, accuracy or fitness for a particular purpose. Ex Libris, its subsidiaries and related corporations ("Ex Libris Group") disclaim any and all liability for all use of this information, including losses, damages, claims or expenses any person may incur as a result of the use of this information, even if advised of the possibility of such loss or damage. © Ex Libris Ltd., 2012

3. 33 Agenda Outline of presentation

4. 44 Documents on Technical Seminar CD I have included the following on the CD: this Powerpoint (TS2012_Aleph_Parallel_Indexing.ppt) Parallel Indexing.pdf (from Ex Libris Documentation Center > Aleph > Technical Documentation >How To >Indexing)Ex Libris Documentation CenterAlephTechnical DocumentationHow To How To Run Index Jobs (from Ex Libris Documentation Center > Aleph > Support > How To from Support by subject > Indexing_filing_and_expand_proceduresEx Libris Documentation CenterAlephSupportHow To from Support by subject How to Open a New Library for Parallel Indexing.doc

5. 55 1. Choose parallel library name In this session, LAW01 is being used as the actual library, and LAW04 as the indexing library. The LAWnn libraries are a subset of Lawrence University Library’s records, consisting of 5,000 bib records and the associated item, acq, HOL records, etc. The patron records have been anonymized.

6. 66 2.Open New Library for ParallelIndexing The Parallel Indexing document has the following Step 1: “Open a new BIB library, parallel to the library that is going to be indexed.” There’s a How to Open a New Library document which could be used for this purpose, but that document has many steps unnecessary for Parallel libraries and fails to include steps unique to Parallel libraries. Thus, I have created a How to Open a New Library for Parallel Indexing document (included on the Technical Seminar CD). Step 2 of Parallel Indexing (“Add the Indexing Library to library relation”) is augmented by section 3.2.1 of the How to Open a New Library for Parallel Indexing document.

7. 77 3. Synonyms Drop the xxxnn z00, z103, z0102, and z970 in law04, as described in Parallel Indexing. Be sure to do the “select count(*) from Z00” test before doing the drop. Then do util a/17/5/2 in law04 to create the synonyms.

8. 88 4. Check the Library’s Z52 Table Step 4 of Parallel Indexing is “Adjust the Library’s Z52 Table”. We find, in the law04 util g/2, that the open_new_library proc has set these counters to a value of “0”.

9. 99 5. Check the indexing library’s $data_tab Step 5 of Parallel Indexing is “Set up Indexing Configuration Tables”. We find, in the law04 $data_tab, that the open_new_library proc has copied the Aleph tables from the law01 template library.

10. 10 6. Run util e/5/1 in the law01 library to save z07’s for later reindexing While the indexing jobs are running, new and updated records in the actual library are indexed, through the ue_01 and Z07 mechanism, on the old indexes. These Z07 records must be saved, for re-indexing after the new indexes have been built. util e/5/1 does this.

11. 11 7. Run the indexing jobs Parallel indexing is normally used for the long- running Words and Headings indexing jobs, but it can be used for other jobs (such as p_manage_05, p_manage_07, p_manage_27, p_manage_35, etc.) as well. We will run: p_manage_01 (Words) and the Headings sequence (p_manage_102, p_manage_02, p_manage_105, p_manage_17, and p_manage_35) in the law04 parallel library.

12. 12 8. Generate z07 indexing activity in law01 We will generate some z07 indexing requests in law01, to be processed by the law01 ue_01, while the parallel indexing is occurring in law04.

13. 13 9. Check the new indexes Parallel Indexing, Step 8 / Appendix A.

14. 14 10. Applying the New Indexes: Option 1 vs. Option 2 Parallel Indexing, Step 9, describes two Options for implementing the new indexes: Option 1: Logical synonyms Option 2: Oracle Import

15. 15 10a. Applying New Indexes: Option 1: Logical synonyms With this method, you leave the index tables in the law04 library, drop the tables in the law01 library, and create synonyms in law01 to point to law04. We will do this for the z01, z02, and z0102 tables. This is described in detail in Parallel Indexing, Step 9. Before dropping the tables in law01 you should save them, as described in “Restoring Old Index” below.

16. 16 10b. Applying New Indexes: Option 2: Oracle Import With this method you export the index tables from law04 using the oracle_expdp_table proc and then import them into law01 with the oracle_impdp_table proc. We will do this for the z95, z97, and z98. There is no util menu for these procs; they must be executed via the commands shown below. (Note: Though p_file_03 might be used to export the table from law04, and p_file_04 to import the table in law01, the p_file_04 import of the z98 has taken as long as 24 hours for the z98 of a 500,000-record bib library. Therefore, we suggest using the Data Pump instead….)

17. 17 10b. Oracle Import (Continued) csh -f $aleph_proc/oracle_expdp_table LAW04,z98 > & oracle_expdp_table.js.log & Copy the LAW01_Z98 directory from law04 $data_files to law01 $data_files. Then: csh -f $aleph_proc/oracle_impdp_table LAW01,z98 > & oracle_impdp_table.js.log & p_manage_01 zeroes out the z980 table. Rather than doing an export of this (empty) law04 table we do util a/17/1 for the law01 z980 table.

18. 18 10c. Applying New Indexes: Backing-up/Restoring Old Index To enable restoration of the old (law01) indexes, you should back them up using the Data Pump before applying the new (law04) indexes: csh -f $aleph_proc/oracle_expdp_table LAW01,z95 > & oracle_expdp_table.js.log & csh -f $aleph_proc/oracle_expdp_table LAW01,z97 > & oracle_expdp_table.js.log & csh -f $aleph_proc/oracle_expdp_table LAW01,z98 > & oracle_expdp_table.js.log & csh -f $aleph_proc/oracle_expdp_table LAW01,z980 > & oracle_expdp_table.js.log &.

19. 19 10c. Backing-up/Restoring Old Index (Cont.) Then rename the directories: cd $data_files mv LAW01_Z95 LAW01_Z95.save mv LAW01_Z97 LAW01_Z97.save mv LAW01_Z98 LAW01_Z98.save mv LAW01_Z980 LAW01_Z980.save To restore, you would remove the “.save” from the name and do “oracle_impdp_table”

20. 20 11. Updating law01 with law04 util g/2 and $data_tab values Parallel Indexing Step 10 has details on updating law01with law04 util g/2 and $data_tab values. (Note: the title for Step 10 is incorrect. It should be “Updating util g/2 and $data_tab values”.) Any law04 util g/2 counter which has a non-zero value needs to be updated in law01. And any law04 $data_tab tables which were updated for indexing need to be copied to law01.

21. 21 12. Index records updated in the interim [Parallel Indexing Step 11] In order to include records that were updated while indexing was running in the indexing library, perform UTIL/E/5/2 in the actual library (law01). This copies the saved Z07H records to Z07, deleting duplicate entries. The ongoing UTIL E/1 (ue_01) process in the actual library re-indexes the records stored in Z07. Important: ue_01, ue_08, etc., never run in the indexing library; their processing is always done in the actual library.

22. 22 Al Rykhus’ Method: Use of separate server for parallel indexing Better/simpler if you have: a separate server with space to duplicate your entire database and a DBA familiar with cloning databases. Contact: alan.rykhus@mnsu.edu.alan.rykhus@mnsu.edu

23. 23 Recap Recap … and Thank you! Jerry.specht@exlibrisgroup.com