William Lewis CSU Fresno Jan 9, 2004 Resource Conversion William Lewis CSU Fresno Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA Symposium on Best Practice, LSA: Boston, MA

Symposium on Best Practice Preliminaries Eventually any resource will become obsolete  Resource conversion is inevitable One should plan from the start for eventual conversion Encode your resource such that it is Migratable is Reusable will Endure Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Symposium on Best Practice Simons (this symposium) argues there are 3 relevant formats for encoding data: Working form Presentation form Archival form (1) is tied to particular software. (2) is generally generated from (1), but itself is often “semantically” sparse. Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Symposium on Best Practice Encoding resource in archival form (3) insures that the resource is reusable, facilitating interoperability the resource can be migrated to other formats (including presentation formats) the resource endures Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Symposium on Best Practice Data Survivability Converting to archival XML form provides for data reuse and insures survivability: Working Form Archival Form Conversion Process HTML PDF Other XML form Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Data Conversion (“text”) Highly dependent on flexibility of working form and related software Converting from proprietary, binary format most difficult – to be avoided Converting from plain text output easiest – might be avoided due to potential data loss Converting from enriched text form (Unicode compliant) or XML coded data is best, but may not always be possible Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Symposium on Best Practice Data Conversion Working Form Archival Form Conversion Process Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Symposium on Best Practice Data Conversion Working Form Inter-mediary Form (Enriched text) Archival Form CP Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Intermediary Conversion Resources in Word Processor Spreadsheet Proprietary Flat File DB Relational DB XML or enriched text (inc. Shoebox) Use Print Function or “Save as…” Print Function or other file convert Data Query (direct to XML?) As is Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Intermediary Conversion Important: Insure that conversion to Intermediary Form suffers no data loss, or that the data loss suffered is minimal Danger in Save As (and Print to file), in that data loss is possible Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Symposium on Best Practice Final Conversion Intermediary to Archival Form (Best Practice XML): Font/Character transforms Macros or methods for enriching and aligning data elements Tables or “glossaries” defining how content and form should be interpreted Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Data Conversion – Case Study Converting Hopi Dictionary (Hill et al 1998) from working form (legacy format) Purpose: Build software to extract relevant data from working form Generate reusable archival format For dissemination on the Web For use by others To preserve data should DB software become unusable Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Symposium on Best Practice Hopi Dictionary Example entry from Hopi Dictionary: Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Hopi Dictionary Conversion Until now: Generated text file from DB Manually converted IPA fonts in MSWord Generated PDFs for dissemination Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Hopi Dictionary Conversion New Process: Convert DB format to “enriched” text Software transforms for fonts from text format (Unicode compliant IPA) Identify the grammatical concepts used in entries, linked to GOLD (Farrar & Langendoen, this symposium) Generate XML – structured using modified EMELD IGT format (Bow, Hughes & Bird 2003) Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Archival Hopi Dictionary Record Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA

Recipe for Resource Conversion Choose data format that is easily archived Where the software provides for data migration, or, The data format itself is easily converted Use existing software to bring you as close to Archival Form as possible (Intermediary Form) Clearly identify Content and structural semantics (“terms”) Fonts used (and transforms) Data alignment Construct transforms/macros/software to convert to Archival form Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA