1. Scripps Institution of Oceanography R/V Alexander Agassiz November, 1907 SIO: New developments since 1903 SIOExplorer Stephen P. Miller Geological Data Center http://SIOExplorer.ucsd.edu spmiller@ucsd.edu

2. SIO begins to map the seafloor Sigsbee Sounding Machine R/V Albatross, March 1904 Lead line sounding Ground truth

3. Gulf of California Expedition, 1939 R/V E. W. Scripps L to R: Erik Moberg, Roger Revelle, Andrew Boffinger, Richard Fleming (with binoculars), Bob MacDonald, George Hale, Lee Haines, Walter Robinson, Martin Johnson, Loye H. Miller

4. Capricorn Expedition, 1952-53 R/V Spencer F. Baird L to R back row: Dick Von Herzen, Roger Revelle, Willard Bascom, Ted Folsom, Alan Jones, Gustaf Arrhenius, Henri Rotschi, Robert Livingston, Russell Raitt. Seated: Dick Blumberg, Ronald Mason, Bob Dill, Art Maxwell, Winter Horton, Walter Munk, Helen Raitt

5. Project Mohole, 1961 R/V CUSS 1 Roger Revelle, Willard Bascom, Walter Munk, Gustav Arrhenius. John Steinbeck in left corner. Original uncropped photo by Fritz Goro, LIFE Magazine.

6. SIO Expeditions, 1952-

7. SIO SeaBeam Expeditions, 1981- Thomas Washington Melville Revelle

8. R/V Thomas Washington, 1965-1992 SeaBeam “Classic” 16 beams 1981-92 Discovered overlapping spreading centers, 1982

9. R/V Melville, 1969- SeaBeam 2000 121 beams 1992- Sample survey Alarcon Spreading Ridge Entrance Gulf of California Christina Massell Peter Lonsdale

10. R/V Roger Revelle, 1996- SeaBeam 2100 151 beams 1996-2000 Simrad EM120 191 beams 2001-

11. EM120 Multibeam Sonar No. receive beams:191 Depth range:20 to 11000m Max swath width:6 times water depth/25km Transmit beamwidth:1-2 degrees Receive beamwidth:1-2-4 degrees Beam pattern:Equidistant (or equal angle) on seafloor Beam stabilization:Beams stabilized for pitch, yaw, and roll Refraction correction:Realtime and postprocessing Bottom detection:Amplitude + Phase detection Sonar backscatter imagery:Included System precision:0.1% of depth RMS System operation:Unix workstation with built-in data storage and real time visualization/quality control Transmit Frequency:11.25 to 12.60 kHz R/V Roger Revelle First sea trial January 2001

12. Geological Data Center Archives 440 GB digital holdings 646 SIO cruise legs, 1952- Underway Bathymetry, magnetics, gravity Multibeam bathymetry and sidescan imagery, 1981- 16 beam Thomas Washington, SB Classic 120 beam Melville, SB2000 151 beam Revelle, SB2100 191 beam Revelle, Simrad EM120, Jan 2001-

13. Geological Data Center Archives … Analog holdings Original echosounding records, 1950- Includes all DSDP Legs 1-96 Seismic records, 1963- Underway log books, 1952- Plotting sheets, 1952- (SIO Library bridge logs and reports, 1903-) Microfilm single channel seismics

14. Marine Geology and Geophysics Database Management Workshop Sponsored by NSF and ONR 14-16 May at SIO Pitfalls and successes Current database practices New software tools Database management GIS http://humm.whoi.edu/DBMWorkshop/

15. SIOExplorer: Web Exploration of Seagoing Archives Information Technology Research An Initiative of the National Science Foundation Collaboration with San Diego Super Computer Center

16. SIOExplorer … Review community practices Academia, Industry, Government Use modern geospatial database tools Data-Intensive Computing Environments National Partnership for Advanced Computational Infrastructure

17. SIOExplorer … Extract across distributed archives Map images Gridded data Raw data Underway geophysical data Multibeam (440 GB) Seismic data (2000 GB) Metadata processing notes Reports and publications

18. SIOExplorer … Facilitate data synthesis projects Combine bathymetry from multiple sources Overlay other data types Create prototype web delivery system Deliver compressed images across the web MrSID, ECW, jpeg2000 Use IGPP Digital Library for storage Robotic access to 20 TB

19. SIOExplorer … “gmtplus” interface Underway data Gravity Magnetics Togography Search engine Specify lat,lon area Select type of data http://topex.ucsd.edu/cgi-bin/cruise_data.cgi

20. SIOExplorer … Access distributed archives Wessel and Smith Lamont SIO NGDC Allow selection of specific cruises

21. SIOExplorer … Public outreach portal at Birch Aquarium 350,000 visitors per year Clearinghouse for web database techniques

22. SIOExplorer … Oceanographic institutions face a major challenge dealing with the rapid growth of data sets output by the latest shipboard instruments and the potential disappearance of older data sets that do not already reside in a secure database environment. Poor access to data collected in the past can lead to needless and expensive duplication of data acquisition efforts. Many older data sets were collected in remote areas that are seldom visited and loss of these data could lead to permanent holes in data coverage. These issues were highlighted in the FUMAGES report summarizing the 1996 conference on the Future of Marine Geology and Geophysics (MG&G): “The rapidly growing rate of data and sample acquisition requires more effective and standardized data management and publication. We risk losing vast amounts of data in the files and hard drives of individual investigators. Databases, sample archives and standardized data management are necessary complements to publication of research papers, and are likely to be of even longer-lasting value.” We intend to open up the shipboard archives of the Scripps Institution of Oceanography (SIO) to web access, with modern geospatial database tools. This will be a multi-step process: Assess community needs and resources Define and create a prototype system using the latest concepts in information technology and metadata management Test and refine the prototype system based on community review Populate system with all SIO digital holdings and new acquisitions Maintain the data system for more than 10 years.

23. SIOExplorer … Year 1 Development of prototype system. We will plan and begin construction of a prototype system. The design will be based on our existing gmtplus system, adding a metadata catalog and allowing web search and access for underway geophysical data across distributed archives. In addition, we will expand the metadata catalog for our rapidly growing archive of multibeam bathymetry data. This system will be used to provide outside access to SIO holdings as well as to track the levels of in-house editing and processing. We will also take advantage of recent image compression developments to make multibeam map imagery more accessible. A web interface to the 1600 GB holdings of the SIO Seismic Reflection Archive will be built for data retrieval and display. Year 2 Testing, outreach, and expansion. The prototype system for distribution of underway, multibeam, imagery and seismic holdings will be tested with key users in the academic community. The results will be assimilated, interfaces revised, and plans made for future developments. We expect to add the capability to combine data from diverse sources at various resolutions. In addition, a public outreach portal will be installed at the Birch Aquarium at Scripps, which sees about 350,000 visitors a year. A hands-on review workshop will be held at SIO. Year 3 Build-out the databases and add functionality. Following the recommendations of the review workshop, we will install all of the SIO digital holdings in the system and add additional functionality, as appropriate. Possibilities include an interface to outside holdings, the addition of new data types, the interactive display of multiple layers, and capabilities to monitor the time dependence of geospatial data.

24. SIOExplorer … Team member responsibilities Stephen P. Miller, Lead PI –Overall management and direction, as well as participant in development Steven Cande Liaison with dataset user community for needs assessment and evaluation David Sandwell –Development advisor for gmtplus and other tools for automatic processing and QC of global and cruise data Paul Henkart –Creation of seismic archive content, display and access strategies Ilya Zaslavsky –Liaison with IT community, creation of GIS web database strategy Cheryl Peach –Public outreach through the Birch Aquarium Advisory Committee Dr. Michael J. Carron, Naval Oceanographic Office, Stennis Space Center, MS, –Oceanographic data archiving and synthesis from multiple data sources Jim Case, SAIC, Newport RI, Data Processing Manager, –Marine data warehousing and rapid, web-enabled reporting systems Dr. Arthur Green, ExxonMobile, Houston, Senior Geologist –Overall strategies for utilizing geological information. Brice Pryszo, President of the Signet Group, Bidart, France, (Informatique & Mer, MapMedia and NetSea) –Designer of large-scale commercial nautical charting software. Dr. Cathy Manduca, Carleton College –Representative for the Digital Library for Earth System Education organization (DLESE). Bob Spiegelthal, Director of System Integration for Global Photon –Submarine fiberoptic cable system, contributing partner in CAL-(IT)2 Dr. Khalid Soofi, Conoco, Dir. Remote Sensing Laboratory –Bathymetric data synthesis and integration with other observations.

25. SIO Digital Library “Bridging the Gap between Libraries and Research Archives” Proposal to NSF National Digital Library Program

26. SIO Digital Library … Assemble a working team Oceanographers SIO Librarians UCSD Library Computer scientists San Diego Super Computer Center

27. SIO Digital Library … Modern database search engine Geospatial Lat, lon Temporal “1995-2000” Keyword Region“East Pacific Rise” Vessel“Melville” Cruise“COOK01MV” Expert-level Research, teacher, student, public

28. SIO Digital Library … Single search approach for all information Geospatial, temporal, keyword, expert-level Apply equally to Digital data Publications Citations or full text –Depending on user’s copyright permission “Gray literature” –Technical reports Scanned documents from UCSD and SIO holdings

29. SIO Digital Library … Build a modern metadata catalog Key to successful searching Make it easy to maintain Automatic tools to harvest metadata from data files Take advantage of community standards and tools OAI– Open Archive Initiative DLESE– Digital Library for Earth System Education ADEPT– Alexandria Digital Earth Prototype Embed domain-specific metadata into standard catalog

30. SIO Digital Library … Track evolving data, seamlessly From acquisition to publication Maintain relationships with other evolving data Various media DAT, EXB, CD, local file, robotic storage Various locations Distributed archives Monitor backup status Synchronize mirrored sites

31. SIO Digital Library … Take advantage of the “Storage Resource Broker” Facilitate archive operations Simple enough for small projects Designed for peta-byte scale (1000 TB) databases Easily manages hundreds of millions of files MCAT metadata catalog Manage distributed sites Automatically extract files from tape Robotic DLT storage, HPSS and other systems Hold on disk farm while active Transfer to user’s computer

32. Storage Resource Broker

33. Storage Resource Broker … SDSC Storage Resource Broker Tames Flood of Online Information The size and online availability of data sets is increasing exponentially in the Information Age, across all sectors of society. With the promise of limitless information at researchers’ fingertips, however, there are new challenges, and this flood of information is threatening to overwhelm existing methods of accessing, organizing, and archiving such data. One problem researchers face in handling scientific information as it travels from data sensors to computer applications to mass storage systems and digital libraries is that data sets must be moved and reorganized numerous times. Thus, researchers need, during this life cycle, an infrastructure tool capable of managing large data sets in such uses as massive data analysis systems, scientific data publication systems, and persistent digital archives. SDSC’s Data-Intensive Computing Environments (DICE) group has developed the SDSC Storage Resource Broker (SRB), a software tool for just this purpose. Initially released some three years ago, the SDSC SRB has proven highly useful, and there are now more than 200 registered users at more than 50 sites. "Digital data collections are becoming indispensable to the advance of science," said Reagan Moore, associate director for Data-Intensive Computing at SDSC and adjunct professor in UCSD’s Computer Science and Engineering Department. "SDSC’s DICE group is working to create a scalable data-handling and information discovery environment." This environment integrates distributed persistent digital archives, data grids for remote data access, and digital library services. The core components include the SDSC SRB and MCAT metadata catalog developed at SDSC and the Mediation of Information using XML (MIX) tools developed in collaboration with the UCSD Database Lab. These systems are finding applications in many data-intensive scientific disciplines and national-scale data centers. For further details, see http://www.npaci.edu/online/v5.4/srb118.html

34. SIO Digital Library … Libraries generally do an excellent job of distributing information to the public. Scientific data archives generally focus the interests of a narrow group of expert users. We propose to bridge the gap by opening archives to library search, with a team of UCSD researchers from the Library, the Scripps Institution of Oceanography, and the San Diego Super Computer Center (SDSC). Many scientific archives have evolved over the decades in an incremental fashion, with ad hoc solutions added for each new type of data. The retirement of key personnel and the cost of maintaining custom software can leave important archives in jeopardy. We propose to take advantage of recent developments in database and library technology to create a model to rescue scientific archives, place them under cost-effective modern database control, and make them available to a wider set of users. As a prototype, we intend to apply the model to the archives of the Geological Data Center at the Scripps Institution of Oceanography, which contain nearly fifty years and 440 GB of digital cruise data.

35. SIO Digital Library … Metadata will be the key to bridging the gap. We will embed the domain-specific metadata catalog into a more general catalog, conforming to the digital library standards of DLESE and OAI. Access tools will allow a combination of geospatial, temporal, and expert-level searching. For example, K-12 teachers and students will be able to select appropriate levels for their inquiries, so that they can discover essential features without being overwhelmed by detailed information requiring special tools and understanding. Long-term sustainability will be based on the SDSC Storage Resource Broker toolkit, which will manage the migration of the distributed archives through various media, such as CD, DAT, Exabyte, DLT, and various operating systems, and also maintain backups and monitor proprietary holds and copyright permission. The prototype digital library will contain more than shipboard data. We will establish a searchable infrastructure to facilitate a wide range of the tasks needed to write proposals, conduct research, or create lesson plans. Links will be made for literature searches, including the “gray literature” of technical reports and Master’s theses. As an integral part of the geospatial search engine, links will be provided to other archives, such as the Ridge PETDB Petrological Database of the Ocean Floor.

36. SIO Digital Library … Create custom maps on demand Select lat, lon Use 2-minute Global topography Overlay earthquakes, volcanoes, etc Create multibeam maps on demand? MB-System running on Super Computer 400 GB swath data online storage

37. Global Topography Based on 2-min satellite altimetry, gravity Calibrated by shipboard echo soundings http://topex.ucsd.edu/marine_topo/mar_topo.html

38. Global Topography … Calibrated by shipboard echo soundings

39. SIO 100 th Anniversary September 26, 2003 SIO, 1909 SIO, 1926