1. Improving Graduate Education with Digital Libraries Eröffnung des DFG-Graduiertenkollegs 1223 “Qualitätsverbesserung im E-Learning durch rückgekoppelte Prozesse” Darmstadt, GE, September 14, 2006 Edward A. Fox fox@vt.edu http://fox.cs.vt.edu

2. Outline  Acknowledgements  ETDs and NDLTD  DL curriculum and resource development  Prior work on quality and success models  DL success model  From end user perspective  Summary and Conclusions

3. Acknowledgements (selected) Colleagues: Lillian Cassel, Debra Dudley, Weiguo Fan, Marcos Gonçalves, Doug Gorton, Rohit Kelapure, Neill Kipp, Aaron Krowne, Ming Luo, Uma Murthy, Manuel Perez, Ananth Raghavan, Rao Shen, Hussein Suleman, Srinivas Vemuri, Layne Watson, … Sponsors: ACM, AOL, CAPES, DFG, IBM, Microsoft, NSF (IIS-9986089, 0086227, 0080748, 0325579, 0535057, 0535060; ITR- 0325579; DUE-0121679, 0136690, 0121741, 0333601), SUN, …

4. Acknowledgements: ETD Mtgs 1987 mtg in Ann Arbor: UMI, VT, … 1992 mtg in Washington: CNI, CGS, UMI, VT and 10 universities with 3 reps each 1993 mtg in Atlanta to start Monticello Electronic Library (regional, US Southeast): SURA, SOLINET 1994 mtg at VT: std: PDF + SGML + multimedia objects 1996 funding by SURA, US Dept. of Education (FIPSE) 1997 meetings in UK, Germany,... 1998 – 1 st symposium – Memphis (20) 1999 – 2 nd symposium – Blacksburg (70) 2000 – 3 rd symposium – St. Petersburg (225) 2001 – 4 th symposium – Caltech (200) 2002 – 5 th syposium – BYU, Provo, Utah 2003 – 6 th syposium – Berlin (215) 2004 – 7 th syposium – U. Kentucky 2005 – 8 th syposium – Sydney, Australia

5. Acknowledgements: Future ETD Conferences 2007 – 10 th symposium –Uppsala University, Sweden –13-16 June 2008 – 11 th symposium –Dartington College of Arts, Devon, UK –29 June – 2 July (tentative)

6. Outline  Acknowledgements  ETDs and NDLTD  DL curriculum and resource development  Prior work on quality and success models  DL success model  From end user perspective  Summary and Conclusions

7. The Networked Digital Library of Theses and Dissertations www.NDLTD.org Leader of the Worldwide ETD (Electronic Thesis and Dissertation) Initiative Training Authors Expanding Access Preserving Knowledge Improving Graduate Education Enhancing Scholarly Communication Empowering Students & Universities

9. NDLTD Incorporation Networked Digital Library of Theses and Dissertations incorporated May 20, 2003 in Virginia, USA Charitable and educational purposes (501 c 3) Officers –Executive Director (Ed Fox) –Secretary (Gail McMillan) –Treasurer (Scott Eldredge)

10. Board of Directors Suzie Allard (ETD 2004, U. Kentucky) Denise A. D. Bedford (World Bank) Julia C. Blixrud (ARL, SPARC) José Luis Borbinha (Natl Lib Portugal) Tony Cargnelutti (Ex Libris) Vinod Chachra (VTLS) William Clark (Ohio State U.) Susan Copeland (RGU, UK) Jude Edminster (Bowling Green St. U.) Scott Eldredge (Treasurer, ETD 2002, BYU) Edward A. Fox (Exec Director,Virginia Tech) John H. Hagen (West Virginia U.) Thomas B. Hickey (OCLC) Christine Jewell (U. Waterloo, Canada) Joan K. Lippincott (CNI) Austin McLean (Proquest) Gail McMillan (Secretary, Virginia Tech) Joseph Moxley (ETD 2000, USF) Eva M ü ller (U. Uppsala, Sweden) Ana Pavani (PUC Rio, Brazil) Janice Rickards (chair of ADT) Sharon Reeves (National Library Canada) Peter Schirmbacher (ETD 2003, Humboldt) Samson Soong (Hong Kong U. Science & Technology) Hussein Suleman (U.Cape Town, S. Africa) Shalini R. Urs (U. Mysore, India) Eric F. Van de Velde (ETD 2001, Caltech) Ellen Wagner (Adobe)

11. Some Countries Argentina Australia Belgium Brazil Canada Chile China, Hong Kong Columbia Finland France Germany Greece India Italy Jamaica Korea Lithuania Malaysia Mexico Namibia Netherlands Namibia Netherlands Norway Peru Poland Russia Singapore S. Africa S. Korea Spain Sudan Sweden Switzerland Taiwan Thailand Turkey UK Ukraine United Arab Emirates USA Venezuela Yugoslavia

17. OCLC SRU Interface

21. ETD Union Search Mirror Site in China (CALIS) (http://ndltd.calis.edu.cn – popular site!)

22. Outline  Acknowledgements  ETDs and NDLTD  DL curriculum and resource development  Prior work on quality and success models  DL success model  From end user perspective  Summary and Conclusions

23. DL Curriculum Development Project Collaborative Research launched by: - Department of Computer Science, Virginia Tech - School of Information and Library Science, University of North Carolina, Chapel Hill Three year (2006 - 2008) funded project

24. Project Teams/NSF Grant Project Team at VT (IIS-0535057): –PI: Dr. Edward A. Fox (fox@vt.edu) –GRA: Seungwon Yang (seungwon@vt.edu) Project Team at UNC-CH (IIS-0535060): –Co-PI: Dr. Barbara Wildemuth (wildem@ils.unc.edu) –Co-PI: Dr. Jeffrey Pomerantz (pomerantz@unc.edu) –GRA: Sanghee Oh (shoh@email.unc.edu)

25. Development / Evaluation Plan January 2006 – December 2008

26. DL Topics in 19 Modules (original)

27. Outline  Acknowledgements  ETDs and NDLTD  DL curriculum and resource development  Prior work on quality and success models  DL success model  From end user perspective  Summary and Conclusions

28. has an example IS success model Prior Work on Measuring DL Success DeLone et al. Seddon has an example Information seeking behavior model Ellis Kuhlthau has an example DL quality model Gonçalves has an example Usability of DLs inspection of NCSTRL evaluation of ACM, IEEE-CS, NCSTRL, and NDLTD evaluation of ADL evaluation of ADEPT has an indicator system usage has an example Technology acceptance model Venkatesh predict Intention to re/use

29. Behavioral Attitude & Intension to Use — Venkatesh Model of IT Adoption intention to use system performance expectancy system usage Unified Theory of Acceptance and Use of Technology effort expectancy social influence facilitating conditions

30. Performance expectancy: –perceived usefulness, extrinsic motivation, job-fit, relative advantage, and outcome expectations Effort expectancy –the degree of ease associated with the use of system Social influence –Subjective norms, social factors, and image Facilitating conditions –the degree to which an individual believes that an organizational and technical infrastructure exist to support the system Venkatesh Model of IT Adoption

31. DeLone and McLean Model of IS Success System Quality Information Quality User Satisfaction Individual Impact Organization Impact Use

32. Seddon Model of IS Success System Quality Information Quality User Satisfactions Net Benefits to: Individuals Organizations Society Perceived Usefulness

33. Outline  Acknowledgements  ETDs and NDLTD  DL curriculum and resource development  Prior work on quality and success models  DL success model  From end user perspective  Summary and Conclusions

34. DL Success Model  Synthesize  IS success and adoption models  DL quality model (Gonçalves)  Information life cycle model  Information-seeking behavior models (Ellis’ and Kuhlthau’s)  From end user perspective

35. creation distribution seeking utilization searching, browsing, recommending storing, archiving, networking authoring, modifying, describing organizing, indexing preservability, similarity, timeliness, accuracy, completeness, conformance accessibility, preservability pertinence, significance, timeliness relevance Active Semi-active Inactive accessibility, accessing, filtering Gonçalves et al.

36. creation distribution seeking utilization E1:starting E2: chaining E3: browsing E4: differentiating E5: monitoring E6: extracting storing, archiving, networking K1: initiation K2: selection K3: exploration K4: formulation K5: collection K6: presentation authoring, modifying, describing organizing, indexing preservability, similarity, timeliness, accuracy, completeness, conformance accessibility, preservability DL Success Constructs Active Semi-active Inactive E: Ellis’ model K: Kuhlthau’s model

37. satisfaction performance expectancy (PE) behavioral Intention to (re)use relevanceadequacytimeliness reliabilityunderstandabilityscope accessibilityease of use joy of usereliability user interface social influence (SI) information quality (IQ) system quality (SQ) DL Success Model information quality (IQ)

38. DL Concepts Regarding Information collectionmetadata catalogdigital objectmetadata specificationrepository consist of associated with consist of

39. accessibility preservability pertinence relevance similarity significance timeliness digital object accuracy completeness conformance metadata specification impact factor completeness collection consistency completeness catalog consistency completeness repository understandability relevance timeliness reliability adequacy digital object metadata specification adequacy catalog collection scope repository Information Quality (IQ) Digital Library IQ

40. satisfaction performance expectancy (PE) behavioral Intention to (re)use relevanceadequacytimeliness reliabilityunderstandabilityscope accessibilityease of use joy of usereliability user interface social influence (SI) information quality (IQ) system quality (SQ) DL Success Model system quality (SQ)

41. screen design navigation user interface composability reusability extensibility efficiency effectiveness reliability service accessibility reliability ease of use joy of use System Quality (SQ) performance expectancy Digital Library SQ

42. DL success Construct seeking phaseutilization phase starting (E1/K1) selection exploration (E2-E6)/(K2-K3) formulation (K4) collection (K5) presentation (K6) social influenceDL visibility information qualityadequacy, scopeaccuracy system qualityease of use joy of use (interface) accessibility performance expectancy usefulness (interface) DL Success Constructs Associated with Seeking and Utilization Phases

44. Outline  Acknowledgements  ETDs and NDLTD  DL curriculum and resource development  Prior work on quality and success models  DL success model  From end user perspective  Summary and Conclusions

45. Summary and Conclusions  ETDs and NDLTD progressing well  DL curriculum and resource development with iterative refinement  Foundation for defining success of DLs from the view of DL end users  Assumes a multi-theoretical perspective  Synthesizes many related research areas in terms of theory and empirical work

46. Selected Links - http://fox.cs.vt.edu DL curriculum - http://curric.dlib.vt.edu/wiki, http://curric.dlib.vt.edu/DLcurric.html NDLTD (electronic theses and dissertations worldwide) –www.ndltd.org and etdguide.org Virginia Tech Digital Library Research Laboratory (DLRL, www.dlib.vt.edu)