1. Digitization Practices in India: Issues and Challenges
V.N. Shukla

2. C-DAC, NOIDA UNIT MISSION C-DAC SPECIAL INDUSTRIAL APPLICATIONS
NATURAL LANGUAGE PROCESSING AND INTERFACES
HUMAN RESOURCE DEVELOPMENT IN HITECH AREAS
INFRASTRUCTURE AND SUPPORT SERVICES
SPECIAL INDUSTRIAL APPLICATIONS 2

3. Internet on CATV & E-Commerce
AREAS OF COMPETENCE
Graphical Display System
Security Systems
Embedded System
System Engineering and Consultancy
NLP
Solar Energy System
E-Governance
Internet on CATV & E-Commerce .
NOIDA 3

4. Digital Library Activities : CDAC Noida
Digital Library Projects
Mega Centre for Digital Library
Mobile Digital Library : Dware Dware Gyan Sampada
Digital Library at President’s House
Digital Library at Nagari Pracharini Sabha Varanasi
Digital Library at Uttaranchal
GyanNidhi : Multilingual Parallel Corpus in Indian Languages
Digital Library at Gujrat Vidyapeeth ,Ahmedabad
Digitization of Libraries

5. Digital Library Mission
To organize the information and make it universally accessible and useful.
Online Content Billions of web pages
Offline Content Billions of items still unindexed

6. DL Initiatives
~85% of books are out of print and/or out of copyright – these books are only found in libraries
Only ~15% of books are in print
GOAL: Create a comprehensive virtual card catalog of all books in all languages, while respecting publishers’ rights
Source: Google

7. Digital Libraries
Users
Hyperlinks
Metadata
Search
Index
DL creation &
processes
Traditional Libraries
I NDEX

8. A Typical Library Collection
The value is in the middle
15%
~15%
~65% or more
Less than 20%**
In-Print
Unclear copyright status
May be in copyright, but not for sale
Rights may have reverted to author
May be in the public domain
Public Domain
92% of the world's books are neither generating revenue for the copyright holder nor easily accessible to potential readers.*
*Source:  Covey, Denise Troll.  "Global Cooperation for Global Access:  The Million Book Project“ **OCLC analysis of the Google Books Library Project:   

9. Digital Library Definition
Digital Library (DL) may be seen as “Collection of intelligent creations by human beings through their own language and culture. It also reflects cultural heritage besides providing archive and generating many research issues pertaining to Natural Language Processing”

10. Digital Library ?
Sun Microsystems defines a digital library as the electronic extension of functions users typically perform and the resources they access in a traditional library.
These information resources can be translated into digital form, stored in multimedia repositories, and made available through Web-based services.
According to other definition Digital libraries are
“Organizations that provide the resources, including the specialized staff, to select, structure, offer intellectual access to, interpret, distribute, preserve the integrity of, and ensure the persistence over time of collections of digital works so that they are readily available for use by a defined community or set of communities”.

11. What is Digital library ?
A Service? An Architecture?
A set of Information Resources?
A set of tools to locate, search, retrieve information?
Possibly the tools to create such resources and services also fall within the purview of DLs
Digital face of traditional libraries
Include both digital collections and traditional
Backbone and nervous system of libraries.

12. Digital library Vs traditional library
Efficient & qualitative services by collecting, organizing, storing, disseminating, retrieving and preserving the information.
Preservation benefits besides making information retrieval & delivery more comfortable.
Online access to historical and cultural documents whose existence is endangered due to physical decay.
Digital libraries necessarily include a strong focus on the management of digital content, just as traditional libraries have focused for long on the management of content in physical forms.

13. Digital Content Management
Most of the digital content that is being managed includes:
Human Language, in various forms character-coded electronic text, scanned images, printed or handwritten text or human speech.
Language technology helps in managing digital content
Management through learning from past experience also adds to manage content
The major areas for great exploitation are:
Information retrieval,
multimedia,
database,
data mining,
data warehouse,
on-line information repositories,
image processing, hypertext,
World Wide Web and wide area information services (WAIS).

14. Few advantages of digital libraries
Access anywhere
Reducing delays
Distributed storage – central access
Better cataloguing
Cross references to other documents
Full text search
Protected information source
Wide exploration and exploitation of the information
The information explosion, the wide bandwidth data networks and the potential of Internet-based technologies - such as the Web - make digital libraries one of the important application areas of computer science.

15. Process of Digital Preservation
Centralized Server
Book scanning status
XML Meta File Creation using Dublin core Std.
Scanned Image in TIFF format
S/w to divide even & odd pages
Batch cropping & Cleaning
OCR
Conversion to TXT/RTF/HTML
Yes No
Uploading
Reject the Book

16. Goals of DL
Focused on digitization technology, metadata schemes, data management techniques, and digital preservation.
Second-generation digital library
exploring new opportunities and developing new competencies.
Third-generation digital library
focusing instead on fully integrating digital material into the library’s collections through a modular systems architecture.

17. Ingredients for DLs Hardware Software Digital Objects
The minimum machinery to do the job
Software
The programs for handling data
Digital Objects
Articles, Conference Papers, Thesis,……
Basic Skills
Things one has to learn

18. Flatbed – Auto feed, Back to back Book Scanner
Hardware
A Server
You’ll need access to a web server
A good PC
Scanners
Flatbed – Auto feed, Back to back MF
Book Scanner

19. Software Open Source Software (OSS) Dspace, E-Prints, Fedora, GSDL……
Proprietary software you can’t avoid
Image Editing and Optical Character Recognition Software have to be purchased

20. Content is King
The information content is more important than the systems used for its storage, management and retrieval
Objects should not be “locked” in specific DLs or archives

21. Creating DLs … Six steps Selecting Acquiring Digitization
Creation Of Meta Data
Organizing
Archiving
Providing Access

23. Possible Delivery Formats
Pure image formats: TIFF, JPEG
Open encoded formats: XML, HTML, ASCII, and Unicode
Hybrid formats: PDF, DjVu – can contain both image and text
Proprietary formats: Microsoft Word, WordPerfect

24. Digitization: Issues
Copyright
Access copy and archive copy
File size
Storage media( CD, Hard disc…)
File format ( TIFF,JPEG…)

25. Challenges in Digitization
Tefko Saracevic, Rutgers University
Challenges in Digitization
Building digital collections of national importance from existing texts, documents, images . . .
Creating new digital documents & linking them
Subject portals: Selecting and maintaining open source digital resources
Developing / adapting management tools for digital collections
Providing access to digital collections
R&D in digital libraries provides a number of various opportunities to many other institutions - universities, national and regional libraries, information services, information businesses, publishers, international agencies, software providers, and the like. The range is large. And there are examples of many of those already involved in many countries, and in international efforts.
The list of opportunities for projects on the two slides is not an exhaustive list. It provides examples of efforts. Moreover, these opportunities can be combined in a number of ways to build more comprehensive projects and approaches. 25 25

26. Challenges.. Integrating digital & other library collections
Tefko Saracevic, Rutgers University
Challenges..
Integrating digital & other library collections
incl. integration of OPACs, subscribed e-resources and subject portals
Establishing services for digital libraries
online access & offline support
education & training of users and librarians
Addressing social, legal, policy issues
On the last opportunity (outsourcing): a number of commercial companies went into business providing services for various aspects of digital libraries. A typical example, are companies that offer facilities and service to digitize a collection at a given price per page, image etc.
There are other companies that provide server and storage facilities and services for digital libraries of universities, companies etc.
There are also companies that provide integrated software for digital libraries. Thus, digital libraries have also created a very lively commercial market.
This provides an opportunity for libraries to shop around and avoid own development of necessary infrastructure & related services.
Web examples of such services are provided in a previous slide. 26 26

27. Challenges in Publishing
Preservation of layout
Searchability of content and metadata
Efficient image compression
Easy browsing of books
Accommodating low bandwidth user
Multilingual text support
Multipaging

28. Digital Library Support in India
Tefko Saracevic, Rutgers University
Digital Library Support in India
Funding
Ministry of Communication & Information Technology (MIT)
Ministry of Human Resource Development (MHRD)
Manuscript Mission of India
Department of Scientific & Industrial Research (DSIR-TRP)
All India Council for Technical Education (AICTE)
University Grants Commission (UGC) 28

29. Digital Library Initiatives in India
Tefko Saracevic, Rutgers University
Digital Library Initiatives in India
Library Consortium in India
Scholarly Science Journals
Theses & Dissertations
Institutional E-Print Archives
Books (out of copyright)
Manuscripts
Newspapers
Online Courseware
Open Access at Metadata Level
Portal and Gateway Services 29 29

30. Government of India Others Min. of C&IT Min of Culture
Universal Digital
Library
National Manuscript Library
CSIR E-Journals Consortium
INDEST-AICTE
Consortium
UGC Infonet Consortium
FORSA Consortium
IIM Libraries Consortium

31. Participating centers of DLI
Digital Library of India
Participating centers of DLI
PTU-1
PTU-2
PTU-3
Rashtrapathi
Bhavan
ERNET
CDAC Noida
IIIT-Allahabad
CDAC Kolkata
MIDC
Pune University
IIIT-H
State & City
Central Library
University of Hyderabad
Goa University
IISc
TTD Tirupati
Sringeri Mutt
Mega Scanning Centres at
IIITH, IIITA
CDAC- Noida and Kolkatta
Anna University
IISc, IIAP,
PoornaPragya
Kanchi Mutt
ASR Melkote
SASTRA
AKCE

32. Digital Library Initiatives in India
Tefko Saracevic, Rutgers University
Digital Library Initiatives in India
Some Examples 32

33. Digital Library of India Workshop on Institutional Repositories
Tefko Saracevic, Rutgers University
Digital Library of India
April 20, 2009
Workshop on Institutional Repositories 33 33

35. Workshop on Institutional Repositories
Tefko Saracevic, Rutgers University
April 20, 2009
Workshop on Institutional Repositories 35 35

36. Workshop on Institutional Repositories
Tefko Saracevic, Rutgers University
April 20, 2009
Workshop on Institutional Repositories 36 36

37. Workshop on Institutional Repositories
Tefko Saracevic, Rutgers University
April 20, 2009
Workshop on Institutional Repositories 37 37

38. Workshop on Institutional Repositories
Tefko Saracevic, Rutgers University
April 20, 2009
Workshop on Institutional Repositories 38 38

39. Tefko Saracevic, Rutgers University39 39

40. Tefko Saracevic, Rutgers University40

41. Tefko Saracevic, Rutgers University
Manuscripts
India has the largest collection of manuscripts in the world (5 million Approximately).
India is the repository of an astounding wealth of ancient knowledge belonging to different periods of history, going back to thousands of years. Most of this knowledge belonging to different areas of intellectual activity such as religion, philosophy, science, arts and literature is preserved in the form of manuscripts. Composed in different Indian languages and scripts, they are preserved in materials such as birch bark, palm leaf, cloth, wood, stone and paper.
National Manuscript Mission was launched five-year programme in Feb., 2003 by the Ministry of Human Resource Development, Govt. of India to get all the manuscripts and conserve them. 41

42. Tefko Saracevic, Rutgers University 42

43. Archives of Indian Labour V.V. Giri National Labour Institute
Tefko Saracevic, Rutgers University
Archives of Indian Labour
V.V. Giri National Labour Institute
Heritage of Indian Working Class
Commissions on Labour
Oral History Collections
Trade Union Collections
Regional Collections
Strike Collections
Powered by Green Stone Digital Library 43 43

44. Digital Libraries Benefits : Individual
Gain access to the holdings of libraries worldwide through automated catalogs. Locate both physical and digitized versions of scholarly articles and books.
Optimize searches, simultaneously search the Internet, commercial databases, and library collections.
Save search results and conduct additional processing to narrow or qualify results.
From search results, click through to access the digitized content or locate additional items of interest.
All of these capabilities are available from the desktop or other Web-enabled device such as a personal digital assistant or cellular telephone.

45. Tefko Saracevic, Rutgers University
Conclusion
Digital Libraries are redefining the role of libraries in society & the role of librarians & information specialists
National level mechanism is essential to promote and coordinate open access and public domain digital library systems
Improve awareness of open access
Regular training – tools, processes, standards
Support setting up of working models, services
National Resource Centre for open access publishing
International agencies like UNESCO, ICSU, ICSTI, CODATA need to actively promote and support developing country initiatives 45

46. References
Digitization Of Library Forum Survey IT Act . Available at
A digital library for education: the PEN-DOR project. The Electronic Library, 17(2),
Government of India “Background Report on IT for Masses” itformasses.nic.in/vsitformasses/page1.htm
Government of India IT for the Common Man: The Millenium IT Policy. Department of Information.

47. Thank You 47