U NIVERSAL N ETWORKING L ANGUAGE UNDL FOUNDATION

UNL BAMAKO 7/05/05

Content 1.Seeing is believing 2.Response to challenge of our time 3.Convergence of IT, Knowledge, Language 4.What we can do with it 5.How it works 6.What it takes to have it 7.A story

ARABIC CHINESE ENGLISH FRENCH RUSSIAN SPANNISH ARABIC CHINESE ENGLISH FRENCH RUSSIAN SPANNISH

English French Spanish Chinese Arabic Russian UNITED NATIONS: 5x6=30 Pairs

UNL English Spanish Chinese French Japanese Russian Etc... Arabic EnconverterDeconverter

UNL English Spanish Chinese French Japanese Russian Etc... Arabic Enconverter Deconverter

Internet UNL System Architecture French People Hindu People Arabic People Chinese People UNL System The property rights of the UNL belongs to the United Nations  UNDL Foundation. All rights reserved Hindi Chinese French Arabic

WEB Internet UNL Document creation Web server Web page using UNL Spanish Content Developer UNL Language Server Spanish Enconverting

UNL Language Server ENCO DECO Web Server with UNL document UNL-Language Dictionary Knowledge Base Coocurrence Dictionary Generation Rules Analysis Rules UNL NL Language Server Natural Language UNL

Deconverter Deco Generation Rules UNL-Language Dictionary UNL System Coocurrence Dictionary UNL NL Knowledge Base

Enconverter Enco Analysis Rules UNL-Language Dictionary UNL System NL UNL Knowledge Base

UNL LANGUAGE SERVER Enconverter  =  Deconverter ( EnCO) (EnCO) Language Server UNL Hindi Internet UNL Proxy Language Server UNL Japanese Language Server UNL Chinese DeCO UNL document Language Server UNL Arabic Language Server UNL Spanish USER EnCO DeCOEnCO Language Server UNL English DeCOEnCO DeCOEnCO UNL Editor UNL Viewer

LANGUAGE SERVER UNL  =  Native Language Deconversion Program DeCO Enconversion Program EnCO UNL Dictionary UNL Grammar UNL Knowledge Base 3

WEB French People Hindu People Spanish People Chinese People The UNL over the Web French = UNL Language server French Chinese Spanish Hindi SpanishEnglishHindiRussianUNL Chinese

MERCI Thank you

History of Great Discoveries and the Great Inventions To see the Forest beyond the Trees. The little stories of everyday, hide the great history and the great changes in History Most of them are unexpected Technology are response, reaction to great challenges –Technologies has a power of transforming everything, catalyzes of other movements, power of multiplying effects, opportunities; –Technologies that have higher lower power of transforming life; –When they happen, there is a Risorgimento regional.

UNL English Spanish Chinese French Japanese Russian Etc... Arabic Enconverter Deconverter

What the UNL can do ? 1)Machine Translation 2)Multilingual Information Service (e- Commerce, e-learning, e-government, e-TV) 3)Information Retrieval System (e- Commerce, e-learning, e-government) 4)Expert system 5)EncyclopaediaEncyclopaedia 6)And many others

WHAT IS THE UNL ? A set of resources comprising: –Linguistic Resources –A technical infrastructure –Knowledge Assets Inside the UNL System

Specifications of the UNL –Universal Words (UWs) –Master Definitions –Attributes –Relations –Grammar Linguistic resources

UNL Servers –EnconverterEnconverter –DeconverterDeconverter Proxy Server UNL Editor UNL Verifier UNL Explorer Manuals Technical Resources

Dictionaries: UWs, Master, Natural Language (NL) Grammatical rules for each NL Knowledge Assets

Competitors? Computer systems which can deal with knowledge and contents have been already developed. Representations of knowledge or contents are different from each other. Moreover, a representation depends on a language. Knowledge or contents of a computer system can not be used in other systems.

Who? In the case of machine translation, if we combine all the results of research and development on machine translation, we can not realize a multilingual machine translation system that can break language barriers.

Advantages of UNL The UNL, a common language for computers: –enables sharing knowledge and contents among all systems –overcomes language barriers –reduces costs of developing knowledge or contents –facilitates knowledge processing

How it works The UNL can express concepts like words do in natural languages. Ex: horse, cavalo, cheval, (Chinese ideogram), The UNL can express information like natural languages do. Ex: full description of a horse as in an encyclopaedia entry.

How UNL express information? The UNL express information by classifying objectivity and subjectivity. Objectivity is expressed using UWs and relations. Subjectivity is expressed using attributes.

300 computer scientists and linguists from universities and research institutions around the world Who are we

Language Coverage Languages already engaged: 6 UN official Languages: Arabic, Chinese, English, French, Spanish, Russian Other languages: Hindi, Indonesian, Italian, Japanese, Korean, Mongol, Latvian, Portuguese, Thai

ArabicThe Royal Scientific Society, Jordan ChineseMinistry of Electronics Industry, China EnglishUNL Centre FrenchUniversity Joseph Fourier, France GermanUniv. of Saarbrucken, Germany (inactive) HindiIndian Institute of Technology, India IndonesianBPPT Technology, Indonesia ItalianPisa CNR, Italy JapaneseUNL Centre UNL R&D Network(1)

MongolianMongol Pedagogical University, Mongolia LatvianUniversity of Latvia, Latvia (inactive) PortugueseUniversity of Sao Paulo, Brazil RussianRussian Academy of Science, Russia SpanishUniversity Politecnica of Madrid, Spain SwahiliUniv. of Dar es Salaam, Tanzania (inactive) Thai NECTEC, Thailand (inactive) UNL CentreUNDL Foundation UNL R&D Network(2)

Where we are now 1) UNL the language, Relation and Attributes (specification) Version Approved by a committee of Scholars and patent recognized by PCT countries (WIPO) 2002 Dictionary of Universal Words, Knowledge Base (Increasing volume of entries on a continuous development)

Where we are now 2) Language Server: (Operational) a) Deconverter (Language Generation System) Deco: Operational Generation Rules and Dictionary (each language): continuous development b) Enconverter (UNL Generation System) Enco: Operational Analysis Rules, Dictionaries (each language): continuous development

Where we are now 3) Tools & Applications: UNL Proxy Server: Operational UNL News: 4 publications on 2002 UW Gate: under tests UNL Verifier: under tests UNL Viewer: Prototype UNL Editor: Prototype UNL Encyclopedia: Prototype UNL Explorer: Prototype Org Explorer: Prototype

Applications in all fields of human activities Advantages for international organizations Bridging the Digital Gap Benefits for Multilingual Countries Content driven Technology: hence opportunities for employment and self employment Low cost clean investment Vision of the Future

Financial Resources Persistence: working towards cumulative results More language coverage Expanding the R&D network Challenges

Open Policy UNL (system) should be developed by all peoples in the world. We will open: UNL specifications Universal Word Dictionary Format of UNL-Language dictionary Format of Deconversion rule System interface

What we expect to be developed by people in the world UNL (system) should be developed by all peoples in the world. Universal words necessary for each language Language Servers for new languages and new domains

What we expect to be developed by people in the world Application systems such as: Information Retrieval System Search Engines Browsers Editors/Word Processors Machine translation Systems

The UNL System 1) UNL (Universal Networking Language) Dictionary of Universal Words, Relation, Attribute, Knowledge Base 2) Language Server i) Deconverter (Language Generation System) Deco, Generation Rules, Dictionary(each language) ii) Enconverter (UNL Generation System) Enco, Analysis Rules, Dictionaries(each language) 3) Tools: UNL Viewer, UNL Editor, UNL Proxy Server

UNL Proxy Server Searches for UNL at the web page accessed by the user. The UNL document is sent to the Language Server defined by the selected language. Updates the web page to be displayed on the user’s chosen language.

UNL Editor

UNL English Spanish Chinese French Japanese Russian Etc... Arabic Enconverter Deconverter

UNL Editor – select sentence

UNL Editor

UNL Encyclopaedia

“Infinite library” (M.Luis Borges) Human Knowledge Knowledge system Encyclopaedias How to build the UNL Encyclopaedia

Purpose: Gift to Humankind Submitted in 1999 to the Japanese Patent Office Recognized by PCT countries (WIPO) 2002 Application for patent e commercial protection in major countries Protection by the United Nations UNL Patent

300 computer scientists and linguists from universities and research institutions around the world Languages covered: Arabic, Chinese, English, French, Japanese, German, Hindi, Indonesian, Italian, Latvian, Mongolian, Portuguese, Russian, Spanish, Thai UNL Global Network of R&D

Purpose: Collaboration in R&D Membership: Individual and institutions At present: over 300 members from 30 countries Future perspective: Collaboration, support users UNL Society

WE… A global network of computer Scientists and Linguists + philosophers, mathematicians… UNDL FOUNDATION 8, JULY 2003

UNL : A LANGUAGE UNL is a “language” for computers (different from a “computer language”) expresses information and knowledge in digits, the characters that all computers understands enconverts contents from any natural language into UNL and then deconverts into any other natural languages. UNL Language enables peoples to build the “reservoir” of human knowledge from and to diverse natural languages

UNL English Spanish Chinese French Japanese Russian Etc... Arabic Enconverter Deconverter

UNL English Spanish Chinese French Japanese Russian Etc... Arabic EnconverterDeconverter

UNL English Spanish Chinese French Japanese Russian Etc... Arabic EnconverterDeconverter

UNL: A SYSTEM UNL has been designed to represent contents in a language independent way. UNL is a system to support multilingual information services (mainly for Internet) It can also be used as a machine translation system

European Heritage Network (HEREIN) HEREIN is a very large document repository (all documents written in three different languages) Great amount of human translation resources needed. Current contents written in UNL can be converted in more languages. Web page The Network is currently composed of administrations and/or mandated bodies from the following (27) countries : –Andorra, Armenia, Belgium (Brussels-Capital, Flemish Region, Walloon Region), Bulgaria, Croatia, Cyprus, Denmark, Estonia, Finland, France, Georgia, Hungary, Ireland, Latvia, Lithuania, Luxembourg, Norway, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden and the United Kingdom.

DEMO 1. See the Spanish report (.xml).xml 2.See the Spanish report in UNLUNL 3.Load the Spanish report in UNL into the Spanish language generator.he Spanish language generator 4.See the generated Spanish (output.txt)output.txt 5.See generation available in other languages (Russian, English, Italian).RussianEnglishItalian

THE SIZE OF THE PROBLEM/CHALLENGE Globalization of the economic activities and the political relations among states and social lifestyle is generated, supported and reinforced by global information systems. The global village emerging from the convergence of telecommunications carriers, radio and television global networks and the computers generates the conditions for a market, sharing affluence, and enjoying cultural goods. The global village creates the situation of exclusion of millions from the sharing affluence, health services education, enjoying leisure, technology comfort exchange and exposure culture, participating social activities, benefiting from economic activities, access to the market

Population Forecasts for Major Cities in 2010 (unit: millions) (14) Calcutta (India) m (15) New Delhi (India)15.58 m (16) Los Angeles (USA)13.91 m (17) Seoul (South Korea)13.91 m (18) Buenos Aries (Argentina)13.68 m (19) Cairo (Egypt)13.42 m (20) Rio de Janeiro(Brazil)13.32 m (21) Bangkok (Thailand)12.74 m (22) Tehran (Iran)11.88 m (23) Istanbul (Turkey)11.80 m (24) Osaka (Japan)10.60 m (25) Moscow (Russia)10.37 m (26) Lima (Peru)10.07 m (1) Tokyo (Japan)28.93 m (2) San Paolo (Brazil)24.97 m (3) Bombay (India)24.37 m (4) Shanghai (China)21.67 m (5) Lagos (Nigeria)21.09 m (6) Mexico City (Mexico ） m (7) Beijing (China)17.97 m (8) Dhaka (Bangladesh)17.55 m (9) New York (USA)17.23 m (10) Jakarta (Indonesia)17.20 m (11) Karachi (Pakistan)17.02 m (12) Manila (Philippines)16.06 m (13) Ten shin (China)15.70 m Source: World Bank Data/Nishi

Top 10 Languages by Population RANK LANGUAGE POPULATION ____________________________________________ 1.CHINESE (MANDARIN)885,000,000 2.SPANISH 332,000,000 3.ENGLISH 322,000,000 4.BENGALI189,000,000 5.HINDI 182,000,000 6.ARABIC (ALL COUNTRIES)177,000,000 7.PORTUGUESE 170,000,000 8.RUSSIAN 170,000,000 9.JAPANESE 125,000, GERMAN, STANDARD 98,000,000 ____________________________________________ Source: Ethnologue: Languages of the WorldEthnologue

WHAT DOES UNL OFFER ? The UNL provides users with a multilingual platform and a set software tools enabling them to communicate with other people their respective languages. With the multilingual platform in place, users can share information and knowledge across native languages. Citizens, governments, international organizations, and enterprises will all benefit from the UNL, as it provides opportunities for information sharing, education, and e- business. The ultimate goal is to promote sustainable development, dialogue among civilizations, economic prosperity for all nations as well as peace among them. The property rights of the UNL belongs to the United Nations  UNDL Foundation. All rights reserved

“enconverts” all inputs into UNL representations. This can be done interactively between the writer and the computer. The UNL “Viewer” shows back to the writer the document as it is “enconverted” from the UNL into his/her language, which represents how the system understands the original document being produced by the writer. This allows him/her to check the correctness of “enconversion”. In such an interactive process, the writer can produce UNL documents as accurate as he/she wishes. USERS do not need to know UNL, nor how the EnCO and DeCO programs operates; they just need to input correct sentences in their native languages with the help of the UNL Editor like a word processor. In bloc 1, the USER writes a document in his/her native language using a PC equipped with the UNL Language Server. The UNL “Editor” tool, in connection with the UNL Language Server, enables him/her to write it in UNL. As the USER types word by word, sentence after sentence, a full paragraph, or the whole document, the UNL Enconverter software (EnCO) instantaneously Understanding How the UNL System Works

in standing alone computers, or exchanged in local networks (LAN), or distributed through WWW servers. They can also be forwarded by file transfer program. UNL documents received in a network terminal can be deconverted into each native language and read by any people on a browser equipped with the “the UNL Language Server” set. This is one of the outstanding features of the UNL System: it allows for synchronous and asynchronous operation of multiple language servers simultaneously. In Bloc 2 the UNL document is placed on the Internet through a ”UNL Proxy server”. Information, text, documents, web pages written in UNL can be stored in archives, or downloaded and shared throughout the Internet to multiple users in all native languages equipped with the “UNL Language Server” set. UNL documents can be processed Once You Have It in UNL, You Have in It All Languages

Bloc 3 shows that each native language has its own a UNL Language Server. This allows any user to interact with others in his/her own language, while the others use theirs, through the Internet. The number of languages that can be supported is unlimited. The Language Servers are all equipped with the same set of software as in Block 1, i.e., the EnCO, DeCO programs, as well as the Editor and Viewer tools, which are connected to the Master Dictionary of UWs and the UNL Knowledge Base. Users, therefore, may write, read and exchange UNL documents from any language that has developed its UNL Language Server. They can also improve the existing UWs Dictionary, or create one where it does not exist, and expand Knowledge Base indefinitely. For these tasks, the necessary tools, specifications, instructions and manuals are available on the web. Once you Have it in UNL, you Have in It all languages

馬