Blogging, Googling, Syndication: What’s the Web coming to? Ian Graham Enterprise IT Strategy & BMO Connect, T&S T: E: W:

What this talk is about The culture of web applications The culture of web applications –What are the new applications about? –How are they ‘designed’ and put together –Where are they taking the ‘public’ Web Examples (Lots) Examples (Lots) –That help to illustrate the above Some conclusions Some conclusions What the talk is not about –Banking/financial services, software development, Web Services (tech details)

Web culture Location Location Connectivity Connectivity Discovery Discovery Communication & Presence Communication & Presence Community Community Blogging Syndication  RSS Google Jabber, ICQ Ebay, Yahoo, Slashdot, Amazon, Blogspots, … The right side lists just a few examples: there are many others … The right side lists just a few examples: there are many others …

A) Having a home: Blogging Short for ‘Weblogging’ Short for ‘Weblogging’ –A ‘log’ authored on / accessible over, the Web »Simple Web-site generation –Personal (or group) publishing & communications: »Users often publish regularly (daily, or weekly), and link to friends / colleagues / coworkers »Links establish virtual ‘communities’ with shared interests »Categorization for topics, etc. –Software is often free to download (and play with) »Free (or near) hosting available (see list at end) –Software often supports user-level scripting to building custom functions, behaviors

Some Example Blogs – –A ‘normal’ person (purely social site) [1] [1] – –Inventor of JavaScript – roadmap for development team 63.aspx 63.aspx – –Internet Explorer development team member – –Articles on software development rchive.html [2] rchive.html [2] – –Reported from inside Iraq before and during last year’s war

Uses of Weblogs Pure social networking Pure social networking –Post musings and share them with friends (Semi-) professional information sharing (Semi-) professional information sharing –Post information for more general communication (e.g. news, current affairs, professional commentary) Work-related networking Work-related networking –Post status reports, decisions and analyses, etc, for sharing / cross-linking with others. Popularity? Popularity? –There are millions of blogsites!

Blogspace The collection of blog sites all across the Internet Unconnected except for hand-created links in the pages

B) Two issues: 1. Letting people know what you have –Publishing information ‘about’ blog postings »RSS, Atom: XML languages for summary publishing RSS  Resource Site Summary; RDF Site Summary; Really Simple Syndication …) – [ example later ] RSS  Resource Site Summary; RDF Site Summary; Really Simple Syndication …) – [ example later ] –Also used by regular web sites, news sites, etc. 2. Finding interesting/relevant stuff –Aggregation sites and clients »aggregating info ‘about’ published blogs / other sites »Headliner clients, topic-specific Web sites –Categorization and rating systems »Categorize blog items, Web page/sites »separate wheat from chaff

B.1 RSS Feeds from a blogsite Time-stamped ‘summary’ about a blog item Time-stamped ‘summary’ about a blog item Metadata (for cataloging, indexing) Metadata (for cataloging, indexing) Headline text Headline text A link back to the original A link back to the original … An ‘ad’ for the original content. … An ‘ad’ for the original content. Dave Massy [MSFT] Security, Security, Security /06/20/ aspx Sun, 20 Jun :56:00 GMT This topic seems to be coming up <img src =" dmassy/aggbug/ aspx" width = "1" height = "1" /> …more text … E.g.:  RSS link [3]

B.2. Aggregators & Syndicate Retrieves and categorizes RSS from blog (and other) sites And provides a categorized feed to users, or a Web listing: (a Blog aggregator) (an RSS feed aggregator) [4] (an RSS desktop client) [5] RSS or HTML

Aggregator APIs: APIs for talking to aggregation sites APIs for talking to aggregation sites –Simple, easy to use, often URL-based –E.g. Meerkat API -- » [6] html -- \ API documentation) –API based on arguments in the URL (docs above explain how it works). Here are some examples: » [6.1,6.2] » RSS feed of items in profile category 1065 Same, but use RSS 1.0 format for feed

And Embeddable in Pages: (... demo.html) [6.3] Example of inclusion of RSS feeds using JavaScript Heading For the Example Here is some regular HTML -- ok, i didn't have time to make it pretty And here is the JavaScript example code: Returned script sent by Meerkat; writes out HTML summaries into file

Summary Blogging is for individuals Blogging is for individuals RSS (and syndication) help build connectivity, and communities RSS (and syndication) help build connectivity, and communities Aggregators support simple APIs so it’s easy to build functions that integrate these tools with others (blogsites, portals, other..) Aggregators support simple APIs so it’s easy to build functions that integrate these tools with others (blogsites, portals, other..) –Richer communities via richer functionality –No conscious high-level architecture: people just try new ideas, and seeing what works (or doesn’t) –A heterogenous collection of apps, sharing using simple protocols, APIs. Each application and protocol is simple (limited scope, easy to use ), and open (encourages reuse, extension) Each application and protocol is simple (limited scope, easy to use ), and open (encourages reuse, extension) URL as a reference / API is key to this model URL as a reference / API is key to this model

C. Googling A web search engine A web search engine – –Other stuff: »Blogger.com; Google groups, special search services, maps, Gmail ( ) etc. Some numbers: Some numbers: –Estimated space> 2,000,000 GB –Number of servers  100,000 (Linux) Access to the index: Access to the index: –Via several APIs, some simple, and some complex

Google as a service Via APIs that let you reuse the google engine as part of your own application: Via APIs that let you reuse the google engine as part of your own application: –A URL-based API (like Meerkat) –A full-blown Web services interface –The latter lets you, essentially, use Google as the search engine / database within your own applications (subject to restrictions)

Google’s URL-based API (... demo-google.html) [7.1] <input type="hidden" name="cof" value="LW:600;LH:58;L: <input type="hidden" name="domains" value=“bmo.com"> <input type="hidden" name="sitesearch" value=“bmo.com"> Info

Google’s Web Services API Experimental interface, but widely used Experimental interface, but widely used –Requires registration for access key (simple, and free) –Provides library and tools for building simple applications, using SOAP-based web services. »Java and.NET examples provided API covers API covers –Ways to query the google database –Response formats / error responses

Google Example [7.2] public class GoogleAPIDemo { public static void main(String[] args) { … // Create a Google Search object, set our authorization key GoogleSearch s = new GoogleSearch(); s.setKey(clientKey); // do search or cache query, then print out result try { if (directive.equalsIgnoreCase("search")) { s.setQueryString(directiveArg); GoogleSearchResult r = s.doSearch(); System.out.println("Google Search Results:"); System.out.println(r.toString()); } else if (directive.equalsIgnoreCase("cached")) { …. } else if (directive.equalsIgnoreCase("spell")) { … } else { printUsageAndExit(); } } catch (GoogleSearchFault f) { System.out.println("The call to the Google Web APIs failed:"); System.out.println(f.toString()); } } private static void printUsageAndExit() { … } }}

Google Summary Simple API focused on single function Simple API focused on single function –Querying the google database. Loose coupling Loose coupling –Google doesn’t care about you, or what you’re doing. Coarse-grained Coarse-grained –Here’s a query, and there’s your answer. No details beyond those needed for business function. These two characteristics are core to almost all ‘Web’ development models. These two characteristics are core to almost all ‘Web’ development models.

D. Jabber: Messaging & presence Jabber server Jabber server Jabber clients Presence User directory Proxys to Yahoo, ICQ Other services Jabber servers

Jabber Example Jabber server Jabber server Jabber client Connect register presence Lookup user contact database Send text message contact database Jabber client Requests and responses all sent in XML Generic XML protocol for exchanging messages, plus some services. Can be extended to non-text messaging applications Now used for virtual presence: lets you know who else is at a blog or other web site Jabber client [8.1]

Virtual Presence (Jabbber extension: [8.2]) 1. Web Server registers with virtual presence (VP) server, using a URL 2. VP client gets name of VP server (URL) from Web server. 3. VP client registers with VP server. 4. VP server tells VP client who else is there. 5. VP client provides chat service to other users of the site. VP server WS 1 VP client

Key features Simple, single-purpose Simple, single-purpose URL-based referencing scheme URL-based referencing scheme –Underlying protocol uses XML Loose coupling between components Loose coupling between components –servers, clients – failure is expected Less-simple protocol / API Less-simple protocol / API –May explain why it isn’t as popular as other technologies.

And many other examples Bittorrent - file sharing / transfers[9] Bittorrent - file sharing / transfers[9] – Wikis collaborative web authoring Wikis collaborative web authoring – – …

An example application Web page (from web server) that includes data from an aggregator, Web page (from web server) that includes data from an aggregator, –uses google to provide searching –publishes new content info using RSS –Uses jabber to provide presence functionality to visitors –Provides bittorrent links to downloadable data All integrated using URLs, and simple web protocols. All integrated using URLs, and simple web protocols.

Conclusions Social  focus on community, networking, connection, sharing Social  focus on community, networking, connection, sharing Technical  Software design focused on Technical  Software design focused on –Simplicity of interfaces, and applications –URL as the key reference for an application, function, method –Loose coupling between applications »Construction of Web applications by integrating these different ‘application services’ together.

Conclusion II “ A large part of how we think about music is influenced by the methods by with which it has conventionally been distributed. We think of pop songs as being three or four minutes long because 40 years ago that was all that could fit on one side of a vinyl single.” “ A large part of how we think about music is influenced by the methods by with which it has conventionally been distributed. We think of pop songs as being three or four minutes long because 40 years ago that was all that could fit on one side of a vinyl single.”Moby We often think of Internet-based computing is the same way -- in terms of what we know -- not what it is becoming. It is different, and challenges our thinking! We often think of Internet-based computing is the same way -- in terms of what we know -- not what it is becoming. It is different, and challenges our thinking! Couldn’t be a more fun time to be doing software! Couldn’t be a more fun time to be doing software!

Blogging, Googling, Syndication: What’s the Web coming to? --- The End --- Ian Graham Enterprise IT Strategy & BMO Connect, T&S T: E: W:

Some Tools and Sites Blogging software – – – – – – – – Free blogging sites – –  (Ian’s site) – – RSS / Atom Aggregation sites – – – – – – – – (Open Wire Service) » »API Documentation: RSS / Atom Desktop clients – – – –

Some Tools and Sites Google tools and APIs – –Google Hacks, Calishain and Dornfest, O’Reilly and Associates, 2003 » » – – – – (Free websearch) – – (custom search) – – – – (Google Web service APIs) Jabber – – – – (virtual presence extension) Bittorrent – – Wikis – – (all about Wikis) Java Development Kit – –