1. Archiving the Mobile Web Frank McCown, Monica Yarbrough, & Keith Enlow Computer Science Dept Harding University WADL 2013 Indianapolis, IN July 25, 2013

2. Mobile vs. Stationary Web

3. Mobile Web-Related Markup Languages http://en.wikipedia.org/wiki/File:Mobile_Web_Standards_Evolution_Vector.svg Smartphone era

4. Two Types of Mobile Web Feature Phone Web Smartphone Web cHTML (iMode), WML, WAP, etc. XHTML, HTML5, etc.

6. Serving Up Mobile Sites 1.Responsive web design Same HTML content to desktop and mobile CSS media queries alter appearance @media (max-width: 600px) {.sidebar { display: none; } }

7. Example of Responsive Web Design

8. Serving Up Mobile Sites 1.Responsive web design Same HTML content to desktop and mobile CSS media queries alter appearance 2.Redirect mobile user agent to mobile site Client-side redirection Server-side redirection

9. Client-Side Redirection JavaScript detects mobile user agent // From www.harding.edu var ua = navigator.userAgent.toLowerCase(); if (queryString.match('version=mobile') || ua.match(/IEMobile|Windows CE|NetFront|PlayStation|like Mac OS Z|MIDP|UP\.Browser|Symbian| Nintendo|BlackBerry|mobile/i)) { if (!ua.match('ipad')) { if (window.location.pathname.match('.html')) window.location = window.location.pathname.replace('.html', '.m.html'); else window.location = window.location.pathname + 'index.m.html'; }

10. Client-Side Redirection

11. Server-Side Redirection Server routes mobile user agent to different page Apache Example: RewriteEngine On RewriteBase / RewriteCond %{HTTP_USER_AGENT} (android|bb\d+|meego).+mobile|avantgo|badda\/|blackberry|blazer|etc…|zte\-) [NC] RewriteRule ^$ http://detectmobilebrowser.com/mobile [R,L] https://developers.google.com/webmasters/smartphone-sites/details

12. Server-Side Redirection

13. Serving Up Mobile Sites 1.Responsive web design Same HTML content to desktop and mobile CSS media queries alter appearance 2.Redirect mobile user agent to mobile site Client-side redirection Server-side redirection 3.User-agent content negotiation Dynamically serving different HTML for the same URL

14. User-Agent Content Negotiation Server serves up different content for same URL Use Vary: User-Agent header in response Best method for serving content quickly

15. Archiving Mobile Sites 1.Responsive web design Easy: Crawl like normal Use client tools to view page formatted for mobile 2.Redirect mobile user agent to mobile site Need to crawl with mobile user agent Need JavaScript-enabled crawler to handle client-side redirection 3.User-agent content negotiation Need to crawl with mobile user agent Need to distinguish mobile vs. desktop for same URL

16. How are we doing archiving mobile sites so far?

18. Earliest archived page

19. Earliest 2007 archived page: WML

20. Finally some news!

21. Really???

22. Great…

23. Only desktop version is archived!