1. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship Thanks Google! A LOVE / HATE relationship Stuart Lewis University of Wales Aberystwyth

2. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship Contents LOVE –Why we love Google HATE –Problems –Updates to recent versions of DSpace LOVE –Google sitemaps –Google Analytics Questions and answers

3. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE Google drives a lot of traffic to our repositories: 63.93% to http://cadair.aber.ac.uk in last three monthshttp://cadair.aber.ac.uk

4. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship HATE Load –Google et al like to index our sites –http://cadair.aber.ac.uk/ homepagehttp://cadair.aber.ac.uk/ 124 times in 3 months –http://cadair.aber.ac.uk/*http://cadair.aber.ac.uk/* 18,000+ hits ~3.7% of the total hits

5. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship HATE Not always nice –66.249.72.98 - - [11/Sep/2006:00:48:11 +0100] "GET /dspace/browse-title?top=2160%2F253” –66.249.72.98 - - [11/Sep/2006:00:48:12 +0100] "GET /dspace/browse-title?bottom=2160%2F267” –66.249.72.98 - - [11/Sep/2006:00:48:12 +0100] "GET /dspace/browse-title?top=2160%2F268“ –66.249.72.98 - - [11/Sep/2006:00:48:13 +0100] "GET /dspace/browse-title?top=2160%2F268“ –66.249.72.98 - - [11/Sep/2006:00:48:14 +0100] "GET /dspace/browse-title?bottom=2160%2F267" Brose pages create a lot of DB calls! 

6. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship HATE Recent changes to DSpace –Addition of Robots.txt file (1.4.1) –Restricts access to ‘expensive’ browse pages Except browse-title to ensure crawlers can find every item User-agent: * Disallow: /browse-author Disallow: /items-by-author Disallow: /browse-date Disallow: /browse-subject

7. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship HATE Recent changes to DSpace –If-modified-since support (1.4.1) Crawlers can ask if content has been modified since a given date, and then the server only has to present the item if it has E.g. –If-Modified-Since: Mon, 20 Nov 13:43:31 GMT ‘Cheap’ return code if it has not changed –304 (Not Modified) Also of use to browsers / proxy servers

8. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship HATE / LOVE Recent changes to DSpace –Google Sitemaps support (?) A gzipped XML file (50,000 URLS per file) In the following format: http://cadair.aber.ac.uk/dspace/handle/2160/67 2006-03-22T02:00:20Z Google only then has to index what has changed

9. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE DSpace statistics –Quite basic, but reliable and work well –Hard to see trends over time –No visualisations –No referrer statistics

10. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE Google Analytics tool –http://www.google.com/analyticshttp://www.google.com/analytics –Small bit of javascript in header <script src="http://www.google-analytics.com/urchin.js" type="text/javascript"> _uacct = "UA-434838-1";  your site id urchinTracker(); –Doesn't get called by crawlers

11. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE

12. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE Google Analytics tool –Can create filters –Lots of superfluous functionality Designed to link in with AdWords™ and Ecommerce systems –A lot of stats, hard to find what you want –Some examples…

13. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE

14. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE

15. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE

16. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE

17. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE

18. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE

19. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship LOVE Google Analytics tool –Very nice –Quite big – hard to find your way around! –Not integrated 

20. Stuart Lewis, UWA Thanks Google! A LOVE / HATE relationship The end! Stuart Lewis –Stuart.Lewis@aber.ac.ukStuart.Lewis@aber.ac.uk Any questions?