1. M.Nedim Alpdemir, Anastasios Gounaris¹, Arijit Mukherjee², Desmond Fitzgerald, Norman W. Paton¹, Paul Watson², Rizos Sakellariou¹, Alvaro A.A. Fernandes¹, Jim Smith 2 1 University of Manchester, UK 2 University of Newcastle, UK Acknowledgement: Much of the content in many of the slides has been authored by co-workers, especially Nedim Alpdemir and Jim Smith. Errors are mine, of course. Experience on Performance Evaluation with OGSA- DQP

2. 21 Sep 2005AHM 20052 Outline of talk The OGSA-DQP system Impact of infrastructure layers Profiling

3. 21 Sep 2005AHM 20053 OGSA-DQP system Unified view of and access to remote DBMSs

4. 21 Sep 2005AHM 20054 Selecting Resources in OGSA-DQP Unified schema machines

5. 21 Sep 2005AHM 20055 Evaluating Queries in OGSA-DQP query plan

6. 21 Sep 2005AHM 20056 High level architecture

7. 21 Sep 2005AHM 20057 Brief tour: an illustration http://phoebus.cs.man.ac.uk:8080/ogsa/services/ogsadai/GridDataServiceFactory http://rpc676.cs.man.ac.uk:8080/ogsa/services/ogsadai/GridDataServiceFactory http://mygrid.ncl.cs.ac.uk:8080/ogsa/services/ogsadai/GridDataServiceFactory http://phoebus.cs.man.ac.uk:9090/axis/services/EntropyAnalyserService?WSDL varchar 12 varchar 12 varchar 12 id 130.88.192.230 http://phoebus.cs.man.ac.uk:9090/ogsa/services/ogsadai/GridDataServiceFactory http://130.88.198.195:9090/ogsa/services/ogsadai/dqp/GridQueryEvaluationFactory/hash-11025450- 1076603541049 goterm goterm.OID string goterm.id string goterm.type string goterm.name goterms http://130.88.192.230:9090/ogsa/services/ogsadai/GridDataServiceFactory/hash- 31056514-1076603576481 goterms LIKE...

8. 21 Sep 2005AHM 20058 Where we are The OGSA-DQP system Impact of infrastructure layers Profiling Work based on publicly available releases OGSA-DQP 2.0, OGSA-DAI 4.0, GT 3.2. !! Some of the figures presented do not describe the behaviour of the system any more and refer to pre-optimisation stages. Complementarily, see OGSA-DAI papers in AHM2004-5.

9. 21 Sep 2005AHM 20059 Data Sources Protein_goterm (16803 rows @ 24B ~ 404KB) Protein_interaction (4716 rows @ 47B ~ 227KB)

10. 21 Sep 2005AHM 200510 Representation in WebRowSet

11. 21 Sep 2005AHM 200511 (1) Access Techniques

12. 21 Sep 2005AHM 200512 Configurations JDBC local/remote GDS local/remote sync/async OGSA-DQP GQES co-located with GDS GQES calls GDS asynchronously

13. 21 Sep 2005AHM 200513 Scan-1 (protein_goterm)

14. 21 Sep 2005AHM 200514 Scan-2 (protein_interaction)

15. 21 Sep 2005AHM 200515 Join (both tables)

16. 21 Sep 2005AHM 200516 Remote Access by Block Block access benefits local cases too (e.g. DQP access to protein_goterms 156 -> 28s)

17. 21 Sep 2005AHM 200517 (2) Breaking Down Costs 8.1 26.8 (4.8+1+22) 15.1 (9.6+5.5) Total Cost: 28.6 secs

18. 21 Sep 2005AHM 200518 (3) Parallelizing Operation Call

19. 21 Sep 2005AHM 200519 Configuration Two parameters: a number of copies of WS are available; a number of spare machines are available – compiler plants an op-call on each.

20. 21 Sep 2005AHM 200520 Measurements

21. 21 Sep 2005AHM 200521 Lessons Increase granularity of inter-service communication, like access to GDS. Reduce delivery cost – coalesce root evaluator within GDQS – in progress. Parallelizing expensive operations can be beneficial – ongoing work. Translations performed in transfers and XML WebRowSet processing can be expensive – ongoing work.

22. 21 Sep 2005AHM 200522 Current Work New Release Supports WS-RF/ WS-I Builds on top of OGSA-DAI 7.0 (due in September) Includes optimisations Investigating adaptive and fault-tolerant mechanisms

23. 21 Sep 2005AHM 200523 Contact OGSA-DAI and OGSA-DQP software http://www.ogsadai.org.uk http://www.ogsadai.org.uk/dqp Project site, mentioning adaptivity and fault-tolerance http://www.ncl.ac.uk/polarstar