1. 1 Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness and Joanne Luciano With Peter Fox and Li Ding CSCI-6962-01 Week 10, November 8, 2010

2. Contents Review of reading, questions, comments Technology and how to use it Summary Next week 2

3. Reading from last week Provenance - PML, Inference Web, Implementation - IAAI VSTO, Semantic eScience Web Services, Computers and Geoscience 3

4. 4 Semantic Web Methodology and Technology Development Process Establish and improve a well-defined methodology vision for Semantic Technology based application development Leverage controlled vocabularies, et c. Use Case Small Team, mixed skills Analysis Adopt Technology Approach Leverage Technology Infrastructure Rapid Prototype Open World: Evolve, Iterate, Redesign, Redeploy Use Tools Science/Expert Review & Iteration Develop model/ ontology Evaluation

5. Architecture Importance of state –Grids –Web Existing infrastructure –Catalogs –Data sources –User interfaces –Services Wrapping these syntactic interface 5

6. Inventory Refer to the Resources –Files –Databases –Catalogs –Existing UI –Services –User database/ security –Logging –Backup/ archive 6

7. … … Geo App 1 Geo App 2 App 3 DB 2 DB 3 DB n DB 1  WSCommo n  Web Coverage Service  Web Feature Service  Web Mapping Service Limited interoperability

8. Fox WHOI: Semantic Data Frameworks March 20, 2008 8 The Astronomy approach; data- types as a service … … VO App 1 VO App 2 VO App 3 DB 2 DB 3 DB n DB 1  VOTable  Simple Image Access Protocol  Simple Spectrum Access Protocol  Simple Time Access Protocol VO layer Limited interoperability Lightweight semantics Limited meaning, hard coded Limited extensibility Under review

9. … … Web Portal Web Serv. API DB 2 DB 3 DB … DB 1 Semantic mediation layer: Ontology - capturing concepts of Parameters, Instruments, Date/Time, Space, Event, Feature, Data Product (and associated classes, properties) and Service Classes. Maps queries to underlying data. Generates access requests for metadata, data. Allows queries, reasoning, analysis, new hypothesis generation, testing, explanation, etc. Semantic mediation layer - mid- upper-level Education, clearinghouses, other services, disciplines, etc. Metadata, schema, data Query, access and use of data Semantic query, hypothesis and inference Semantic interoperability Data as Service

10. Implementing Let’s take an example –VSTO –Representative but does not exercise all semantic web capabilities 10

11. Fox RPI: Semantic Data Frameworks May 14, 2008 11 Web Service

12. 12

13. 13

14. 14

15. 15

17. 17 2

18. Additional Middleware Web server, Tomcat are essential (Axis) MySQL (or similar) is very handy to have OPeNDAP – for data access and transport 18

19. Fox RPI: Semantic Data Frameworks May 14, 2008 19 Web Service

21. 21 Infrastructure Protégé-OWL-API –http://protege.stanford.edu/plugins/owl/api/index.htmlhttp://protege.stanford.edu/plugins/owl/api/index.html –http://protege.stanford.edu/plugins/owl/api/guide.htmlhttp://protege.stanford.edu/plugins/owl/api/guide.html Jena (Java API for RDF and OWL) –http://protege.stanford.edu/plugins/owl/jena-integration.htmlhttp://protege.stanford.edu/plugins/owl/jena-integration.html –http://jena.sourceforge.net/http://jena.sourceforge.net/ –Migrate to other triple stores when needed

22. Using Protégé Load VSTO into Protégé 3.4 Generate Java-OWL classes from Tool menu Review other tools for generating code stubs –E.g. ELMO (http://www.openrdf.org/doc/elmo/1.3/user- guide/x463.html and http://www.openrdf.org/download.jsp )http://www.openrdf.org/doc/elmo/1.3/user- guide/x463.html http://www.openrdf.org/download.jsp 22

23. Examine some of the code Java Factory class Code stubs and ‘myclass’ VSTO code base can be made available for browsing 23

24. Jena 24

25. Infrastructure Reasoner – DIG/Pellet –http://protegewiki.stanford.edu/index.php/Protege ReasonerAPIhttp://protegewiki.stanford.edu/index.php/Protege ReasonerAPI SPARQL –http://www.w3.org/2001/sw/DataAccess/tests/imp lementationshttp://www.w3.org/2001/sw/DataAccess/tests/imp lementations Spring (Application Framework - optional) –http://www.springframework.org/http://www.springframework.org/ Eclipse (IDE) –http://www.eclipse.org/http://www.eclipse.org/ 25

26. Infrastructure Rules –OWL-2 RL –SWRL – plug-in for Protégé –Jena rules –Jess rules –Jess rules engine - http://herzberg.ca.sandia.gov/jess/ http://herzberg.ca.sandia.gov/jess/ 26

27. Software development Junit (generated in Eclipse) –http://smi- protege.stanford.edu/repos/protege/owl/trun k/junit.properties.templatehttp://smi- protege.stanford.edu/repos/protege/owl/trun k/junit.properties.template Faceted browsing – mspace 27

28. Metadata Migrate metadata into ontologies – instances, choose how you will populate them –Manual – okay to start with sufficient annotation –Scripted – preferred –rdfs_comment: essential Choose what you will not, cannot move 28

29. Services If you are going to put up services, include an end-point and a link to your WSDL (or SAWSDL) At this point, developing a full services ontology, e.g. in OWL-S may be beyond the initial implementation 29

30. Fox RPI: Semantic Data Frameworks May 14, 2008 30 Semantic Web Services

31. Fox RPI: Semantic Data Frameworks May 14, 2008 31 Semantic Web Services OWL document returned using VSTO ontology - can be used both syntactically or semantically

32. Result/ outcome Refer to the use case document Check the expected outcome and see if the test (to verify outcome) is complete Document all variations, note alternate flows Document in sufficient detail that someone else could come along and re-produce your work Include URLs for access, etc. 32

33. 2008 Assignments 33

34. 34

35. 35

36. Orchard Irrigation External slides 36

37. Diet exchange External slides 37

38. Metrics Next week we will cover evaluation but already be thinking of things you can measure –Could not do before –Faster, more complete, less mistakes, etc. –Wider range of users Estimate the baseline before you start 38

39. Summary Architectural design needs to take into account existing resources that you will leverage Keeping it simple is also very important as you begin to implement Take time to learn the tools and the supporting APIs; look at existing examples and working code Being prepared to iterate is really essential 39

40. Next week This weeks assignment: –Reading: Evaluation Next class (week 11 – November 15): –Application Project Evaluation Office hours this week – Questions? 40