1. SDT NIWA Systems Development Team Andrew Watkins SDT Overview Taking dull repetitive work from scientists and giving it to robots since 2008.

2. People Processes & Tools SDT People

3. The Team SDT

4. The Team SDT Colocated Agile Methods Diverse Skills Mix of Youth and Experience Capacity and Capability 80:20 Development & Research

5. Work on SDT Dataware Middleware Web services Web User interfaces Thick and thin application clients Mobile, fax, and email notification services Other Technical Stuff

6. Don’t Work on SDT Static Web content - Communications Office Systems – IT Operations Intranet GIS Scientific programming Model Development High Performance Computing Facility

7. Key Relationships SDT IT General Manager – Arian de Wit IT Operations – Anthony Cole Chief Scientist EI – Jochen Schmidt GIS – Arne Pallentin Scientists Public and Science Users Peer groups

8. People Processes & Tools SDT Proceses

9. Processes SDT Agile development methodology Full Software Engineering Life Cycle Strategic Planning

10. Agile Software Development SDT Scrum Iterative development Test driven development Continuous Integration Virtual Environments Evolving process

11. Software Engineering Baseline Standard SDT Revision control. Auto build process and development project Test Coverage Deployment System Documentation Issue Tracking and change control process Run Time monitoring Technical support plan and SLA. Users and Access levels are identified Data is managed

12. Data Management Process SDT Work in progress A big sell to the science staff Overcoming hoarding Making metadata available Quality control chain What can software do?

13. Managing Multiple Projects SDT Over 80 online services Using Wiki to document – basic metadata Many legacy systems Ongoing Maintenance Sprints – burst of focus to delivery JIRA Issue Tracking – custom workflow Prioritisation

14. People Processes & Tools SDT Tools

15. Atlassian Confluence – One.NIWA SDT

16. Atlassian Confluence – One.NIWA SDT

17. Atlassian Confluence – One.NIWA SDT

18. Atlassian JIRA SDT

19. Atlassian JIRA SDT

20. Eclipse SDT

21. Subversion SDT

22. Cruise Control SDT

23. Selenium Web App Test SDT

24. Programming Languages and Frameworks SDT Java Frameworks – Struts, Seam N-Tier systems, Components Web services, Web UI PHP Frameworks – Symfony, Zend Simpler systems, Front ends

25. Relational Database SDT PostgreSQL/ PostGIS –Free, Open Source, Full Featured –Strong Geospatial Support Oracle –Perceived Quality, Performance –License costs – Distribution issues. Others - Legacy –Informix, Empress, Paradox, MySQL –Actively retiring

26. Non Relational Database SDT eXist –XML datastore –Good for reference information –Lookups, Code lists –XQuery –XSLT

27. NIWA Systems SDT Policy

28. NIWA Systems Goals Web Friendly Restful Documented APIS Open Data by default Open Source tools first choice Mostly Free Standards Compliant SDT

29. NIWA Systems Goals Avoid Vendor Lock in Avoid CMS Embedding Avoid Brand Embedding Don’t reinvent wheel Have Fun SDT