What is Sakai QA? Alan Berg, Interim QA Director, Sakai Foundation Anthony Whyte, Release manager, Sakai Foundation Aaron Zeckoski, Software Engineer, Unicon and Maint team lead, Sakai

Agenda The Release Management Process Quality Assurance QA boundaries Current Automation Work in progress The Maintenance Team How to get involved March 20102European Sakai Conference – Valencia - Spain..

The Release Management Process And now here’s a… March 2010European Sakai Conference – Valencia - Spain..3

Quality Assurance And now here’s a… March 2010European Sakai Conference – Valencia - Spain..4

Help out with QA for

QA Boundaries Making life predictable

QA Boundaries Define basic measurable criteria for when to cross boundaries Work in progress Expect product council to be more active in definitions later. Alpha, beta, release candidate, general availabilty Alpha = Not functionally frozen Alpha => Beta Frozen state, no 2.x.x dependencies in pom files. Beta - Cross cutting concerns reviewed Security review Log review Static code review Special characters As much functional code coverage as possible Review of Jira (Maintenance team/QA) 2.7 process not perfect, lack QA resources Large amount of historic maintenance hidden in the bug database

Beta to Release Candidate Beta's occur once every two weeks. A release candidate transition occurs after there are no outstanding blockers and all critical issues have been assigned with a clear time to finish. The Executive Director can override this criteria for specific Jira's. All micro defects from the code reviews needs to have been removed. During this period of time QA performs as many functional tests as possible and signals any logistic issues. Greater QA resources = Quicker transition from beta/RC

Release Candidate to General Availability Tagging is driven by the cleaning up of code. The longest time between tagging is 3 weeks. If this not achievable due the lack of resources then the Release Manager signals this to the community and the Executive Director and the Executive Director makes an appeal for resources. The Executive Director accepts that the Sakai final tag based on a memo from the QA director with comments from the Release Manager. The final tag can only be cut if there no blockers. All significant issues are described in the release documents. The product council is informed of the known issues document and have the right to recommend extra release candidates. No issue is left unassigned.

General Availability There is a clear relationship between QA and early adopters. QA is actively involved, log files are parsed for new errors, data is collected over usage. Early adopters help form the maintenance teams priorities. The first minor tag is released within a month of the major tag. The criteria for acceptance of a minor tag is defined.

QA Automation Historically, static code review Work in progress Move towards active testing nightly Corey/ Automated functional testing Continuous builds Stress testing Need time to automate after 2.7 released

Automation links Positioning Paper Daily reports Work in progress Idea’s page QA Contrib Sonar – David Haines

Plug for the Sakai Book And now here’s a… March 2010European Sakai Conference – Valencia - Spain..13

The Maintenance Team And now here’s a… March 2010European Sakai Conference – Valencia - Spain..14

MT (maint team) March 2010European Sakai Conference – Valencia - Spain..15

How to get involved And now here’s a… March 2010European Sakai Conference – Valencia - Spain..16

Blood and Treasure BLOODTREASURE March 2010European Sakai Conference – Valencia - Spain..17

3 main ways Get to work Assets (people) and Resources (hardware) MT, QA, RM, Pay your dues Foundation subscription Commercial Buy In Commercial partners and support programs March 2010European Sakai Conference – Valencia - Spain..18

Buying product development “How do you support Sakai QA/development?” Commercial development programs May also benefit the community Make contributing the code back part of the contract March 2010European Sakai Conference – Valencia - Spain..19 Contributes all code back as requested by client Sakai Skin Manager, Sakai Maps and the Sakai Knowledge Base

Unitech Sakai Corrective Support Monthly subscription service Multiple levels (higher cost for more support) and phone based Can be used for local or community fixes Contact: March 2010European Sakai Conference – Valencia - Spain..20

rSmart Enterprise Support Subscription 2 nd and 3 rd tier support for you local instance Hosting services Tool development OSP tools, Xslt Portal, Websphere and DB2 support, Virus scanning in content hosting, Elluminate Integration, Icodeon Integration Contact: March 2010European Sakai Conference – Valencia - Spain..21

Unicon Cooperative Development/Support for Sakai Yearly subscription, multiple levels All development (bugs and features) is done with and goes back to the Sakai community Includes local support and assistance Hosting and contract development Contact: Charise Arrowood (Webinars)Charise ArrowoodWebinars March 2010European Sakai Conference – Valencia - Spain..22

GET INVOLVED! March 2010European Sakai Conference – Valencia - Spain..23

Questions and maybe some Answers March 2010European Sakai Conference – Valencia - Spain..24