EMI is partially funded by the European Commission under Grant Agreement RI-261611 Product Integration (testing) Balázs Kónya, Lund University 3rd EMI.

Slides:



Advertisements
Similar presentations
Improving Process for Better Software. Who We Are An experiential learning program that provides technology solutions for our partners, and real- world.
Advertisements

© Company Confidentialwww.itcinfotech.com Business Case for Test Automation S.Janardhanan Chief Technology Officer ITC Infotech India Limited Business.
Release & Deployment ITIL Version 3
EMI INFSO-RI SA2: Session Summary Alberto Aimar WP Package Leader 1 June 2011, Lund.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Future support of EGI services Tiziana Ferrari/EGI.eu Future support of EGI.
EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.
EMI INFSO-RI EMI SA2 Report Quality Assurance Alberto Aimar (CERN) SA2 WP Leader.
EMI INFSO-RI EMI Quality Assurance Processes (PS ) Alberto Aimar (CERN) CERN IT-GT-SL Section Leader EMI SA2 QA Activity Leader.
EMI is partially funded by the European Commission under Grant Agreement RI Post EMI Plans and MeDIA Alberto DI MEGLIO, CERN Project Director WLCG.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI SA2 services evolution (after the end of EGI-InSPIRE) Peter Solagna, Michel.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
EMI is partially funded by the European Commission under Grant Agreement RI Software stack consolidation Balázs Kónya, Lund University 3rd EMI all-hands,
EMI is partially funded by the European Commission under Grant Agreement RI MEDIA: motivation, mandate, scope and organization Balázs Kónya, Lund.
European Middleware Initiative (EMI) – Release Process Doina Cristina Aiftimiei (INFN) EGI Technical Forum, Amsterdam 17. Sept.2010.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PPS All sites Meeting: Introduction & Agenda.
EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Quality Assurance Alberto AIMAR (CERN) SA2 Leader EMI Second EC.
Project-X 3.0 Quality Criteria. QA Criteria Milestones Ø System Integration Complete (September) ùReady to start building production servers. Ø Project-X.
EMI is partially funded by the European Commission under Grant Agreement RI Software development, integration and coordination Balázs Kónya, Lund.
Security Token Service (STS) Design & Development Plans Henri Mikkonen / HIP 3 rd EMI All-Hands Meeting , Padova, Italy.
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EMI INFSO-RI Guidelines and SQA Process Maria Alandes Pradillo (CERN) SA2.2 Task Leader.
EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Development Tools Andres Abad Rodriguez SA2.4 Tools Activity Leader.
EMI INFSO-RI SA1 – Maintenance and Support Francesco Giacomini (INFN) SA1 Leader 1 st EMI Periodic Review Brussels, 22 June 2011.
EMI INFSO-RI SA2: Quality Assurance Platforms for EMI 2 Andres Abad Rodriguez SA2.4 EMI All Hands Meeting May 30 th -June 1 ST, Lund (Sweden) Platforms.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
EMI INFSO-RI Argus Policies in Action Valery Tschopp (SWITCH) on behalf of the Argus PT.
EMI INFSO-RI SA1 Session Report Francesco Giacomini (INFN) EMI Kick-off Meeting CERN, May 2010.
EMI INFSO-RI EMIR integration in BDII Maria Alandes Pradillo (CERN) Information System Product Team.
European Middleware Initiative (EMI) The Software Engineering Model Alberto Di Meglio (CERN) Interim Project Director.
EMI is partially funded by the European Commission under Grant Agreement RI Project Status and NA1 Alberto Di Meglio, CERN 3 rd EMI All-Hands Meeting.
SA2.6 Task: EMI Testbeds Danilo Dongiovanni INFN-CNAF.
EMI INFSO-RI Software Quality Assurance in EMI Maria Alandes Pradillo (CERN) SA2.2 Task Leader.
EMI INFSO-RI Argus The EMI Authorization Service Valery Tschopp (SWITCH) Argus Product Team.
EMI INFSO-RI EMI Quality Assurance Tools Lorenzo Dini (CERN) SA2.4 Task Leader.
EMI INFSO-RI Technical Overview Balázs Kónya (Lund University) Technical Director 1 st EMI Periodic Review Brussels, 22 June 2011.
EMI INFSO-RI EMI 2 Matterhorn roadmap Balázs Kónya (Lund University) EMI Technical Director EGI Technical Forum, Lyon, 20 September 2011.
EGEE-III INFSO-RI Enabling Grids for E-sciencE SA3 All Hands Meeting 'Cluster of Competence' Experience SA3 INFN Cyprus May 7th-8th.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Grid Technology SL Section Software Lifecycle Duarte Meneses.
EMI INFSO-RI SA1 – Maintenance and Support Francesco Giacomini (INFN) EMI First EC Review Brussels, 22 June 2011.
EMI Inter-component and Large Scale Testing Infrastructure Danilo Dongiovanni INFN-CNAF.
EMI INFSO-RI EMI Documentation Emidio Giorgio (INFN Catania) NA2 Leader 2 nd All Hands Meeting May 31th, Lünd.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSA3.4.1 “The process document” Oliver Keeble.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
EMI is partially funded by the European Commission under Grant Agreement RI Build and Test Services of the EMI project: Lessons Learned and Perspectives.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Implementing product teams Oliver Keeble.
INFSOM-RI ETICS and EGEE Testing Alberto Di Meglio.
EMI is partially funded by the European Commission under Grant Agreement RI EMI SA2 Report Andres ABAD RODRIGUEZ, CERN SA2.4, Task Leader EMI AHM,
EMI INFSO-RI SA2: Quality Assurance Status Report Alberto Aimar(SA2) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
EMI INFSO-RI Testbed for project continuous Integration Danilo Dongiovanni (INFN-CNAF) -SA2.6 Task Leader Jozef Cernak(UPJŠ, Kosice, Slovakia)
EMI is partially funded by the European Commission under Grant Agreement RI Argus Policies Tutorial Valery Tschopp (SWITCH) – Argus Product Team.
EMI is partially funded by the European Commission under Grant Agreement RI Common Framework for Extracting Information and Metrics from Multiple.
EMI is partially funded by the European Commission under Grant Agreement RI EMI Outlook and Open Source Activities Alberto DI MEGLIO, CERN Project.
EMI INFSO-RI Technical Overview Balázs Kónya (Lund University) Technical Director 1 st EMI Periodic Review Brussels, 22 June 2011.
Lund All Hands meeting Compute Area Section Massimo Sgaravatto INFN Padova.
UNICORE and Argus integration Krzysztof Benedyczak ICM / UNICORE Security PT.
SA2.6 Task: EMI Testbeds Danilo Dongiovanni INFN-CNAF.
Argus EMI Authorization Integration
The Quality Assurance Metric Infrastructure in the EMI Project
EMI and GISELA Collaboration
EMI 1 (Kebnekaise) Updates
C/C++ Build tools & Testbed
SA2: Quality Assurance Status Report
Testing for patch certification
Future Test Activities SA3 All Hands Meeting Dublin
EMI Testbeds Discussion
EMI 1 (Kebnekaise) release preparation status
What is user acceptance testing and how is it different than system testing Kusum daga.
Presentation transcript:

EMI is partially funded by the European Commission under Grant Agreement RI Product Integration (testing) Balázs Kónya, Lund University 3rd EMI all-hands, Padova, October 2011

EMI INFSO-RI EMI ”integration” products Integration (inter-component) tests Howto move forward? – Long list of questions outline 18/10/20113rd EMI all-hands2

EMI INFSO-RI DNA1.3.2 product table already lists ”integration tasks” These are products that created via ”some integration” activity No real ownership The list: – EMI-UI – EMI-WN – Glite-yaim-core – Torque server config – Torque wn config Integration tasks of DNA /10/20113rd EMI all-hands3

EMI INFSO-RI Product development (RfC) – Development of test suit – Unit tests – Product Team responsibility ”Pre-certification” testing – Follows a test plan – Various tests including deployment tests are executed on ”in-house” resources – Some tests are run on the testbed – Concluded with a test report and ”certified” state – Product Team responsibility Testing in EMI certification (1/2) 18/10/20113rd EMI all-hands4

EMI INFSO-RI Certified product gets rolled-out on the testbed – SA2 Testbed task deploys the ”release candidate ” product how do you know that something is a release candidate? – Then what? Questions: – Do we know how many/which bugs were caught during testing? Could be a useful metric to measure testing efficiency – What happens if bugs are discovered during testing? Certification process? Available fixes? – Where is the place for cross-product integration tests? Testing in EMI certification (2/2) 18/10/20113rd EMI all-hands5

EMI INFSO-RI Excerpt from the Testing policy Type: Mandatory The execution of inter-component tests is triggered by the release manager and relies on the use of the EMI testbed [R12]. Inter-component tests are the final stage before going to Production and they are done on certified software products. The exact context and procedure to run and monitor the result of these tests still needs to be understood. EMI testbed Integration tests 18/10/20113rd EMI all-hands6

EMI INFSO-RI Who defines those? Who writes those? – Will every integration test turned into a Nagios probe? Integration tests vs. testbed and certification process: – When are the integration tests run? – Who runs those? (Nagios framework?) – What happens to the test results (test report update)? – What is the role of the testbed (team)? – How does integration testing affect certification? Integration tests 18/10/20113rd EMI all-hands7

EMI INFSO-RI Mandate: – Update testing policy, define workflow – Definition and prioritization of inter-component (multi- product) tests – Execution of the tests (goal to automate things) Including producing lightweight reports – Composed of: ??? Testers from key PTs Active contribution is required – Lead by: ??? Deputy: Danilo Dongiovanni Integration team??? 18/10/20113rd EMI all-hands8