EMI is partially funded by the European Commission under Grant Agreement RI-261611 Common Framework for Extracting Information and Metrics from Multiple.

Slides:

Advertisements

Similar presentations

ILD Quality Center Overview.

Advertisements

Making the System Operational

Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.

Project Change Management

Oracle XML Publisher Integration with PeopleSoft By, Mr. Venkat.

DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 DataGrid Quality Assurance On behalf.

EMI INFSO-RI SA2: Session Summary Alberto Aimar WP Package Leader 1 June 2011, Lund.

Guide to Using Message Maker Robert Snelick National Institute of Standards & Technology (NIST) December 2005

Continuous Integration and Testing

Carolina Environmental Program UNC Chapel Hill The Analysis Engine – A New Tool for Model Evaluation, Sensitivity and Uncertainty Analysis, and more… Alison.

EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.

Lecture #9 Project Quality Management Quality Processes- Quality Assurance and Quality Control Ghazala Amin.

EMI INFSO-RI EMI SA2 Report Quality Assurance Alberto Aimar (CERN) SA2 WP Leader.

EMI INFSO-RI Metrics review Claudio (SA1), Lars, Duarte, Eamonn and Maria (SA2)

EMI INFSO-RI EMI Quality Assurance Processes (PS ) Alberto Aimar (CERN) CERN IT-GT-SL Section Leader EMI SA2 QA Activity Leader.

1 Software Development Configuration management. \ 2 Software Configuration  Items that comprise all information produced as part of the software development.

Introduction to MDA (Model Driven Architecture) CYT.

EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.

EMI is partially funded by the European Commission under Grant Agreement RI Post EMI Plans and MeDIA Alberto DI MEGLIO, CERN Project Director WLCG.

EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.

Knowledge Modeling, use of information sources in the study of domains and inter-domain relationships - A Learning Paradigm by Sanjeev Thacker.

European Middleware Initiative (EMI) – Release Process Doina Cristina Aiftimiei (INFN) EGI Technical Forum, Amsterdam 17. Sept.2010.

EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Quality Assurance Alberto AIMAR (CERN) SA2 Leader EMI Second EC.

EMI INFSO-RI Guidelines and SQA Process Maria Alandes Pradillo (CERN) SA2.2 Task Leader.

EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Development Tools Andres Abad Rodriguez SA2.4 Tools Activity Leader.

EMI INFSO-RI SA1 – Maintenance and Support Francesco Giacomini (INFN) SA1 Leader 1 st EMI Periodic Review Brussels, 22 June 2011.

EMI INFSO-RI SA2.3 Metrics Report Eamonn Kenny (TCD) Gianni Pucciani (CERN)

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.

INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.

EMI INFSO-RI SA1 Session Report Francesco Giacomini (INFN) EMI Kick-off Meeting CERN, May 2010.

EMI INFSO-RI EMIR integration in BDII Maria Alandes Pradillo (CERN) Information System Product Team.

European Middleware Initiative (EMI) The Software Engineering Model Alberto Di Meglio (CERN) Interim Project Director.

INFSO-RI Enabling Grids for E-sciencE The gLite Software Development Process Alberto Di Meglio EGEE – JRA1 CERN.

SA2.6 Task: EMI Testbeds Danilo Dongiovanni INFN-CNAF.

EMI INFSO-RI Software Quality Assurance in EMI Maria Alandes Pradillo (CERN) SA2.2 Task Leader.

EMI INFSO-RI Software Metric Definitions, Reports and Analysis in EMI Authors: Eamonn Kenny (TCD), Gianni Pucciani (CERN) Date: Tuesday 12 th April.

EMI INFSO-RI EMI Quality Assurance Tools Lorenzo Dini (CERN) SA2.4 Task Leader.

EMI INFSO-RI Metrics report visualization and reporting Lars Barlindhaug (CERN)

EMI is partially funded by the European Commission under Grant Agreement RI Product Integration (testing) Balázs Kónya, Lund University 3rd EMI.

EMI is partially funded by the European Commission under Grant Agreement RI Common Authentication Library Daniel Kouril, for the CaNL PT EGI TF.

Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Grid Technology SL Section Software Lifecycle Duarte Meneses.

European Middleware Initiative (EMI) – Training Kathryn Cassidy, TCD EMI NA2.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Patch Preparation SA3 All Hands Meeting.

EMI INFSO-RI SA1 – Maintenance and Support Francesco Giacomini (INFN) EMI First EC Review Brussels, 22 June 2011.

EMI INFSO-RI EMI Documentation Emidio Giorgio (INFN Catania) NA2 Leader 2 nd All Hands Meeting May 31th, Lünd.

EMI is partially funded by the European Commission under Grant Agreement RI Build and Test Services of the EMI project: Lessons Learned and Perspectives.

EMI is partially funded by the European Commission under Grant Agreement RI EMI SA2 Report Andres ABAD RODRIGUEZ, CERN SA2.4, Task Leader EMI AHM,

JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.

EMI INFSO-RI SA2: Quality Assurance Status Report Alberto Aimar(SA2) SA2 Leader EMI First EC Review 22 June 2011, Brussels.

EMI is partially funded by the European Commission under Grant Agreement RI Common Authentication Library Daniel Kouril, for the CaNL PT EGI CF.

EMI is partially funded by the European Commission under Grant Agreement RI caNl++ caNl++ team University Of Oslo 5th EMI AHM, Budapest.

EMI INFSO-RI Testbed for project continuous Integration Danilo Dongiovanni (INFN-CNAF) -SA2.6 Task Leader Jozef Cernak(UPJŠ, Kosice, Slovakia)

StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Demonstration StratusLab First.

EMI INFSO-RI /04/2011What's new in EMI 1: Kebnekaise What’s new in EMI 1 Kathryn Cassidy (TCD)‏ EMI NA2.

SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Quality assurance in SCI-BUS project by applying agile testing practices.

Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.

EPEL All Hands Meeting, Padova, Mattias Ellert Uppsala University.

Argus EMI Authorization Integration

The Quality Assurance Metric Infrastructure in the EMI Project

INTRODUCTION TO GENERATING SERVICES

EMI 1 (Kebnekaise) Updates

Software Verification and Validation

8.3 Control Quality The process of monitoring and recording results of executing quality activities to assess performance and recommend necessary change.

EMI Project Processes and Tools

Continuous Integration and Testing

SA2: Quality Assurance Status Report

EMI 1 (Kebnekaise) release preparation status

SL Section Software Lifecycle Duarte Meneses

EMI: dal Produttore al Consumatore

Kick off meeting ARACHNE PROJECT.

Presentation transcript:

EMI is partially funded by the European Commission under Grant Agreement RI Common Framework for Extracting Information and Metrics from Multiple Change Trackers Eamonn Kenny, TCD Munich,

EMI INFSO-RI Quality Assurance Policies – definition and monitoring Metrics and KPIs – definition and collection Quality Control – verification and reporting Build/Test Tools and Repositories – selection, maintenance and integration Certification and Integration Testbeds – setup, maintenance and deployment EMI Quality Assurance Activities 29/03/2012TCD2

EMI INFSO-RI Savannah Trackers  Format  Metrics 29/03/2012TCD3 Metrics RT

EMI INFSO-RI Many data sources  many formats – e.g: UNICORE: 2 defect trackers, 2 request trackers, 1 enhancement and 1 regression test tracker (6-in-1 ) Data obtained from multiple organisations must have the same meaning everywhere otherwise metrics are meaningless. Helps the EMI project gather only the important information and leaves organisations the freedom to produce other internally useful information. Why Produce a Common Format? 29/03/2012TCD4

EMI INFSO-RI Request for Change (RfC) lifecycle 29/03/2012TCD5 Open Accept? YES Accepted Fixed Test? Successful? Not Tested Tested Closed Rejected NO YES NO YES

EMI INFSO-RI Validated Common Format (Yr 1) 29/03/2012TCD6 Quality Assurance Other formats dashboard Common Format Dump/Export of RfC Tracker Bug/Feature Trackers Common Format Exported files in Common Format Common formats Tabulated Formats Metric Calculation & Visualisation Per Product Calculations Trend Graphs Automated Validation Manual Validation Automated Validation

EMI INFSO-RI Implemented Framework 29/03/2012TCD7 QA CSV /XSL Dashboard Tabulated Formats Report Generator (Java) Manual Validation Validation Tracker to Product Mappings Policy Quality Control Release Manager Metrics

EMI INFSO-RI Dashboard for Validation/Reports 29/03/2012TCD8

EMI INFSO-RI Add the Static Analysers & Testing 29/03/2012TCD9 Other formats dashboard Common Format Dump/Export of RfC Tracker Bug/Feature Trackers Common Format Exported files in Common Format Common formats Tabulated Formats Metric Calculation & Visualisation Per Product Calculations Trend Graphs Quality Assurance Automated Validation Manual Validation Automated Validation Other formats dashboard Common Format Dump/Export of RfC Tracker Bug/Feature Trackers Common Format Exported files in Common Format Common formats Tabulated Formats Metric Calculation & Visualisation Per Product Calculations Trend Graphs Common Format Dated Builds Results with Static Analysers Multiple Builds Verification & Tests Releases Dashboard Product information XY Bar/Stacked Charts Stacked, Trend Graphs, Distributions Outputs

EMI INFSO-RI /03/2012TCD10 Framework Actors Other formats dashboard Common Format Dump/Export of RfC Tracker Bug/Feature Trackers Common Format Exported files in Common Format Common formats Tabulated Formats Metric Calculation & Visualisation Per Product Calculations Trend Graphs Common Format Dated Builds Results with Static Analysers Multiple Builds Verification & Tests Releases Dashboard Product information XY Bar/Stacked Charts Stacked, Trend Graphs, Distributions Outputs Product Teams QA Tools Product TeamsQA Metrics QA Metrics & Tools QA Metrics QA Policy & Testing + SA1 Release Manager Release Manager, QA, QC

EMI INFSO-RI Using the Chart Generator 29/03/2012TCD11 Java Implementation Chart Configuration Chart Framework Data Provider Chart Generator EMI Mapping Plot Provider Existing Metric Description New Metric Description Existing Abstract Plotting Class New Abstract Plotting Class JAXB Stubs XML Schema Modified XML Schema 1 Add schema changes 2 Clone existing metric 3 Clone existing Plotting method 4 Edit Configuration Details: XY titles, Title, special settings Plot type, etc.

EMI INFSO-RI Sample Results 29/03/2012TCD12

EMI INFSO-RI More time series data to produce trend data for analysis by QC Ongoing maintenance/improvement of the XML, XSD and Chart generator Possible introduction of more defect/feature trackers. Current/Future Work 29/03/2012TCD13

EMI INFSO-RI Questions?