Utilizing CI environment for efficient and effective testing of NFRs

Slides:



Advertisements
Similar presentations
1 A Systematic Review of Cross- vs. Within-Company Cost Estimation Studies Barbara Kitchenham Emilia Mendes Guilherme Travassos.
Advertisements

System Integration Verification and Validation
Nine Steps to Delivering Defect-Free Software By: Terence M. Colligan Presented by: Isaac Bailey.
Mapping Studies – Why and How Andy Burn. Resources The idea of employing evidence-based practices in software engineering was proposed in (Kitchenham.
Software Engineering Software quality. Software quality characteristics:  External: user is aware of. User cares about.  Internal: programmer is aware.
Roadmap to Continuous Integration Testing and Benefits Gowri Selka, Walgreens Natalie Koltun, Walgreens May 20th, 2014 ©2013 Walgreen Co. All rights reserved.
Technische Universität München The influence of software quality requirements on the suitability of software cost estimation methods 24th International.
1 Improving Access to Public Health Information: A Study of Information Needs in a State Health Department E. Hatheway Simpson, MPH Nancy R. La Pelle,
Strategic Directions in Real- Time & Embedded Systems Aatash Patel 18 th September, 2001.
1.Macbeth et al. (2012): Procurement and supply in projects: Misunderstood and under- researched. Project Management Institute. 2.Pesämaa et al. (2009):
Michael Burnside Blog: Software Quality Assurance, Quality Engineering, and Web and Mobile Test.
Introduction to Software Testing Chapter 9.3 Challenges in Testing Software Test Criteria and the Future of Testing Paul Ammann & Jeff Offutt
1 Software Testing (Part-II) Lecture Software Testing Software Testing is the process of finding the bugs in a software. It helps in Verifying and.
N By: Md Rezaul Huda Reza n
Software Testing Life Cycle
Validation Metrics. Metrics are Needed to Answer the Following Questions How much time is required to find bugs, fix them, and verify that they are fixed?
A Systematic Mapping Study on Software Engineering Testbeds Emanoel Barreiros Advisor: Sérgio Soares.
1 Software Quality CIS 375 Bruce R. Maxim UM-Dearborn.
Rational Requirements Management with Use Cases v5.5 Copyright © Rational Software, all rights reserved 1Welcome! Rational Requirements Management.
Introduction to Software Engineering LECTURE 2 By Umm-e-Laila 1Compiled by: Umm-e-Laila.
SYSTEM DYNAMICS MODELING OF AGILE CONTINUOUS DELIVERY PROCESS 資工 4A 鄭鈞輿.
Chapter 2 Process: A Generic View
Software Quality Assurance SE Software Quality Assurance What is “quality”?
An Introduction to Software Engineering. What is Software?
IT Requirements Management Balancing Needs and Expectations.
D1.HGE.CL7.01 D1.HGA.CL6.08 Slide 1. Introduction Design, prepare and present reports  Classroom schedule  Trainer contact details  Assessments  Resources:
Continuous Deployment JEFFREY KNAPP 8/6/14. Introduction Why is it valuable How to achieve What to consider.
1 Dr. Ralph R. Young Director of Software Engineering PRC, Inc. (703) DOORS USER GROUP CONFERENCE Reston, VA September 17,
Lecture 7: Requirements Engineering
SWEN 5130 Requirements Engineering 1 Dr Jim Helm SWEN 5130 Requirements Engineering Requirements Management Under the CMM.
Planning an Applied Research Project Chapter 3 – Conducting a Literature Review © 2014 by John Wiley & Sons, Inc. All rights reserved.
A protocol for evaluating an OODBMS Master thesis in Computer Science Anders Carlsson.
Develop Project Charter
THE IRISH SOFTWARE ENGINEERING RESEARCH CENTRELERO© What we currently know about software fault prediction: A systematic review of the fault prediction.
CS532 TERM PAPER MEASUREMENT IN SOFTWARE ENGINEERING NAVEEN KUMAR SOMA.
1 Software Engineering: A Practitioner’s Approach, 6/e Chapter 15a: Product Metrics for Software Software Engineering: A Practitioner’s Approach, 6/e Chapter.
Build and Deployment Process Understand NCI’s DevOps and continuous integration requirements Understand NCI’s build and distribution requirements.
Ahmed Idris Tahir Waseel Application Service Provider.
Requirements Management with Use Cases Module 2: Introduction to RMUC Requirements Management with Use Cases Module 2: Introduction to RMUC.
Cruise Training Introduction of Continuous Integration.
by: Er. Manu Bansal Deptt of IT Software Quality Assurance.
Department of Computer Science Continuous Experimentation in the B2B Domain: A Case Study Olli Rissanen, Jürgen Münch 23/05/2015www.helsinki.fi/yliopisto.
1 Visual Computing Institute | Prof. Dr. Torsten W. Kuhlen Virtual Reality & Immersive Visualization Till Petersen-Krauß | GUI Testing | GUI.
2. Protocol and training Theory development with systematic literature reviews Chitu Okoli for ICT University, Fall 2015.
Course Project Guidelines
PREPARED BY G.VIJAYA KUMAR ASST.PROFESSOR
Hadoop-based Distributed Web Crawler
Software Engineering (CSI 321)
NURS3030H NURSING RESEARCH IN PRACTICE MODULE 7 ‘Systematic Reviews’’
Work Package 4 Software Integration and Distribution
Mobile Application Test Case Automation
HCS 465 Competitive Success-- snaptutorial.com
NSG 512Competitive Success/snaptutorial.com
HCS 465 Education for Service-- snaptutorial.com
NSG 512 Education for Service-- snaptutorial.com
HCS 465 Teaching Effectively-- snaptutorial.com
Goal, Question, and Metrics
3. Practical screen Theory development with systematic literature reviews Chitu Okoli for ICT University, Fall 2015.
Surafel Demissie, Frank Keenan, Özden Özcan-Top and Fergal McCaffery
Automated Testing and Integration with CI Tool
(Software Engineering group, IDI, NTNU):
LITERATURE REVIEW.
The Advising Literature Review: Make it Systematic!
Software Engineering I
Forum on Application Compatibility for Windows “Longhorn”
Testing and Inspection Present and Future
Software Verification and Validation
Chapter 11 – Project Dashboard
Professional Licentiate in Engineering (PLEng 2.0) mini-Conference
Presentation transcript:

Utilizing CI environment for efficient and effective testing of NFRs  - Liang Yu Date: 2019-05-13

CI NFR Research area Target CI-NFR: NFR testing by using CI environments CI NFR CI: Continuous Integration NFR: Non-Functional Requirement Target

Motivation Quality focused NFR [1] Security Usability Reliability Maintainability Performance [1] D. Mairiza, D. Zowghi, N. Nurmuliani, An investigation into the notion of non-functional requirements, in: Proceedings of the 2010 ACM Symposium on Applied Computing, ACM, 2010, pp. 311–317

Why we use continuous integration Prevent faults Fast feedback Automation

Why we select CI Basic CI pipeline Automation Dev Teams source control server CI server build test verdict trigger feedback commit changes

Goal and research questions What we have done Data analysis Workshop Conference papers Journals articles Goal and research questions Search string Findings Inclusion&exclusion criteria Systematic Literature Review [2] on CI-NFR Findings CI environments are underutilized for NFR testing Very low ratio of industrial studies found Nine testable NFR reported New model CI baseline model for NFR testing [2] Barbara A. Kitchenham, Guidelines for performing Systematic Literature Reviews in Software Engineering Version 2.3, Keele University and University of Durham, EBSE Technical Report, 2007

CI baseline model

Next step Next step plan Case study design Objective: verify and validate the CI baseline model Research method: case study[3] Case study design Technique: Semi-structure interview Obervation Documentary Data: Qualitative Quantitative [3] P. Runeson, M. Höst, Guidelines for conducting and reporting case study research in software engineering, Empirical software engineering 14 (2) (2009) 131.

Augmented CI components/probes The plan Augmented CI environment Baseline model NFR Testing Real-time quality Analysis & prediction Augmented CI components/probes

Perceived benefits of CI-NFR Get feedback and prevent faults fast and earlier Deliver new features fast with NFR secured Reduce cost and time

Summary CI NFR

Interested? Contact: Liang Yu <liang.yu@bth.se> Q&A Interested? Contact: Liang Yu <liang.yu@bth.se>