A Case Study in Database Reliability: Component Types, Usage Profiles, and Testing Colin Taylor, IBM Toronto Lab, Canada Mechelle Gittens, IBM Toronto.

Slides:

Advertisements

Similar presentations

An Efficient Multi-Dimensional Index for Cloud Data Management Xiangyu Zhang Jing Ai Zhongyuan Wang Jiaheng Lu Xiaofeng Meng School of Information Renmin.

Advertisements

Effectively Prioritizing Tests in Development Environment

Riku Salonen Regression composite estimation for the Finnish LFS from a practical perspective.

Prioritizing User-session-based Test Cases for Web Applications Testing Sreedevi Sampath, Renne C. Bryce, Gokulanand Viswanath, Vani Kandimalla, A.Gunes.

UML Static diagrams. Static View: UML Component Diagram Component diagrams show the organization and dependencies among software components. Component:

1) Lord Kelvin on Measurement 2) Tom DeMarco on Measurement 3) Test Metric Categories 4) Testability at the Unit Test Level 5) Testability at the Integration.

Chapter 6: Database Evolution Title: AutoAdmin “What-if” Index Analysis Utility Authors: Surajit Chaudhuri, Vivek Narasayya ACM SIGMOD 1998.

What is a Geographic Information System? Geographic Information System = GIS.

Database Administration

1 Predictors of customer perceived software quality Paul Luo Li (ISRI – CMU) Audris Mockus (Avaya Research) Ping Zhang (Avaya Research)

1 Software Testing and Quality Assurance Lecture 14 - Planning for Testing (Chapter 3, A Practical Guide to Testing Object- Oriented Software)

CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.

Justin Meza Qiang Wu Sanjeev Kumar Onur Mutlu Revisiting Memory Errors in Large-Scale Production Data Centers Analysis and Modeling of New Trends from.

1 Project Planning CIS 375 Bruce R. Maxim UM-Dearborn.

Framework for Model Creation and Generation of Representations DDI Lifecycle Moving Forward.

Test and Lab Manager Manual Testing Layer Diagram UML Modeling Load Testing Web Testing Test Case Management IntelliTrace™ Architecture Explorer Test.

Impact Analysis of Database Schema Changes Andy Maule, Wolfgang Emmerich and David S. Rosenblum London Software Systems Dept. of Computer Science, University.

Chapter 1 Database Systems. Good decisions require good information derived from raw facts Data is managed most efficiently when stored in a database.

Lab2 CPIT 440 Data Mining and Warehouse.

MGS Testing A High Level Overview of Testing in Microsoft Games Studio Joe Djorgee – Test Lead.

AL-MAAREFA COLLEGE FOR SCIENCE AND TECHNOLOGY INFO 232: DATABASE SYSTEMS CHAPTER 1 DATABASE SYSTEMS (Cont’d) Instructor Ms. Arwa Binsaleh.

1 How to Apply Static and Dynamic Analysis in Practice © Software Quality Week ‘97 How to Apply Static and Dynamic Analysis in Practice - Otto Vinter Manager.

Das SCCH ist eine Initiative der Das SCCH befindet sich im Empirical Evaluation of Strategies to Detect Logical Change Dependencies SOFSEM 2010 Günter.

Chapter 3: Software Maintenance Process Omar Meqdadi SE 3860 Lecture 3 Department of Computer Science and Software Engineering University of Wisconsin-Platteville.

Software Estimation and Function Point Analysis Presented by Craig Myers MBA 731 November 12, 2007.

Presented By : Abirami Poonkundran.  This paper is a case study on the impact of ◦ Syntactic Dependencies, ◦ Logical Dependencies and ◦ Work Dependencies.

Intelligent Database Systems Lab N.Y.U.S.T. I. M. A new student performance analysing system using knowledge discovery in higher educational databases.

Introduction to Database Management. 1-2 Outline  Database characteristics  DBMS features  Architectures  Organizational roles.

CS480 Computer Science Seminar Introduction to Microsoft Solutions Framework (MSF)

Data-Driven Transaction Based Unit Tests Engin Yorgancıoğlu Volkan Sevinçok Turkey.

Charles L.A. Clarke School of Computer Science, University of Waterloo, Canada Elaine G. Toms Faculty of Management, Dalhousie University, Halifax, Canada.

Adma Archana CSC532 TERM PAPER LOUISIANA TECH UNIVERSITY DATABASE REVERSE ENGINEERING.

Database Administration

Review for the Final Exam CSCI Software Project Management.

1 Experience-Driven Process Improvement Boosts Software Quality © Software Quality Week 1996 Experience-Driven Process Improvement Boosts Software Quality.

Intelligent Database Systems Lab Presenter: WU, MIN-CONG Authors: Zhiyuan Liu, Xinxiong Chen, Yabin Zheng, Maosong Sun 2011, FCCNLL Automatic Keyphrase.

1/24 Impact of design decisions on software quality Wiebe Hordijk

Software Quality Model for Consumer Electronic Product Chanwook Kim, Keun Lee 2009 IEEE Speaker: 林建慶、詹志鴻、洪煒凱.

The Role of Experience in Software Testing Practice Zahra Molaei Soheil Hedayatitezengi Comp 587 Prof. Lingard 1 of 21.

1 Indian Institute of Technology Bombay Indian Institute of Technology, Mumbai A Framework for Design Phase Prediction using Integrated Product and Process.

INFO1408 Database Design Concepts Week 15: Introduction to Database Management Systems.

A protocol for evaluating an OODBMS Master thesis in Computer Science Anders Carlsson.

Enabling Reuse-Based Software Development of Large-Scale Systems IEEE Transactions on Software Engineering, Volume 31, Issue 6, June 2005 Richard W. Selby,

Database Administration

Evolution in Open Source Software (OSS) SEVO seminar at Simula, 16 March 2006 Software Engineering (SU) group Reidar Conradi, Andreas Røsdal, Jingyue Li.

Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 Fuzzy integration of structure adaptive SOMs for web content.

1 COMPUTER SCIENCE DEPARTMENT COLORADO STATE UNIVERSITY 1/9/2008 SAXS Software.

What is Enterprise Architecture March Enterprise Architecture Architecture –the fundamental organization of a system, embodied in its components,

CMDBs: Above and Beyond…

Understanding Data Intensive Systems Using Dynamic Analysis and Visualization Nesrine NOUGHI.

CISC 849 : Applications in Fintech Namami Shukla Dept of Computer & Information Sciences University of Delaware iCARE : A Framework for Big Data Based.

1 JIFL: JIT Instrumentation Framework for Linux Marek Olszewski Adam Czajkowski Keir Mierle University of Toronto.

Review for the Final Exam CSCI Software Project Management.

Week 7 Lecture Part 2 Introduction to Database Administration Samuel S. ConnSamuel S. Conn, Asst Professor.

Database Systems: Design, Implementation, and Management Eighth Edition Chapter 1 Database Systems.

Tool Support for Testing Classify different types of test tools according to their purpose Explain the benefits of using test tools.

Automation Testing Trainer: Eran Ruso. Training Agenda Automation Testing Introduction Microsoft Automation Testing Tool Box Coded UI Test and Unit Test.

Role of Metadata in dissemination of census data Regional Seminar on dissemination and spatial analysis of census data, Nairobi, September, 2010.

Tool Support for Testing

Estimate Testing Size and Effort Using Test Case Point Analysis

A Hierarchical Model for Object-Oriented Design Quality Assessment

Theodore Lawson CSCE548 Student Presentation, Topic #2

Database Management System (DBMS)

Regression composite estimation for the Finnish LFS from a practical perspective Riku Salonen.

Component-Based Software Engineering: Technologies, Development Frameworks, and Quality Assurance Schemes X. Cai, M. R. Lyu, K.F. Wong, R. Ko.

Testing, Reliability, and Interoperability Issues in CORBA Programming Paradigm 11/21/2018.

Agile Testing Using Virtualization

How to Read a Paper (Practice: CCS’14)

Presentation transcript:

A Case Study in Database Reliability: Component Types, Usage Profiles, and Testing Colin Taylor, IBM Toronto Lab, Canada Mechelle Gittens, IBM Toronto Lab, Canada Andriy Miranskyy, University of Western Ontario, Canada

Outline Motivation Database under test Relevant terms Case study Conclusion Future work

Motivation Improved DBMS reliability Efficient assignment of DBMS testing effort

Database Under Test Distributed enterprise relational DBMS >20 MLOC Has evolved over >20 years and >10 major versions

Relevant Terms LOC LOCC Component call frequency Usage profiles: FT and ST Component types: Development and Architectural Defects

Case Study Case study presented as an analysis of our perceptions –Contour plots –Tabular summary of contour plots –Correlation tables

Case Study – Perceptions 1.Number of defects ~ LOC 2.Number of defects ~ Component call frequency 3.For the Development component type, FT Profile more strongly correlated to number of defects than ST Profile

Case Study – Analysis

Conclusion Weak support for Perceptions 1 and 2 Analysis of Perception 3 inconclusive Component size, the size of changes, and call frequency are variables that impact DBMS reliability Testing effort should be assigned according to relational DBMS architecture

Future Work Static code complexity variable Component overlap

Colin A. Taylor

Etcetera

Related Work Majority of studies deal with test tool implementation; only two papers consider the relationships between variables that influence DBMS reliability –Chays, D., Dan, S., Frankl, P. G., Vokolos, F. I., and Weber, E. J A framework for testing database applications. –Deng, Y., Frankl, P., and Wang, J Testing web database applications. –Suárez-Cabal, M. J. and Tuya, J Using an SQL coverage measurement for testing database applications. –Wu, X., Wang, Y., and Zheng, Y Privacy preserving database application testing. –Gittens, M., Lutfiyya, H., Bauer, M., Godwin, D., Kim, Y. W., and Gupta, P An empirical evaluation of system and regression testing. –Sullivan, M., Chillarege, R. A comparison of software defects in database management systems and operating systems.