Fitness Guided Fault Localization with Coevolutionary Automated Software Correction Case Study ISC Graduate Student: Josh Wilkerson, Computer Science ISC.

Slides:



Advertisements
Similar presentations
PRAM Algorithms Sathish Vadhiyar. PRAM Model - Introduction Parallel Random Access Machine Allows parallel-algorithm designers to treat processing power.
Advertisements

Overcoming Limitations of Sampling for Agrregation Queries Surajit ChaudhuriMicrosoft Research Gautam DasMicrosoft Research Mayur DatarStanford University.
MOEAs University of Missouri - Rolla Dr. T’s Course in Evolutionary Computation Matt D. Johnson November 6, 2006.
Test Automation Success: Choosing the Right People & Process
Time-Aware Test Suite Prioritization Kristen R. Walcott, Mary Lou Soffa University of Virginia International Symposium on Software Testing and Analysis.
Combining Classification and Model Trees for Handling Ordinal Problems D. Anyfantis, M. Karagiannopoulos S. B. Kotsiantis, P. E. Pintelas Educational Software.
Constructing Complex NPC Behavior via Multi- Objective Neuroevolution Jacob Schrum – Risto Miikkulainen –
Multi-objective optimization multi-criteria decision-making.
Optimal Design Laboratory | University of Michigan, Ann Arbor 2011 Design Preference Elicitation Using Efficient Global Optimization Yi Ren Panos Y. Papalambros.
Automated Fitness Guided Fault Localization Josh Wilkerson, Ph.D. candidate Natural Computation Laboratory.
Dynamic Service Composition with QoS Assurance Feb , 2009 Jing Dong UTD Farokh Bastani UTD I-Ling Yen UTD.
Multiobjective Optimization Chapter 7 Luke, Essentials of Metaheuristics, 2011 Byung-Hyun Ha R1.
Wei Zhu, Xiang Tian, Fan Zhou and Yaowu Chen IEEE TCE, 2010.
A Study on Recent Fast Ways of Hypervolume Calculation for MOEAs Mainul Kabir ( ) and Nasik Muhammad Nafi ( ) Department of Computer Science.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
EMBIO – Cambridge Particle Swarm Optimization applied to Automated Docking Automated docking of a ligand to a macromolecule Particle Swarm Optimization.
A New Evolutionary Algorithm for Multi-objective Optimization Problems Multi-objective Optimization Problems (MOP) –Definition –NP hard By Zhi Wei.
Multi-Objective Evolutionary Algorithms Matt D. Johnson April 19, 2007.
Eng 101 – Seeds of Success Social and Ethical Implications of Artificial Intelligence Daniel Tauritz, Ph.D. Associate Professor of Computer Science.
CS 1 – Introduction to Computer Science Introduction to the wonderful world of Dr. T Daniel Tauritz, Ph.D. Associate Professor of Computer Science.
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Classical Exploration Methods for Design Space Exploration (multi-criteria.
Applying Multi-Criteria Optimisation to Develop Cognitive Models Peter Lane University of Hertfordshire Fernand Gobet Brunel University.
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
Multiobjective Optimization Athens 2005 Department of Architecture and Technology Universidad Politécnica de Madrid Santiago González Tortosa Department.
Subgoal: conduct an in-depth study of critical representation, operator and other choices used for evolutionary program repair at the source code level.
Optimal Arrangement of Ceiling Cameras for Home Service Robots Using Genetic Algorithms Stefanos Nikolaidis*, ** and Tamio Arai** *R&D Division, Square.
Quality Indicators (Binary ε-Indicator) Santosh Tiwari.
Testing. Definition From the dictionary- the means by which the presence, quality, or genuineness of anything is determined; a means of trial. For software.
Software Engineering Laboratory, Department of Computer Science, Graduate School of Information Science and Technology, Osaka University 1 Refactoring.
Algorithms and Programming
Robin McDougall Scott Nokleby Mechatronic and Robotic Systems Laboratory 1.
Predictive Design Space Exploration Using Genetically Programmed Response Surfaces Henry Cook Department of Electrical Engineering and Computer Science.
Ensemble Based Systems in Decision Making Advisor: Hsin-His Chen Reporter: Chi-Hsin Yu Date: IEEE CIRCUITS AND SYSTEMS MAGAZINE 2006, Q3 Robi.
New Mexico Computer Science For All Algorithm Analysis Maureen Psaila-Dombrowski.
MODES-650 Advanced System Simulation Presented by Olgun Karademirci VERIFICATION AND VALIDATION OF SIMULATION MODELS.
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
DIVERSITY PRESERVING EVOLUTIONARY MULTI-OBJECTIVE SEARCH Brian Piper1, Hana Chmielewski2, Ranji Ranjithan1,2 1Operations Research 2Civil Engineering.
“Isolating Failure Causes through Test Case Generation “ Jeremias Rößler Gordon Fraser Andreas Zeller Alessandro Orso Presented by John-Paul Ore.
Software Development Problem Analysis and Specification Design Implementation (Coding) Testing, Execution and Debugging Maintenance.
Bug Localization with Association Rule Mining Wujie Zheng
Coevolutionary Automated Software Correction Josh Wilkerson PhD Candidate in Computer Science Missouri S&T.
ADASS the Planning and Scheduling Perspective Roadmap: - How planning and scheduling fits in at ADASS - ADASS planning and scheduling posters and presentations.
Quality of Pareto set approximations Eckart Zitzler, Jörg Fliege, Carlos Fonseca, Christian Igel, Andrzej Jaszkiewicz, Joshua Knowles, Alexander Lotov,
Software testing techniques Software testing techniques Input Output Analysis Presentation on the seminar Kaunas University of Technology.
At what level do I trust the outcomes of the model? Verification Calibration Validation Exploration of the model structure. the activity of adjusting the.
September 28, 2000 Improved Simultaneous Data Reconciliation, Bias Detection and Identification Using Mixed Integer Optimization Methods Presented by:
1 The Software Development Process ► Systems analysis ► Systems design ► Implementation ► Testing ► Documentation ► Evaluation ► Maintenance.
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Multiobjective Optimization  Particularities of multiobjective optimization  Multiobjective.
Discovering Interesting Patterns for Investment Decision Making with GLOWER-A Genetic Learner Overlaid With Entropy Reduction Advisor : Dr. Hsu Graduate.
Evolutionary Computing Chapter 12. / 26 Chapter 12: Multiobjective Evolutionary Algorithms Multiobjective optimisation problems (MOP) -Pareto optimality.
Net-Centric Software and Systems I/UCRC Self-Detection of Abnormal Event Sequences Project Lead: Farokh Bastani, I-Ling Yen, Latifur Khan Date: April 1,
Multi-cellular paradigm The molecular level can support self- replication (and self- repair). But we also need cells that can be designed to fit the specific.
MEER 111 – Global Research Solving Real-World Problems with Evolutionary Algorithms Daniel Tauritz, Ph.D. Associate Professor of Computer Science.
` Question: How do immune systems achieve such remarkable scalability? Approach: Simulate lymphoid compartments, fixed circulatory networks, cytokine communication.
Zachary Starr Dept. of Computer Science, University of Missouri, Columbia, MO 65211, USA Digital Image Processing Final Project Dec 11 th /16 th, 2014.
Combinatorial Library Design Using a Multiobjective Genetic Algorithm
11-5 Linkage and Gene Maps.
MultiRefactor: Automated Refactoring To Improve Software Quality
Writing a Technical Report
Test Case Purification for Improving Fault Localization
Heuristic Optimization Methods Pareto Multiobjective Optimization
Automated Fitness Guided Fault Localization
Aiman H. El-Maleh Sadiq M. Sait Syed Z. Shazli
UNIT 5 EMBEDDED SYSTEM DEVELOPMENT
Authors: Barry Smyth, Mark T. Keane, Padraig Cunningham
UNIT 5 EMBEDDED SYSTEM DEVELOPMENT
M. Kezunovic (P.I.) S. S. Luo D. Ristanovic Texas A&M University
Self-Configuring Crossover
Coevolutionary Automated Software Correction
Multiobjective Optimization
Presentation transcript:

Fitness Guided Fault Localization with Coevolutionary Automated Software Correction Case Study ISC Graduate Student: Josh Wilkerson, Computer Science ISC PI: Dr. Daniel Tauritz, Computer Science Co-PIs:Dr. Bruce McMillin, Computer Science & Dr. Thomas Weigert, Computer Science Missouri S&T Natural Computation Laboratory Technical Background: The FGFL System Fault localization: the most time consuming step in software debugging Would greatly benefit from automation FGFL: automated fault localization system exploiting a fitness function for the program Fitness function: type of objective function used to rate the performance of a solution Ensemble of techniques used in FGFL, currently consisting of: Trace Comparison Trend Based Line Suspicion Fitness monitor Results of (active) techniques combined using confidence based voting system Technical Background: Multi-Objective Optimization Simultaneously optimize problem objectives Candidate solutions are given scores for each objective Non-Dominated Sorting Genetic Algorithm (NSGA): algorithm that FGFL multi-objective approach is based on NSGA Details: Solution fitness is proportional to the number of other solutions dominated Solution S1 dominates S2 if S1 performs at least as good as S2 on all objectives and better on at least one objective Non-Dominated Front: set of solutions that are not dominated by any other known solutions Benefits and Motivation Most real world problems consist of multiple objectives  Multi-objective fitness calculation allows problems to remain closer to their natural state in the FGFL system Combining objectives together into a single aggregate fitness function is difficult, as there infinite possibilities  Multi-objective fitness functions avoid having to make tradeoff decisions a priori The dominance relationship between solutions is stronger than comparison employing an aggregate fitness function  Multi-objective comparison is expected to lead to an improved FGFL test case set Separate objective scores provide more insight into a solution’s performance  FGFL enhancements and techniques that specifically exploit multiple objective functions Objective Add support for multi-objective optimization style fitness calculation to the Fitness Guided Fault Localization (FGFL) System Proposed FGFL Enhancement: Objective Sensitivity Testing Through testing, objectives effected by a bug could be identified Identifying objectives sensitive to the bug will allow for more targeted testing  Ideally resulting in more accurate results Removing objectives from consideration would result in a significant search space reduction Current and Future Work Continue development and testing of FGFL enhancements and new techniques exploiting multiple objective functions Investigate enhancements to existing FGFL techniques to exploit multiple objective functions Conduct case study using the Coevolutionary Automated Software Correction (CASC) system  Use FGFL to indicate section of buggy code to be corrected Use both aggregate and multi-objective function  Testing using the Siemens test suite of programs with injected faults Proposed FGFL Technique: Cross Objective Testing Examine execution characteristics of test cases on the non-dominated front with sufficiently unique performance  The closer to the pareto-optimal front, the better Differences in these characteristics can be employed to provide information on the nature and location of the bug Can also be used to enhance existing FGFL techniques Example Fault Localization Result: Warmer Color Indicates Higher Suspicion Example Front Organization