Centre for Research in Evolution, Search & Testing Welcome to CREST King’s College London Mark Harman Centre for Research in Evolution, Search & Testing.

Slides:

Advertisements

Similar presentations

Intelligent Tools for Techno- Economic Modelling and Network Design Tim Glover Chris Voudouris Anthony Conway Edward Tsang Ali Rais Shaghaghi Michael Kampouridis.

Advertisements

Annual International Conference On GIS, GPS AND Remote Sensing.

Local Search Algorithms Chapter 4. Outline Hill-climbing search Simulated annealing search Local beam search Genetic algorithms Ant Colony Optimization.

Test Automation Success: Choosing the Right People & Process

Multi-Objective Optimization NP-Hard Conflicting objectives – Flow shop with both minimum makespan and tardiness objective – TSP problem with minimum distance,

Software Modeling SWE5441 Lecture 3 Eng. Mohammed Timraz

Multi-Stakeholder Tensioning Analysis in Requirements Optimisation Yuanyuan Zhang CREST Centre University College London.

SBSE Course 3. EA applications to SE Analysis Design Implementation Testing Reference: Evolutionary Computing in Search-Based Software Engineering Leo.

CPSC 322, Lecture 16Slide 1 Stochastic Local Search Variants Computer Science cpsc322, Lecture 16 (Textbook Chpt 4.8) February, 9, 2009.

Spie98-1 Evolutionary Algorithms, Simulated Annealing, and Tabu Search: A Comparative Study H. Youssef, S. M. Sait, H. Adiche

Introduction to Search Based Software Engineering SSS SEBASE Summer School, Birmingham University, July 2007 Mark Harman King’s College London.

1 Wendy Williams Metaheuristic Algorithms Genetic Algorithms: A Tutorial “Genetic Algorithms are good at taking large, potentially huge search spaces and.

Date:2011/06/08 吳昕澧 BOA: The Bayesian Optimization Algorithm.

Opportunities for Cooperation IAB Kick-off Leicester, 8 June 2005.

1 Evolutionary Testing Metaheuristic search techniques applied to test problems Stella Levin Advanced Software Tools Seminar Tel-Aviv University

Genetic Algorithms for multiple resource constraints Production Scheduling with multiple levels of product structure By : Pupong Pongcharoen (Ph.D. Research.

Exploiting Content Localities for Efficient Search in P2P Systems Lei Guo 1 Song Jiang 2 Li Xiao 3 and Xiaodong Zhang 1 1 College of William and Mary,

1 A hybrid particle swarm optimization algorithm for optimal task assignment in distributed system Peng-Yeng Yin and Pei-Pei Wang Department of Information.

The CONVERSE Project: Tough on Change, Tough on the Causes of Change. Improving Software in Engine Controllers University of York John McDermid, John Clark.

Dynamic Adaptive Automated Software Engineering John Woodward University of Stirling, Scotland

LLNL-PRES This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.

Metaheuristics The idea: search the solution space directly. No math models, only a set of algorithmic steps, iterative method. Find a feasible solution.

Genetic Algorithms: A Tutorial

Prepared by Barış GÖKÇE 1.  Search Methods  Evolutionary Algorithms (EA)  Characteristics of EAs  Genetic Programming (GP)  Evolutionary Programming.

A Comparison of Nature Inspired Intelligent Optimization Methods in Aerial Spray Deposition Management Lei Wu Master’s Thesis Artificial Intelligence Center.

Protein Folding in the 2D HP Model Alexandros Skaliotis – King’s College London Joint work with: Andreas Albrecht (University of Hertfordshire) Kathleen.

Robust GW summary statistics & robust GW regression are used to investigate spatial variation and relationships in a freshwater acidification critical.

COSC 4426 Topics in Computer Science II Discrete Optimization Good results with problems that are too big for people or computers to solve completely

ART – Artificial Reasoning Toolkit Evolving a complex system Marco Lamieri Spss training day

B EYOND C LASSICAL S EARCH Instructor: Kris Hauser 1.

Design & Analysis of Algorithms Combinatory optimization SCHOOL OF COMPUTING Pasi Fränti

1 Chapter 5 Advanced Search. 2 Chapter 5 Contents l Constraint satisfaction problems l Heuristic repair l The eight queens problem l Combinatorial optimization.

ASC2003 (July 15,2003)1 Uniformly Distributed Sampling: An Exact Algorithm for GA’s Initial Population in A Tree Graph H. S.

1 A Heuristic Approach Towards Solving the Software Clustering Problem ICSM03 Brian S. Mitchell /

Fuzzy Genetic Algorithm

Yue Jia, Mark Harman King’s College London CREST Constructing Subtle Faults Using Higher Order Mutation Testing Higher Order Mutation Testing.

1 “Genetic Algorithms are good at taking large, potentially huge search spaces and navigating them, looking for optimal combinations of things, solutions.

Genetic Algorithms Siddhartha K. Shakya School of Computing. The Robert Gordon University Aberdeen, UK

A Hybrid Genetic Algorithm for the Periodic Vehicle Routing Problem with Time Windows Michel Toulouse 1,2 Teodor Gabriel Crainic 2 Phuong Nguyen 2 1 Oklahoma.

AUSTIN: A TOOL FOR SEARCH BASED SOFTWARE TESTING And its Evaluation on Deployed Automotive Systems Kiran Lakhotia, Mark Harman and Hamilton Gross in.

Overview of Machine Learning RPI Robotics Lab Spring 2011 Kane Hadley.

Robust GW summary statistics & robust GW regression are used to investigate a freshwater acidification data set. Results show that data relationships can.

Controlling the Behavior of Swarm Systems Zachary Kurtz CMSC 601, 5/4/

Efficient P2P Search by Exploiting Localities in Peer Community and Individual Peers A DISC’04 paper Lei Guo 1 Song Jiang 2 Li Xiao 3 and Xiaodong Zhang.

1 The Search Landscape of Graph Partitioning Problems using Coupling and Cohesion as the Clustering Criteria Brian S. Mitchell & Spiros Mancoridis

1 Genetic Algorithms K.Ganesh Introduction GAs and Simulated Annealing The Biology of Genetics The Logic of Genetic Programmes Demo Summary.

Scheduling Architecture and Algorithms within ICENI Laurie Young, Stephen McGough, Steven Newhouse, John Darlington London e-Science Centre Department.

“Isolating Failure Causes through Test Case Generation “ Jeremias Rößler Gordon Fraser Andreas Zeller Alessandro Orso Presented by John-Paul Ore.

Xiao Liu 1, Yun Yang 1, Jinjun Chen 1, Qing Wang 2, and Mingshu Li 2 1 Centre for Complex Software Systems and Services Swinburne University of Technology.

SCAM’08 -- Evaluating Key Statements AnalysisZheng Li Evaluating Key Statements Analysis David Binkley - Loyola College, USA Nicolas Gold, Mark Harman,

Evolving RBF Networks via GP for Estimating Fitness Values using Surrogate Models Ahmed Kattan Edgar Galvan.

Chapter 5. Advanced Search Fall 2011 Comp3710 Artificial Intelligence Computing Science Thompson Rivers University.

Genetic Search Algorithms Matt Herbster. Why Another Search?  Designed in the 1950s, heavily implemented under John Holland (1970s)  Genetic search.

INTELLIGENT TEST SCHEDULING TE-MPE Technical Meeting Michael Galetzka.

Genetic Algorithms. Solution Search in Problem Space.

MULTI-OBJECTIVE APPROACHES FOR SOFTWARE MODULE CLUSTERING C. Kishore10121D2509 Presented by Guide: Head of the Department: Mr A.Srinivasulu, M.Tech.,(Ph.D.)

Local search algorithms In many optimization problems, the path to the goal is irrelevant; the goal state itself is the solution State space = set of "complete"

Learning based Software Testing --Marriage between “learning” and “testing” Dan Hao Peking University

Evolutionary Algorithms Jim Whitehead

MultiRefactor: Automated Refactoring To Improve Software Quality

Genetic Algorithms: A Tutorial

Multi-Objective Optimization

Technical Debt Reduction Using Search-Based Automated Refactoring

Software Testing: A Research Travelogue

More on HW 2 (due Jan 26) Again, it must be in Python 2.7.

More on HW 2 (due Jan 26) Again, it must be in Python 2.7.

Evolutionary Computation in Computational Finance & Economics

Beyond Classical Search

Genetic Algorithms: A Tutorial

Presentation transcript:

Centre for Research in Evolution, Search & Testing Welcome to CREST King’s College London Mark Harman Centre for Research in Evolution, Search & Testing

Centre for Research in Evolution, Search & Testing CREST Engineering: Better, faster and cheaper –through automation and –Improved insight World leading in –Program Slicing –Search Based Software Engineering –Software Testing Also widely known for work in –Service-Oriented Software Engineering –Foundations of Source Code Analysis

Centre for Research in Evolution, Search & Testing CREST: Where we are CREST King’s College London

Centre for Research in Evolution, Search & Testing 20 minutes walk CREST: Where we are CREST King’s College London

Centre for Research in Evolution, Search & Testing CREST Members Mark Harman Director Nicolas Gold Deputy Director Chris McCulloch CREST Manager EvoTest SEBASE CONTRACTS Shin Yoo PhD Student Afshin Mansouri Research Assistant Chris McCulloch Project Operations Manager Laurie Tratt Research Assistant Youssef Hassoun Research Assistant Kiran Lakhotia PhD Student Zheng Li Research Assistant Kiarash Mahdavi Research Assistant Tao Jiang PhD Student Yuanyuan Zhang PhD Student Kostas Adamopoulos PhD Student Independent PhD Students Kazhaw AlKhaffaf Part time PhD Student Marian Mohr PhD Student Connie Bao PhD Student Independent PhD Students Ghassan Dukes Part time PhD Student Jaeeun Yi PhD student

Centre for Research in Evolution, Search & Testing CREST Funding

Centre for Research in Evolution, Search & Testing Industrial Links

Centre for Research in Evolution, Search & Testing Industrial Links

Centre for Research in Evolution, Search & Testing Yuanyuan Zhang PhD Student Shin Yoo PhD Student Chris McCulloch Project Operations Manager Laurie Tratt Research Assistant Afshin Mansouri Research Associate Mark Harman Project Director

Centre for Research in Evolution, Search & Testing What is SBSE? In SBSE we apply search techniques to search large search spaces, guided by a fitness function that captures properties of the acceptable software artefacts we seek. Genetic Algorithms, Hill climbing, Simulated Annealing, Random, Tabu Search, Estimation of Distribution Algorithms, Particle Swarm Optimization

Centre for Research in Evolution, Search & Testing Why is SBSE?

Centre for Research in Evolution, Search & Testing Why is SBSE?

Centre for Research in Evolution, Search & Testing Why not SBSE? ?

Centre for Research in Evolution, Search & Testing Why not SBSE? EPSRC network 1999 – 2002 Laid foundation for SBSE

Centre for Research in Evolution, Search & Testing Current state of SBSE research 18 countries 20 in UK alone CREST is undisputed world leader

Centre for Research in Evolution, Search & Testing Current state of SBSE research 18 countries 20 in UK alone CREST is undisputed world leader Mark Harman The Current State and Future of Search Based Software Engineering 29th International Conference on Software Engineering (ICSE 2007), Future of Software Engineering (FoSE). Minneapolis, USA, May 2007

Centre for Research in Evolution, Search & Testing SEBASE Project Overview Overall: £2.7M KCL: £1.2M Aim: To provide an entirely new way of understanding and practicing software engineering Software Engineering as search and optimize

Centre for Research in Evolution, Search & Testing … plus EvoTest Overall: £2.1M KCL: £250k Aim: To provide evolutionary search for software test automation Software testing as search and optimize

Centre for Research in Evolution, Search & Testing The Eight Queens Problem

Centre for Research in Evolution, Search & Testing The Eight Queens Problem

Centre for Research in Evolution, Search & Testing The Eight Queens Problem Perfect

Centre for Research in Evolution, Search & Testing The Eight Queens Problem Score 0

Centre for Research in Evolution, Search & Testing The Eight Queens Problem

Centre for Research in Evolution, Search & Testing The Eight Queens Problem

Centre for Research in Evolution, Search & Testing The Eight Queens Problem Two Attacks

Centre for Research in Evolution, Search & Testing The Eight Queens Problem Score -2

Centre for Research in Evolution, Search & Testing The Eight Queens Problem

Centre for Research in Evolution, Search & Testing The Eight Queens Problem

Centre for Research in Evolution, Search & Testing The Eight Queens Problem Three Attacks

Centre for Research in Evolution, Search & Testing The Eight Queens Problem Score -3

Centre for Research in Evolution, Search & Testing That was easy

Centre for Research in Evolution, Search & Testing Generate a solution Place 8 Queens With no attacks

Centre for Research in Evolution, Search & Testing Scale up: Generate a solution

Centre for Research in Evolution, Search & Testing Scale up: Generate a solution

Centre for Research in Evolution, Search & Testing Evolution beats random

Centre for Research in Evolution, Search & Testing SBSE is so generic Testing Fitness function: coverage, time, … Representation: input vector Restructuring Fitness function: cohesion and coupling Representation: mapping nodes to clusters

Centre for Research in Evolution, Search & Testing SBSE is so generic Testing Fitness function: coverage, time, … Representation: input vector Restructuring Fitness function: cohesion and coupling Representation: mapping nodes to clusters

Centre for Research in Evolution, Search & Testing SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Requirements is a search problem Fitness function: cost, value, dependence constraints Representation: bitset

Centre for Research in Evolution, Search & Testing SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Regression is a search problem Fitness function: testing goals Representation: retained test set

Centre for Research in Evolution, Search & Testing SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Planning is a search problem Fitness function: time, schedule robustness Representation: work package allocation

Centre for Research in Evolution, Search & Testing SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Planning is a search problem Fitness function: time, schedule robustness Representation: work package allocation

Centre for Research in Evolution, Search & Testing SBSE Applications TransformationCooper, Ryan, Schielke, Subramanian, Fatiregun, Williams Requirements Bagnall, Mansouri, Zhang Effort prediction Aguilar-Ruiz, Burgess, Dolado, Lefley, Shepperd ManagementAlba, Antoniol, Chicano, Di Pentam Greer, Ruhe Heap allocationCohen, Kooi, Srisa-an Regression testLi, Yoo, Elbaum, Rothermel, Walcott, Soffa, Kampfhamer SOA Canfora, Di Penta, Esposito, Villani RefactoringAntoniol, Briand, Cinneide, O’Keeffe, Merlo, Seng, Tratt Test GenerationAlba, Binkley, Bottaci, Briand, Chicano, Clark, Cohen, Gutjahr, Harrold, Holcombe, Jones, Korel, Pargass, Reformat, Roper, McMinn, Michael, Sthamer, Tracy, Tonella,Xanthakis, Xiao, Wegener, Wilkins MaintenanceAntoniol, Lutz, Di Penta, Madhavi, Mancoridis, Mitchell, Swift Model checkingAlba, Chicano, Godefroid Probe dist’ionCohen, Elbaum UIOsDerderian, Guo, Hierons ComprehensionGold, Li, Mahdavi ProtocolsAlba, Clark, Jacob, Troya Component selBaker, Skaliotis, Steinhofel, Yoo Agent OrientedHaas, Peysakhov, Sinclair, Shami, Mancoridis

Centre for Research in Evolution, Search & Testing TransformationCooper, Ryan, Schielke, Subramanian, Fatiregun, Williams Requirements Bagnall, Mansouri, Zhang Effort prediction Aguilar-Ruiz, Burgess, Dolado, Lefley, Shepperd ManagementAlba, Antoniol, Chicano, Di Pentam Greer, Ruhe Heap allocationCohen, Kooi, Srisa-an Regression testLi, Yoo, Elbaum, Rothermel, Walcott, Soffa, Kampfhamer SOA Canfora, Di Penta, Esposito, Villani RefactoringAntoniol, Briand, Cinneide, O’Keeffe, Merlo, Seng, Tratt Test GenerationAlba, Binkley, Bottaci, Briand, Chicano, Clark, Cohen, Gutjahr, Harrold, Holcombe, Jones, Korel, Pargass, Reformat, Roper, McMinn, Michael, Sthamer, Tracy, Tonella,Xanthakis, Xiao, Wegener, Wilkins MaintenanceAntoniol, Lutz, Di Penta, Madhavi, Mancoridis, Mitchell, Swift Model checkingAlba, Chicano, Godefroid Probe dist’ionCohen, Elbaum UIOsDerderian, Guo, Hierons ComprehensionGold, Li, Mahdavi ProtocolsAlba, Clark, Jacob, Troya Component selBaker, Skaliotis, Steinhofel, Yoo Agent OrientedHaas, Peysakhov, Sinclair, Shami, Mancoridis SBSE Applications in which SEBASE is active

Centre for Research in Evolution, Search & Testing Companies have their act together We have large pools of regression test data They are getting too large We need to Select and Prioritize Regression

Centre for Research in Evolution, Search & Testing Regression Selection

Centre for Research in Evolution, Search & Testing Regression Selection

Centre for Research in Evolution, Search & Testing The optimal test case orderings: DABC CAB D Regression Prioritization

Centre for Research in Evolution, Search & Testing Regression Prioritization

Centre for Research in Evolution, Search & Testing Requirements Optimization Most expensive mistakes and misunderstandings Many customer Many requirements Many releases Fairness, Approximation

Centre for Research in Evolution, Search & Testing Requirements optimization

Centre for Research in Evolution, Search & Testing Dependence Analysis Some case studies in dependence analysis Work we are doing with Prof. Binkley for DaimlerChrysler IBM Motorola Case studies are based on open source Prof. Binkley’s visit is supported by EPSRC

Centre for Research in Evolution, Search & Testing prepro replace Bubble charts

Centre for Research in Evolution, Search & Testing Flex evolution

Centre for Research in Evolution, Search & Testing sendmail findutils Profiling

Centre for Research in Evolution, Search & Testing Example Dependence Profile X axis: program points Y axis: normalised dependence level Monotone Slice Size Graphs

Centre for Research in Evolution, Search & Testing What is going on here?

Centre for Research in Evolution, Search & Testing No clusters

Centre for Research in Evolution, Search & Testing Enormous clusters 

Centre for Research in Evolution, Search & Testing Refactor to remove

Centre for Research in Evolution, Search & Testing Summary World leading Centre in Testing Search Based Software Engineering Slicing Centre hub of National and International Networks Service Oriented Software Engineering Source Code Analysis Search Based Software Engineering Funded by EPSRC EU Industry