Download presentation
Presentation is loading. Please wait.
Published byBartholomew Hancock Modified over 9 years ago
1
Centre for Research in Evolution, Search & Testing Welcome to CREST King’s College London Mark Harman Centre for Research in Evolution, Search & Testing
2
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ CREST Engineering: Better, faster and cheaper –through automation and –Improved insight World leading in –Program Slicing –Search Based Software Engineering –Software Testing Also widely known for work in –Service-Oriented Software Engineering –Foundations of Source Code Analysis
3
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ CREST: Where we are CREST King’s College London
4
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ 20 minutes walk CREST: Where we are CREST King’s College London
5
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ CREST Members Mark Harman Director Nicolas Gold Deputy Director Chris McCulloch CREST Manager EvoTest SEBASE CONTRACTS Shin Yoo PhD Student Afshin Mansouri Research Assistant Chris McCulloch Project Operations Manager Laurie Tratt Research Assistant Youssef Hassoun Research Assistant Kiran Lakhotia PhD Student Zheng Li Research Assistant Kiarash Mahdavi Research Assistant Tao Jiang PhD Student Yuanyuan Zhang PhD Student Kostas Adamopoulos PhD Student Independent PhD Students Kazhaw AlKhaffaf Part time PhD Student Marian Mohr PhD Student Connie Bao PhD Student Independent PhD Students Ghassan Dukes Part time PhD Student Jaeeun Yi PhD student
6
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ CREST Funding
7
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Industrial Links
8
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Industrial Links
9
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Yuanyuan Zhang PhD Student Shin Yoo PhD Student Chris McCulloch Project Operations Manager Laurie Tratt Research Assistant Afshin Mansouri Research Associate Mark Harman Project Director
10
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ What is SBSE? In SBSE we apply search techniques to search large search spaces, guided by a fitness function that captures properties of the acceptable software artefacts we seek. Genetic Algorithms, Hill climbing, Simulated Annealing, Random, Tabu Search, Estimation of Distribution Algorithms, Particle Swarm Optimization
11
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Why is SBSE?
12
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Why is SBSE?
13
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Why not SBSE? ?
14
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Why not SBSE? EPSRC network 1999 – 2002 Laid foundation for SBSE
15
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Current state of SBSE research 18 countries 20 in UK alone CREST is undisputed world leader
16
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Current state of SBSE research 18 countries 20 in UK alone CREST is undisputed world leader Mark Harman The Current State and Future of Search Based Software Engineering 29th International Conference on Software Engineering (ICSE 2007), Future of Software Engineering (FoSE). Minneapolis, USA, May 2007
17
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SEBASE Project Overview Overall: £2.7M KCL: £1.2M Aim: To provide an entirely new way of understanding and practicing software engineering Software Engineering as search and optimize
18
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ … plus EvoTest Overall: £2.1M KCL: £250k Aim: To provide evolutionary search for software test automation Software testing as search and optimize
19
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem
20
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem
21
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Perfect
22
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Score 0
23
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem
24
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem
25
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Two Attacks
26
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Score -2
27
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem
28
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem
29
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Three Attacks
30
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Score -3
31
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ That was easy
32
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Generate a solution Place 8 Queens With no attacks
33
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Scale up: Generate a solution
34
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Scale up: Generate a solution
35
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Evolution beats random
36
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing Fitness function: coverage, time, … Representation: input vector Restructuring Fitness function: cohesion and coupling Representation: mapping nodes to clusters
37
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing Fitness function: coverage, time, … Representation: input vector Restructuring Fitness function: cohesion and coupling Representation: mapping nodes to clusters
38
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Requirements is a search problem Fitness function: cost, value, dependence constraints Representation: bitset
39
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Regression is a search problem Fitness function: testing goals Representation: retained test set
40
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Planning is a search problem Fitness function: time, schedule robustness Representation: work package allocation
41
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Planning is a search problem Fitness function: time, schedule robustness Representation: work package allocation
42
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE Applications TransformationCooper, Ryan, Schielke, Subramanian, Fatiregun, Williams Requirements Bagnall, Mansouri, Zhang Effort prediction Aguilar-Ruiz, Burgess, Dolado, Lefley, Shepperd ManagementAlba, Antoniol, Chicano, Di Pentam Greer, Ruhe Heap allocationCohen, Kooi, Srisa-an Regression testLi, Yoo, Elbaum, Rothermel, Walcott, Soffa, Kampfhamer SOA Canfora, Di Penta, Esposito, Villani RefactoringAntoniol, Briand, Cinneide, O’Keeffe, Merlo, Seng, Tratt Test GenerationAlba, Binkley, Bottaci, Briand, Chicano, Clark, Cohen, Gutjahr, Harrold, Holcombe, Jones, Korel, Pargass, Reformat, Roper, McMinn, Michael, Sthamer, Tracy, Tonella,Xanthakis, Xiao, Wegener, Wilkins MaintenanceAntoniol, Lutz, Di Penta, Madhavi, Mancoridis, Mitchell, Swift Model checkingAlba, Chicano, Godefroid Probe dist’ionCohen, Elbaum UIOsDerderian, Guo, Hierons ComprehensionGold, Li, Mahdavi ProtocolsAlba, Clark, Jacob, Troya Component selBaker, Skaliotis, Steinhofel, Yoo Agent OrientedHaas, Peysakhov, Sinclair, Shami, Mancoridis
43
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ TransformationCooper, Ryan, Schielke, Subramanian, Fatiregun, Williams Requirements Bagnall, Mansouri, Zhang Effort prediction Aguilar-Ruiz, Burgess, Dolado, Lefley, Shepperd ManagementAlba, Antoniol, Chicano, Di Pentam Greer, Ruhe Heap allocationCohen, Kooi, Srisa-an Regression testLi, Yoo, Elbaum, Rothermel, Walcott, Soffa, Kampfhamer SOA Canfora, Di Penta, Esposito, Villani RefactoringAntoniol, Briand, Cinneide, O’Keeffe, Merlo, Seng, Tratt Test GenerationAlba, Binkley, Bottaci, Briand, Chicano, Clark, Cohen, Gutjahr, Harrold, Holcombe, Jones, Korel, Pargass, Reformat, Roper, McMinn, Michael, Sthamer, Tracy, Tonella,Xanthakis, Xiao, Wegener, Wilkins MaintenanceAntoniol, Lutz, Di Penta, Madhavi, Mancoridis, Mitchell, Swift Model checkingAlba, Chicano, Godefroid Probe dist’ionCohen, Elbaum UIOsDerderian, Guo, Hierons ComprehensionGold, Li, Mahdavi ProtocolsAlba, Clark, Jacob, Troya Component selBaker, Skaliotis, Steinhofel, Yoo Agent OrientedHaas, Peysakhov, Sinclair, Shami, Mancoridis SBSE Applications in which SEBASE is active
44
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Companies have their act together We have large pools of regression test data They are getting too large We need to Select and Prioritize Regression
45
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Regression Selection
46
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Regression Selection
47
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The optimal test case orderings: DABC CAB D Regression Prioritization
48
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Regression Prioritization
49
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Requirements Optimization Most expensive mistakes and misunderstandings Many customer Many requirements Many releases Fairness, Approximation
50
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Requirements optimization
51
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Dependence Analysis Some case studies in dependence analysis Work we are doing with Prof. Binkley for DaimlerChrysler IBM Motorola Case studies are based on open source Prof. Binkley’s visit is supported by EPSRC
52
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ prepro replace Bubble charts
53
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Flex evolution
54
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ sendmail findutils Profiling
55
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Example Dependence Profile X axis: program points Y axis: normalised dependence level Monotone Slice Size Graphs
56
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ What is going on here?
57
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ No clusters
58
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Enormous clusters
59
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Refactor to remove
60
Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Summary World leading Centre in Testing Search Based Software Engineering Slicing Centre hub of National and International Networks Service Oriented Software Engineering Source Code Analysis Search Based Software Engineering Funded by EPSRC EU Industry
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.