Presentation is loading. Please wait.

Presentation is loading. Please wait.

Centre for Research in Evolution, Search & Testing Welcome to CREST King’s College London Mark Harman Centre for Research in Evolution, Search & Testing.

Similar presentations


Presentation on theme: "Centre for Research in Evolution, Search & Testing Welcome to CREST King’s College London Mark Harman Centre for Research in Evolution, Search & Testing."— Presentation transcript:

1 Centre for Research in Evolution, Search & Testing Welcome to CREST King’s College London Mark Harman Centre for Research in Evolution, Search & Testing

2 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ CREST Engineering: Better, faster and cheaper –through automation and –Improved insight World leading in –Program Slicing –Search Based Software Engineering –Software Testing Also widely known for work in –Service-Oriented Software Engineering –Foundations of Source Code Analysis

3 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ CREST: Where we are CREST King’s College London

4 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ 20 minutes walk CREST: Where we are CREST King’s College London

5 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ CREST Members Mark Harman Director Nicolas Gold Deputy Director Chris McCulloch CREST Manager EvoTest SEBASE CONTRACTS Shin Yoo PhD Student Afshin Mansouri Research Assistant Chris McCulloch Project Operations Manager Laurie Tratt Research Assistant Youssef Hassoun Research Assistant Kiran Lakhotia PhD Student Zheng Li Research Assistant Kiarash Mahdavi Research Assistant Tao Jiang PhD Student Yuanyuan Zhang PhD Student Kostas Adamopoulos PhD Student Independent PhD Students Kazhaw AlKhaffaf Part time PhD Student Marian Mohr PhD Student Connie Bao PhD Student Independent PhD Students Ghassan Dukes Part time PhD Student Jaeeun Yi PhD student

6 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ CREST Funding

7 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Industrial Links

8 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Industrial Links

9 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Yuanyuan Zhang PhD Student Shin Yoo PhD Student Chris McCulloch Project Operations Manager Laurie Tratt Research Assistant Afshin Mansouri Research Associate Mark Harman Project Director

10 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ What is SBSE? In SBSE we apply search techniques to search large search spaces, guided by a fitness function that captures properties of the acceptable software artefacts we seek. Genetic Algorithms, Hill climbing, Simulated Annealing, Random, Tabu Search, Estimation of Distribution Algorithms, Particle Swarm Optimization

11 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Why is SBSE?

12 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Why is SBSE?

13 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Why not SBSE? ?

14 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Why not SBSE? EPSRC network 1999 – 2002 Laid foundation for SBSE

15 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Current state of SBSE research 18 countries 20 in UK alone CREST is undisputed world leader

16 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Current state of SBSE research 18 countries 20 in UK alone CREST is undisputed world leader Mark Harman The Current State and Future of Search Based Software Engineering 29th International Conference on Software Engineering (ICSE 2007), Future of Software Engineering (FoSE). Minneapolis, USA, May 2007

17 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SEBASE Project Overview Overall: £2.7M KCL: £1.2M Aim: To provide an entirely new way of understanding and practicing software engineering Software Engineering as search and optimize

18 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ … plus EvoTest Overall: £2.1M KCL: £250k Aim: To provide evolutionary search for software test automation Software testing as search and optimize

19 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem

20 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem

21 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Perfect

22 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Score 0

23 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem

24 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem

25 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Two Attacks

26 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Score -2

27 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem

28 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem

29 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Three Attacks

30 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The Eight Queens Problem Score -3

31 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ That was easy

32 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Generate a solution Place 8 Queens With no attacks

33 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Scale up: Generate a solution

34 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Scale up: Generate a solution

35 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Evolution beats random

36 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing Fitness function: coverage, time, … Representation: input vector Restructuring Fitness function: cohesion and coupling Representation: mapping nodes to clusters

37 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing Fitness function: coverage, time, … Representation: input vector Restructuring Fitness function: cohesion and coupling Representation: mapping nodes to clusters

38 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Requirements is a search problem Fitness function: cost, value, dependence constraints Representation: bitset

39 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Regression is a search problem Fitness function: testing goals Representation: retained test set

40 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Planning is a search problem Fitness function: time, schedule robustness Representation: work package allocation

41 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE is so generic Testing is a search problem Fitness function: coverage, time, … Representation: input vector Planning is a search problem Fitness function: time, schedule robustness Representation: work package allocation

42 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ SBSE Applications TransformationCooper, Ryan, Schielke, Subramanian, Fatiregun, Williams Requirements Bagnall, Mansouri, Zhang Effort prediction Aguilar-Ruiz, Burgess, Dolado, Lefley, Shepperd ManagementAlba, Antoniol, Chicano, Di Pentam Greer, Ruhe Heap allocationCohen, Kooi, Srisa-an Regression testLi, Yoo, Elbaum, Rothermel, Walcott, Soffa, Kampfhamer SOA Canfora, Di Penta, Esposito, Villani RefactoringAntoniol, Briand, Cinneide, O’Keeffe, Merlo, Seng, Tratt Test GenerationAlba, Binkley, Bottaci, Briand, Chicano, Clark, Cohen, Gutjahr, Harrold, Holcombe, Jones, Korel, Pargass, Reformat, Roper, McMinn, Michael, Sthamer, Tracy, Tonella,Xanthakis, Xiao, Wegener, Wilkins MaintenanceAntoniol, Lutz, Di Penta, Madhavi, Mancoridis, Mitchell, Swift Model checkingAlba, Chicano, Godefroid Probe dist’ionCohen, Elbaum UIOsDerderian, Guo, Hierons ComprehensionGold, Li, Mahdavi ProtocolsAlba, Clark, Jacob, Troya Component selBaker, Skaliotis, Steinhofel, Yoo Agent OrientedHaas, Peysakhov, Sinclair, Shami, Mancoridis

43 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ TransformationCooper, Ryan, Schielke, Subramanian, Fatiregun, Williams Requirements Bagnall, Mansouri, Zhang Effort prediction Aguilar-Ruiz, Burgess, Dolado, Lefley, Shepperd ManagementAlba, Antoniol, Chicano, Di Pentam Greer, Ruhe Heap allocationCohen, Kooi, Srisa-an Regression testLi, Yoo, Elbaum, Rothermel, Walcott, Soffa, Kampfhamer SOA Canfora, Di Penta, Esposito, Villani RefactoringAntoniol, Briand, Cinneide, O’Keeffe, Merlo, Seng, Tratt Test GenerationAlba, Binkley, Bottaci, Briand, Chicano, Clark, Cohen, Gutjahr, Harrold, Holcombe, Jones, Korel, Pargass, Reformat, Roper, McMinn, Michael, Sthamer, Tracy, Tonella,Xanthakis, Xiao, Wegener, Wilkins MaintenanceAntoniol, Lutz, Di Penta, Madhavi, Mancoridis, Mitchell, Swift Model checkingAlba, Chicano, Godefroid Probe dist’ionCohen, Elbaum UIOsDerderian, Guo, Hierons ComprehensionGold, Li, Mahdavi ProtocolsAlba, Clark, Jacob, Troya Component selBaker, Skaliotis, Steinhofel, Yoo Agent OrientedHaas, Peysakhov, Sinclair, Shami, Mancoridis SBSE Applications in which SEBASE is active

44 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Companies have their act together We have large pools of regression test data They are getting too large We need to Select and Prioritize Regression

45 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Regression Selection

46 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Regression Selection

47 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ The optimal test case orderings: DABC CAB D Regression Prioritization

48 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Regression Prioritization

49 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Requirements Optimization Most expensive mistakes and misunderstandings Many customer Many requirements Many releases Fairness, Approximation

50 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Requirements optimization

51 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Dependence Analysis Some case studies in dependence analysis Work we are doing with Prof. Binkley for DaimlerChrysler IBM Motorola Case studies are based on open source Prof. Binkley’s visit is supported by EPSRC

52 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ prepro replace Bubble charts

53 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Flex evolution

54 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ sendmail findutils Profiling

55 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Example Dependence Profile X axis: program points Y axis: normalised dependence level Monotone Slice Size Graphs

56 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ What is going on here?

57 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ No clusters

58 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Enormous clusters 

59 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Refactor to remove

60 Centre for Research in Evolution, Search & Testing http://crest.dcs.kcl.ac.uk/ Summary World leading Centre in Testing Search Based Software Engineering Slicing Centre hub of National and International Networks Service Oriented Software Engineering Source Code Analysis Search Based Software Engineering Funded by EPSRC EU Industry


Download ppt "Centre for Research in Evolution, Search & Testing Welcome to CREST King’s College London Mark Harman Centre for Research in Evolution, Search & Testing."

Similar presentations


Ads by Google