1. Software Integration and Test Techniques in a Large Distributed Project: Evolution, Process Improvement, Results Paola Sivera - ESO

2. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN2 Center of Array Pampa La Bola V. Licancabur Cº Chajnantor Chajnantor Plateau – looking north

3. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN3 Antenna Prototypes at ALMA Test Facility: 2005

4. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN4 ALMA Geographical distribution ALMA DRAO Penticton ALMA ATF Arcetri Observatory Jodrell Bank Brera Observatory IRAM Grenoble ATC Edinburgh NAOJ ESO NRAO Obs de Paris Univ. Calgary c c Santiago MPI Bonn DAMIR/IEM Madrid

5. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN5 ALMA Management B. Glendenning G. Raffi K.Tatematsu Science Software Requirements R. Lucas High Level Analysis J. Schwarz Software Eng M.Zamparelli Common SW G. Chiozzi Executive P. Grosbol Control A. Farris Archiving A. Wicenec Observation Preparation A. Bridger Operations Support M. Chavan Offline J. McMullen Pipeline L. Davis Telescope Calibration R. Lucas Correlator J. Pisano Integration P. Sivera Scheduler A.Farris ACA M.Watanabe Trilateral Computing IPT Organisation Total Bilateral staff now: 40 FTEs Total trilateral staff now: 65 FTEs Total Bilateral staff now: 40 FTEs Total trilateral staff now: 65 FTEs

6. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN6

7. 7

8. 8 ALMA System Dataflow

9. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN9 ObsPrep Visual Editor (to select spectral setup)

10. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN10 EXEC: Operator Master Client

11. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN11 CASA Viewer Visibility displays (raw, corrected data) Image, data cube displays –Statistics; profiles; raster, contour, vector support

12. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN12 Standards and Tools Alma Common Software Environment CVS organization Makefile Standard Test Environment (STE) Tool for automated testing Bug tracking tool (JIRA)

13. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN13 ALMA Release Cycle Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Minor Release: Mar 31Major Release: Sep 30 Monthly integration = last day of the month ICD Freeze = 15 th of the month

14. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN14 Lessons learned Releases twice per year but… Subsystem developers working in isolation Results thrown over the wall to ITS at release time –Each integration took ~2 months –At completion of integration code was already obsolete

15. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN15 Function-based Teams

16. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN16 FBTs organization ZSharedSimulator-2006-02-B (branch) SharedSimulator-2006-02-RootOfBranch (tag of the HEAD) ASharedSimulator-2006-02-BeforeMerge BTRUNK-SharedSimulator-2006-02-BeforeMerge CTRUNK-SharedSimulator-2006-02-AfterMerge (tag of the HEAD) SharedSimulator-2006-02-AfterMerge-B (branch) F SharedSimulator-2006-02-FINAL

17. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN17 Summing it up FBTs advantages: –Improve communication –More effective involvement of testers Testing end-to-end since the beginning –Good for object-oriented software –A lot of maintenance on the test cases –It is not enough -> user tests

18. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN18 Where we are Testing maturity (according to Boris Beizer) 1.there is no difference between testing and debugging: often during FBTs’ work 2.the purpose of testing is to show that the software works: at FBTs validation 3.the purpose of testing is to show that the software does not work: release validation 4.the purpose of testing is not to prove anything, but to reduce the perceived risk of not working to an acceptable value: release validation

19. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN19 Future developments Make software more testable from its inception adoption of the test maturity model (TMM) … the list can be very long … For the near future we want to focus on: Stability tests More automation

20. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN20 AOS Technical Building

21. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN21 ALMA - 2012

22. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN22

23. ICALEPCS 2007, 15-19 Oct 2007, Knoxville TN23 MELCO : August 2007