Transforming Organizations through Open Source Software Walt Scacchi Institute for Software Research University of California, Irvine Irvine, CA 92697-3425.

Slides:



Advertisements
Similar presentations
Open Source Answer to Critical Infrastructure Security Challenges Vadim Shchepinov, Chief Executive Officer RED SOFT CORPORATION.
Advertisements

Systems Engineering in a System of Systems Context
Chandler ISR June Chandler Open Source Personal Information Manager , calendar, contacts, tasks, free-form items Easy sharing and collaboration.
1 Panel: Open Source Software Successes and Challenges Margaret Elliott, ISR Pankaj Garg, ZeeSource Jason Robbins, UCI (formerly Collab.net) Walt Scacchi,
1 Strategies for Developing and Deploying Free/Open Source Software Walt Scacchi Institute for Software Research School of Information and Computer Science.
Virtual Radical Collocation for Distributed Software Development: Discussion Walt Scacchi Institute for Software Research University of California, Irvine.
1 Open Source Software, Computer Games, and other Socio-Technical Processes Walt Scacchi Institute for Software Research and University of California Irvine.
Software Process Simulation and Modeling: A Review Walt Scacchi Institute for Software Research UCIrvine
1 Open Source Software, Computer Games, and other Socio-Technical Processes Walt Scacchi Institute for Software Research and Game Culture and Technology.
Open Source Software Research at ISR Walt Scacchi Institute for Software Research
1 Emerging Research Concepts for Very Large-Scale Software Engineering Walt Scacchi Institute for Software Research University of California, Irvine Irvine,
1 Understanding the Requirements for Developing and Designing Open Source Software Walt Scacchi Institute for Software Research and Laboratory for Computer.
Computer Games, Open Source Software, and Computer Supported Work Environments Research Opportunities Walt Scacchi Institute for Software Research Game.
1 Strategies for Developing and Deploying Free/Open Source Software Walt Scacchi Institute for Software Research School of Information and Computer Science.
1 Educational Experiences with F/OSS Development Projects: Helping the Inmates Take Over the Asylum Walt Scacchi Institute for Software Research University.
Modeling and Simulating Free/Open Source Software Development Processes Walt Scacchi Institute for Software Research School of Information and Computer.
1 Understanding the Requirements for Developing and Designing Open Source Software Walt Scacchi Institute for Software Research University of California,
1 Computer Systems & Architecture Lesson 1 1. The Architecture Business Cycle.
(Re)Designing Software Production Architectures Walt Scacchi ATRIUM Laboratory and USC Center for Software Engineering 10.
1 Software Licenses, Open Source Components, and Open Architectures Thomas Alspaugh, Hazeline Asuncion, Walt Scacchi Institute for Software Research University.
Emerging Opportunities in Software Technology R&D: A Technology Forecast Walt Scacchi Institute for Software Research University of California, Irvine.
1 Understanding the Requirements for Open Source Software Development Walt Scacchi Institute for Software Research University of California, Irvine Irvine,
1 Understanding Best Practices in Free/Open Source Software Development Walt Scacchi Institute for Software Research School of Information and Computer.
Free/Open Source Software Development: Recent Research Results and Emerging Opportunities Walt Scacchi Institute for Software Research University of California,
Simulating an Automated Approach to Discovery and Modeling of Open Source Software Development Processes Chris Jensen and Walt Scacchi Institute for Software.
1 ECE 453 – CS 447 – SE 465 Software Testing & Quality Assurance Case Studies Instructor Paulo Alencar.
Open Source: How it benefits the Telephony Market Jim Webster Director, Technology Partnerships Digium, Inc. IT Expo Fall 2008.
Opportunities for Game Culture and Technology in Public Libraries Walt Scacchi Institute for Software Research and University of California.
Process and Open Source Software Walt Scacchi Institute for Software Research UC Irvine
Game Web Research at the UCI Game Lab Walt Scacchi and California Institute for Telecommunications and Information Technology (Calit2)
1 Game Grids and Game Culture: Research Vision Walt Scacchi Institute for Software Research and Laboratory for Computer Game Culture and Technology University.
What is Software Architecture?
Opportunities for Game Culture and Technology in Public Libraries Walt Scacchi Institute for Software Research and University of California.
GMD German National Research Center for Information Technology Innovation through Research Jörg M. Haake Applying Collaborative Open Hypermedia.
1 Understanding Free/Open Source Software Development Practices Walt Scacchi Institute for Software Research School of Information and Computer Science.
Patterns of Sustained Collaborative Creativity Across Open Computerization Movements Walt Scacchi Institute for Software Research and Game Culture and.
Computing in Atmospheric Sciences Workshop: 2003 Challenges of Cyberinfrastructure Alan Blatecky Executive Director San Diego Supercomputer Center.
Who Are We? An open, international ecosystem containing 70+ organizations each working in their own self-interest while collaborating toward a common industry.
1 Research and Educational Innovations in Computer Games Walt Scacchi and California Institute for Telecommunications and Information Technology (Calit2)
Software evolution. Objectives l To explain why change is inevitable if software systems are to remain useful l To discuss software maintenance and maintenance.
Organization of the Information Systems Function Chapter 14.
Computer Gaming as a Social Movement Walt Scacchi Institute for Software Research and Game Culture and Technology Laboratory University of California,
SCSC 311 Information Systems: hardware and software.
1 Enterprise and Global Management of Information Technology.
Enabling Exponential Innovation via Open Source Software Development Walt Scacchi Institute for Software Research and Game Culture and Technology Laboratory.
Open Source Software In the beginning, all software was free –in the 1960s,when IBM and others sold the first large-scale computers, these machines came.
HCI in Software Process Material from Authors of Human Computer Interaction Alan Dix, et al.
1 Collaboration Infrastructure for a Virtual Residency in Game Culture and Technology Robert Nideffer and Walt Scacchi Game Culture and Technology Laboratory.
Identifying New Market Opportunities through Process Discovery Walt Scacchi Institute for Software Research and Game Culture and Technology Laboratory.
1 Computer Games, Open Source Software, and other Socio-Technical Processes Walt Scacchi Institute for Software Research and Game Culture and Technology.
IND Architecture Modernization, Deep Space Information Services Architecture (DISA), A Business Case for SOA-Based Modernization Mike Kolar, Integrated.
Manag ing Software Change CIS 376 Bruce R. Maxim UM-Dearborn.
1 Computer Games, Open Source Software, and other Socio-Technical Processes Walt Scacchi Institute for Software Research and Game Culture and Technology.
Collaboration, Leadership, Control and Conflict Negotiation in the NetBeans.org Community Chris Jensen and Walt Scacchi Institute for Software Research.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Marv Adams Chief Information Officer November 29, 2001.
MNP1163 (Software Construction).  SDLC and Construction Models  Construction Planning  Construction Measurement.
Chapter 2: Software Maintenance Omar Meqdadi SE 3860 Lecture 2 Department of Computer Science and Software Engineering University of Wisconsin-Platteville.
Process Modeling Across the Web Information Infrastructure Chris Jensen and Walt Scacchi Institute for Software Research School of Information and Computer.
When Worlds Collide: Emerging Patterns of Intersection and Segmentation when Computerization Movements Interact Walt Scacchi Institute for Software Research.
Multi-Modal Modeling, Analysis, and Validation of Open Source Software Development Processes Walt Scacchi, Chris Jensen, John Noll, and Margaret Elliott.
Development of Concepts for R&D Management R&D in an Individual Enterprise.
Advantages and Disadvantages of Open source Software
Understanding Best Practices in Free/Open Source Software Development
Walt Scacchi Institute for Software Research
Walt Scacchi Institute for Software Research and
Walt Scacchi Institute for Software Research
Open Source Software Development Processes Version 2.5, 8 June 2002
Strategies for Developing and Deploying Free/Open Source Software
Presentation transcript:

Transforming Organizations through Open Source Software Walt Scacchi Institute for Software Research University of California, Irvine Irvine, CA USA June 2005

2

3

4

5

6 Overview Open source software development OSSD business models Organizational forms for OSSD Governance structures for OSSD Transforming organizations via OSS

7 Open Source Software Development

8 What do we know so far about OSSD? What is it, what is it not Who is participating or investing? Recent research results

9 What is OSSD, what is it not? Free (as in “freedom”) vs. open source software –Freedom to access, browse/view, study, modify and redistribute the source code –Free is always open, but open is not always free F/OSSD is not “software engineering” –Different: F/OSSD can be faster, better, and cheaper than SE –SE “-ilities” may not apply in the same way to OSSD F/OSSD involves more software development tools, Web resources, and personal computing resources

10

11 Who is investing in OSS? Large corporations/enterprises: –IBM-Eclipse, Sun-NetBeans and OpenOffice, HP- Gelato, Apple-Darwin, Microsoft Research-Rotor, etc. –Barclays Global Investors, DKW, Merrill Lynch, etc. –DoD, DoE, NSF, NIH, NASA, etc. –MIT, Stanford, CMU, UC, UMichigan, etc. Mid-size corporations: –RedHat, Novell, Borland Small (start-up) companies: –ActiveState (now part of Sophos), Collab.Net, Jabber, Ximian (now part of Novell), JBoss, Compiere, etc.

12 Recent research results OSS project demographics OSSD processes and practices –Software requirements and design –Architectural practices –Configuration management and work practices –Evolution dynamics –Project management and career contingencies –Software technology transfer

13

14

15 Findings from F/OSS Studies CIO Executive Survey : –OSS primarily for new system deployments –OSS benefits enable lower Total Cost of Ownership lower capital investment greater reliability –OSS weaknesses: lack of in-house skills or skills in labor market, lack of vendor support or vendor viability switching costs Observation: We lack a detailed and predictable understanding of the costs of developing, deploying, and sustaining OSS.

16 Findings from F/OSSD Studies Hars and Ou 2002: –>60% of F/OSS developers work on 2-10 F/OSS projects (i.e., socio-technical networking widespread) Madey, et al. 2003: – 90% unsustained, and with less than 2 contributors (i.e., Power Law) Nichols and Twidale 2003: –Usability of F/OSS systems generally neglected Scacchi : –Largest F/OSSD projects sustain exponential growth; but most F/OSSD projects fail to grow to any sustainable effort

17 F/OSS Processes for Software Requirements or Design F/OSS Requirements/Designs –not explicit –not formal F/OSS Requirements/Designs are embedded within “informalisms” –Example OSS informalisms to follow (as screenshot displays) F/OSS Requirements/Design processes are different from their SE counterparts.

18 SE vs. F/OSS processes for Requirements Elicitation Analysis Specification and modeling Validation Communicating and managing Post-hoc assertion Reading, sense- making, accountability Continually emerging webs of discourse Condensing and hardening discourse Global access to discourse

19

20

21

22 OSS architectural issues Source code as API –Unpredictable evolution of product line Bricolage –Unanticipated composition of heterogeneous software components Social networks and software configurations: Conway’s law revisited –OSS are socio-technical systems

23

24 Configuration management and work coordination Use CM to coordinate and control who gets to update what part of the system/online artifacts –Many F/OSSD projects use CVS (single centralized code repository with update locks) and frequent releases (daily releases on active projects) –Collab.Net and Tigris.org: Subversion (CVS++) –Apache: Single major release, with frequent “patch” releases (e.g., “A patchy server”) –Linux Kernel: BitKeeper (multiple parallel builds and release repositories)—being replaced by Git –GNU arch seeks to develop Free CM unification

25 Concurrent version system (CVS) for coordinating source code updates

26 Evolutionary redevelopment, reinvention, and redistribution Overall evolutionary dynamic of F/OSSD is reinvention –Reinvention enables continuous improvement F/OSS evolve through minor mutations –Expressed, recombined, redistributed via incremental releases F/OSS systems co-evolve with their development community –Success of one depends on the success of the other Closed legacy systems may be revitalized via opening and redistribution of their source –When enthusiastic user-developers want their cultural experience with such systems to be maintained.

27

28 Revitalizing legacy applications via open source example

29 Project management and career development F/OSSD projects self-organize as a pyramid meritocracy via virtual project management –Meritocracies embrace incremental mutations over radical innovations –VPM requires people to act in leadership roles based on skill, availability, and belief in project community F/OSS developers want to learn about new stuff (tools, techniques, skills, etc.), have fun building software, exercise their technical skill, try out new kinds of systems to develop, and/or interconnect multiple F/OSSD projects.

30 (images from A.J. Kim, Community Building on the Web, 2000) A pyramid meritocracy and role migration hierarchy for F/OSSD

31 Virtual project management example

32

33 Software technology transfer and licensing F/OSS technology transfer from existing Web sites is a community and team building process –Not (yet) an engineering process –Enables unanticipated applications and uses –Enables F/OSSD to persist without centrally planned and managed corporate software development centers

34 Example of F/OSS technology transfer that enabled creation of new kind of application (e.g., online virtual dancing)

35 An OSS Ecosystem: a socio-technical community and infrastructure for tech transfer and inter-project governance

36 Implications F/OSSD is a community building process –not just a technical development process –F/OSS peer review creates a community of peers F/OSSD processes often iterate daily versus infrequent singular (milestone) Software Life Cycle Engineering events –F/OSSD: frequent, rapid cycle time (easier to improve) vs. –SLC: infrequent, slow cycle time (harder to improve)

37 Conclusions regarding OSSD Developing F/OSS is different than software engineering –not better, not worse, but different and new –more social, more accessible, more convivial F/OSS developers may not seek the goals and benefits from classic software engineering

38 OSSD Business Models

39 Traditional software production business models Custom software product engineering Cost reduction Agile production Revenue maximization Profit maximization Market dominance M. Cusumano, The Business of Software : What Every Manager, Programmer, and Entrepreneur Must Know to Thrive and Survive in Good Times and Bad, Free Press, 2004.

40 OSSD Business Models Free software (General Public License) Open source (BSD/MIT license) Dual license –F/OSS and proprietary licenses Corporate sponsored (SUN, IBM, Apple, HP) Corporate Source (Hewlett-Packard in-house) Shared Source (Microsoft Research) Community Source (SAKAI, Westwood, etc. in Higher Education)

41 Organizational Forms for OSSD

42 Common OSS organizational forms One-off project (>90%) Replicated project (Virtual product line?) –500+ Linux distributions, 200+ OSS content management system projects, 400+ system build/make projects, etc. Meta project –Apache.org Non-profit foundation –Free Software Foundation, GNOME Foundation Corporate sponsored –Sun NetBeans, HP Gelato, IBM Eclipse, Apple Darwin, etc. Consortium and Alliance –Open Source Development Lab, Avalanche Cooperative –Asterisk VoIP PBX, SugarCRM, OpenAdaptor

43 Governance Structures for OSSD

44 Governance structures Collaboration –Guidelines, policies, separate concerns Leadership and Control –Transparency in decision-making –Consent in decision-making –Conflict Resolution

45 Transforming Organizations via OSS

46 Transforming organizations Concepts Methods Tools Case studies

47 Concept Transforming organization target from as-is condition to to-be form via here-to-there transformations Transformation goal: Aligning organizational form, processes, strategy, and information technology –Organizational forms –Open source processes –Business model strategy –Web-centric OSS infrastructure

48 Methods Change management –Empowering organizational participants to embrace, lead, and affect organizational transformation Process engineering –Proving participants with the concepts, techniques, tools, and authority to transform their organization in a process-centric manner

49 Tools (1) Organizational process modeling, analysis, simulation, visualization, re-enactment, and redesign –Supports capture, description, and application of causal and interrelated knowledge about what can affect software development (from empirical studies). –Requires an underlying computational model of process states, actions, plans, schedules, expectations, histories, etc. in order to answer dynamic "what-if" questions.

50 Tools (2) Organizational transformation collaboratory An immersive environment where participants can take a first-person view of simulated organizational processes, before, during, and after transformation Using either an organizational process simulator, or a game-based computer supported collaborative organizational learning environment (CSCOLE)

51 Case Studies  Core process transformation at ONR –Process engineering using organizational transformation laboratory Supporting long-term, large-scale transformation –MMORPG-based computer supported collaborative organizational learning environment Massively, multi-player online role playing game Transforming a software productivity crisis at “BigSysCo” –Process engineering and process simulator

52 A complex software production process : a decomposition-precedence relationship view (19 levels of decomposition, 400+ tasks) W. Scacchi, Experience with Software Process Simulation and Modeling, J. Systems and Software, 46(2/3): ,1999.Experience with Software Process Simulation and Modeling

53

54

55 As-is vs. to-be process

56

57 Identify and cultivate software productivity drivers Why are software developers so productive in the presence of technical and organizational constraints? Software developers must realize the potential for productivity improvement. –The potential for productivity improvement is not an inherent property of new software development technology. –Technological impediments and organizational constraints can nullify this potential. Thus, a basic concern must be to identify and cultivate software productivity drivers. –Examples include workplace incentives and alternative software business models

58 Open source processes Free/open source software does not embody the processes for how to develop, deploy, use or sustain them –Deploying free/open source software is low-cost, but often inefficient and sub-optimal Closed source software development, deployment, use, and support is also inefficient and sub-optimal –Explicit open source processes could also help closed source systems.

59 Open source process example Example of an open source process model of a proposal submission process, specified in a Process Markup Language, PML J. Noll and W. Scacchi, Specifying Process-Oriented Hypertext for Organizational Computing, Journal of Network and Computer Applications, 4(1):39-61, Specifying Process-Oriented Hypertext for Organizational Computing

60 Questions?

61

62 Acknowledgements Project collaborators: –Mark Ackerman, UMichigan, Ann Arbor –Les Gasser, UIUC –John Noll, Santa Clara University –Margaret Ellliot, Chris Jensen, UCI-ISR –And others at UCI-ISR Funding support: –National Science Foundation, ITR# , ITR#-# , ITR# , and ITR#-# No endorsement implied.

63 References W. Scacchi, Understanding the Requirements for Developing Open Source Software, IEE Proceedings--Software, 149(1), , 2002.Understanding the Requirements for Developing Open Source Software W. Scacchi, Free/Open Source Software Development Practices in the Computer Game Community, IEEE Software, 21(1), 59-67, January/February 2004.Free/Open Source Software Development Practices in the Computer Game Community C. Jensen and W. Scacchi, Experiences in Discovering, Modeling, and Reenacting Open Source Software Development Processes, Proc. Software Process Workshop, Beijing, China, May 2005.Experiences in Discovering, Modeling, and Reenacting Open Source Software Development Processes W. Scacchi, Understanding Free/Open Source Software Evolution, in N.H. Madhavji, M.M. Lehman, J.F. Ramil and D. Perry (eds.), Software Evolution, John Wiley and Sons Inc, New York, (to appear).Understanding Free/Open Source Software Evolution More at