Brittany Giel University of Florida Ph.D. Candidate Center for Advanced Construction Information Modeling January 8, 2013 Measuring Success - Metrics

 As the benefits of BIM are widely marketed and adoption increases, many construction owners are now mandating that it be utilized on new construction projects.  However, the change in traditional processes associated with implementation may be very new to them.  As a result: o They are often unsure of what deliverables and processes to require o They lack the technical capabilities to operationalize BIM during O&M 2

Source: McGraw Hill Construction 2009 Source: Bercerik-Gerber et al Perceptions2010 Perceptions BIM Use in Different Life Cycle StagesPerceived Value of BIM by Phase 3

 Assess the level of BIM readiness among US building owner organizations.  Identify what critical factors must be measured in the evaluation of building owners’ BIM competency.  Determine the perceived importance of those factors by leading experts in the research domain.  Develop a framework for assisting owner organizations in evaluating their BIM competency. 4

6 Project Evaluation Models CIFE’s BIM Scorecard NBIMs’ ICMM Organization Evaluation Models IU’s BIM Proficiency Matrix CIC Research Program’s Owner Matrix Product Driven Vico’s BIM Score TNO’s BIM QuickScan Process Driven Succar’s BIMMI Incorporate Building Owner needs and requirements Specifically

7 BIM ICMM (NIBS 2007) BIMMI (Succar 2009) BIM proficiency matrix (IU 2009) BIM QuickScan (Van Berlo et al. 2010) BIM Scorecard (CIFE 2011) Owner Maturity Matrix (CIC 2012) Rating Context Rates the building project Rates organizations, teams, individuals, etc. Rates designers & contractors’ ability to perform BIM services Rates BIM performance of organizations who are executing BIM Rates VDC practices on a project Rates owners’ maturity of BIM planning strategies Evaluation Style Designed for self- evaluation but validated using external reviewers 4 different types of evaluations possible based on granularity level Stakeholder fills out the matrix, owner scores them based on responses QuickScan -uses external accredited evaluator or Self-scan - web assessment tool Offered in an Express, Lite and Full version-all use an excel template Designed for self- evaluation Measurement Categories and Weightings Measures information management using 11 areas of interest weighted on importance Measures process, technology and policy using 12 Key Maturity Areas (KMAs) weighted equally Measures 8 areas of interest related to owner’s wants from designers and contractors that are all weighted equally Measures BIM performance across 4 chapters and 10 different aspects based on weighted KPIs Measures 4 areas across 10 different dimensions weighted based on perceived importance Measures strategy, BIM Use, Process, Information, Infrastructure, Personnel in 16 planning elements that are weighted equally Number of Maturity Levels 10 maturity levels5 maturity levels4 maturity areasNo maturity levels based on weighted KPIS 5 Percentile Ranges of increased Innovation 6 maturity levels similar to SEI’s CMMI Criteria Used for Evaluation Project documentation and model External audit of project documentation/ Interviews with BIM personnel Stakeholders’ explanation in an excel template Roughly 50 questions conducted through interview of key BIM personnel or an online questionnaire Uses excel-based interview sheets but moving to web-based server in v7 (full version includes audit by CIFE) Internal assessment by key personnel within the organization COMPARE

9 Representatives from building owner organizations with BIM experience are encouraged to participate:  Participants must be employed by an owner organization that has required BIM for a period of three years or more. o They must have direct experience working with BIM deliverables and requirements. o They must currently be operationalizing BIM for FM. o A BIM manager within the organization is preferred.

10 Design and Construction professionals with significant BIM experience are invited to participate:  At least 5 years BIM management experience working for a Architecture, General Contractor, Engineering or specialty contracting firm is required: o Must have worked on at least 5 projects in which BIM deliverables were exchanged at critical life-cycle phases. o Must have experience working with owners who require BIM deliverables in addition to their own organizational BIM experience.

11 Representatives from Academia are also invited to participate:  Participants must have previous expertise in this research domain i.e. applications related to BIM maturity evaluation and/or FM integration of BIM.  They must also meet at least four of the following requirements: o Be a primary or secondary author of at least 3 peer-reviewed journal articles o Be a member or chair of the Building Smart Alliance o Have at least five years of professional experience in an area of the AECO industry o Be a faculty member of an accredited institution of higher learning o Hold advanced degrees in the areas of Architecture, Construction, Engineering, Management, or Facilities Management o Hold a professional registration such as: Professional Engineer (PE), License Architect (AIA) etc.

Brittany Giel University of Florida