Yes, Data Management Can Be Agile! Michele Goetz, Principal Analyst
© 2015 Forrester Research, Inc. Reproduction Prohibited3 Base: 1200 and *595 global data and analytics business decision-makers Source: Business Technographics® Global Data & Analytics Survey, 2015 and 2014 Satisfaction is on the decline even as investment in analytics is on the rise. Q.A1: What is your level of satisfaction with analytics in your company?
© 2015 Forrester Research, Inc. Reproduction Prohibited4 Source: A commissioned study conducted by Forrester Research on behalf of Datawatch February 2016 Base100 US professionals who are responsible for data within their organization More analytic tools won’t solve the problem I don’t have the tools I need to analyze the data 13%
© 2015 Forrester Research, Inc. Reproduction Prohibited5 Agile Adoption born out of a need for speed
© 2015 Forrester Research, Inc. Reproduction Prohibited6 Source: Forrester’s Global Data And Analytics Survey 2015 Base: 855 Business and IT decision makers from companies with 500 employees or more in the US Insight latency is a data problem 62% 40%+ of their time preparing data vs. conducting analysis 50%+ Months or longer for IT to source data for analytics
© 2015 Forrester Research, Inc. Reproduction Prohibited7 Base: 118 data management professionals that implement agile development practices; Source: May 2015 Global Agile Development For Data Management Online Survey Organizations tend to implement Agile for data management after they have implemented Agile practices in other areas of the organization. How long have you been using Agile development practices?
© 2015 Forrester Research, Inc. Reproduction Prohibited8 Source: Business Technographics Developer Survey 2015 Base: 1943 Developers Data engineers have to support the developer community
© 2015 Forrester Research, Inc. Reproduction Prohibited9 Source: Business Technographics Developer Survey 2015 Base: 635 Developers Agile data management has to fit within developer project management practices
© 2015 Forrester Research, Inc. Reproduction Prohibited10 Base: 118 data management professionals that implement agile development practices; Source: May 2015 Global Agile Development For Data Management Online Survey Agile has traction in pockets suited to iterative design and development What areas of data management do you apply Agile development for? (select all that apply)
© 2015 Forrester Research, Inc. Reproduction Prohibited11 Base: 118 data management professionals that implement agile development practices; Source: May 2015 Global Agile Development For Data Management Online Survey Agile typically occure in pockets What best describes the scope of use for Agile development practices as it relates to data management?
© 2015 Forrester Research, Inc. Reproduction Prohibited12 Base: 108 data management professionals that implement agile development practices; Source: May 2015 Global Agile Development For Data Management Online Survey Agile for data management has ties to business architecture focusing on new capabilities and data architecture Please indicate the degree to which you agree with the following statements.
© 2015 Forrester Research, Inc. Reproduction Prohibited13 Base: 115 data management professionals that implement agile development practices; Source: May 2015 Global Agile Development For Data Management Online Survey Agile practices focus on speed, iterations and ownership Which core Agile practices do you apply? (select all that apply)
© 2015 Forrester Research, Inc. Reproduction Prohibited14 Base: 118 data management professionals that implement agile development practices; Source: May 2015 Global Agile Development For Data Management Online Survey Agile beginnings are living up to expectations to create momentum How effective has Agile development been for your data management practice?
© 2015 Forrester Research, Inc. Reproduction Prohibited15 But is agile making a difference for the business?
© 2015 Forrester Research, Inc. Reproduction Prohibited16 Base: 112 data management professionals that implement agile development practices; Source: May 2015 Global Agile Development For Data Management Online Survey Chief data officer support lags behind that of tactical teams Please rate each role in their level of support for Agile development for data management.
© 2015 Forrester Research, Inc. Reproduction Prohibited17 Base: 92 data management professionals that implement agile development practices; Source: May 2015 Global Agile Development For Data Management Online Survey Agile benefits data engineers first – quality and value come second. What benefits have you seen by adopting Agile development for data management (select the top three)
© 2015 Forrester Research, Inc. Reproduction Prohibited18 Base: 93 data management professionals that implement agile development practices; Source: May 2015 Global Agile Development For Data Management Online Survey Disconnects exist between stories and business value – business won’t commit What challenges do you face applying Agile development to data management? (rank the top three)
© 2015 Forrester Research, Inc. Reproduction Prohibited19 Organizations need to understand that data is personal for the business…
© 2015 Forrester Research, Inc. Reproduction Prohibited20 Data fit is a business responsibility, not IT 20 It used to be that the business gave me 80% of their requirements for BI. Today, I’m lucky if I get 20%. - Head of Enterprise Architecture for Global Oil & Gas company I know good data when I see it. - Data scientist at a North American Retailer Business users work with data the way they think
© 2015 Forrester Research, Inc. Reproduction Prohibited21 End User empowerment is paramount 62% We envision giving business users flexibility to pull and use data from a central hub Source: Business Technographics® Global Data & Analytics Survey, 2015 Base: 539 Business and IT decision makers from companies with 500 employees or more in the US
© 2015 Forrester Research, Inc. Reproduction Prohibited22 End user enablement is missing Marketing decision-makers’ POV on reasons for lack of customer 360 Source: Forrester’s Global Business Technographics Marketing Survey 2015, 1039 global marketing decision makers, multiple responses accepted 44%38% Too many data sourcesAccess to technology to manage data source integration
© 2015 Forrester Research, Inc. Reproduction Prohibited Share tribal knowledge - Collaborate Business Stakeholder Analyst Data ArchitectData Steward Tribal Knowledge Collection Consistency Enablement Insight To Action Test And Learn Data Valuation Enable Repeatability Meaningful Insights
© 2015 Forrester Research, Inc. Reproduction Prohibited24 Base: 86 data management professionals; Source: Forrester’s 2014 Global Data Quality And Trust Online Survey End users want more than IT transformation processing Responsive and connected data Data quality firewall
© 2015 Forrester Research, Inc. Reproduction Prohibited25 Base: 193 data management professionals; Source: Forrester’s 2014 Global Data Quality And Trust Online Survey End users want more than transactional internal data Context
© 2015 Forrester Research, Inc. Reproduction Prohibited26 Build your data marketplace
© 2015 Forrester Research, Inc. Reproduction Prohibited27 Data search and discovery opens data channels to end users
© 2015 Forrester Research, Inc. Reproduction Prohibited28 Vendors provide governed gateways for access
© 2015 Forrester Research, Inc. Reproduction Prohibited29 Data prep tools let end users build data pipelines and data sets Data engineers lift and harden into data containers and services
© 2015 Forrester Research, Inc. Reproduction Prohibited30 Data preparation vendors to consider › Alteryx – analytic and data prep pipelines › Datawatch – structured and semi- structured data preparation › Paxata – enterprise scale data preparation platform in the cloud › Trifacta – data science and data analyst preparation workbench
© 2015 Forrester Research, Inc. Reproduction Prohibited31 Design an agile architecture
© 2015 Forrester Research, Inc. Reproduction Prohibited32 Create a modular base for dynamic change across business ecosystems APIs underpin the digital platform
© 2015 Forrester Research, Inc. Reproduction Prohibited33 Align app containers with data containers through API management
© 2015 Forrester Research, Inc. Reproduction Prohibited34 Business APIs deliver, capture, tag and analyze information
© 2015 Forrester Research, Inc. Reproduction Prohibited35 Big data fabrics virtualize data to overcome large messy data and ecosystems
© 2015 Forrester Research, Inc. Reproduction Prohibited36 Data Reset… Agile for data management has tactical and strategic benefits A wider community of data engineers exists beyond data management Enable developers and analysts with self-service Think data containers and services over data monoliths Architecture choices make or break data agility
Thank you forrester.com Michele Goetz Shaun McGovern