David Besemer, CTO On Demand Data Integration with Data Virtualization.

Slides:



Advertisements
Similar presentations
October 10-13, 2006 San Diego Convention Center, San Diego California VoIP/SOA Integration Impact on IT Apps, Processes, & Overall Business.
Advertisements

© 2010 TIBCO Software Inc. All Rights Reserved. Confidential and Proprietary. TIBCO Spotfire Application Data Services TIBCO Spotfire European User Conference.
Current impacts of cloud migration on broadband network operations and businesses David Sterling Partner, i 3 m 3 Solutions.
A Java Architecture for the Internet of Things Noel Poore, Architect Pete St. Pierre, Product Manager Java Platform Group, Internet of Things September.
ON-DEMAND VISIBILITY Copyright © 2005 Composite Software, Inc. All Rights Reserved. Ian Pestell Director EMEA Operations Data Virtualization an Overview.
SAS® Data Integration Solution
1 Software architecture adjustments for a changing business.
SOA with Progress Philipp Walther Consultant. © 2007 Progress Software Corporation2 Agenda  SOA  Enterprise Service Bus (ESB)  The Progress SOA Portfolio.
Stuart Sim Chief Architect Global Education & research Sun Client Solutions Blog:
Unlock Your Data Rich connectivity Robust data integration Enterprise-class manageability Deliver Relevant Information Intuitive design environment.
Architecting for the Internet of Things
Hosted by Achieving Best Business Performance Mark R. Willford, Partner Accenture.
REDMOND, Wash., and WALLDORF, Germany – May 19 th, 2014: Steve Lucas, President SAP Platform Solutions at SAP AG “We are proud of how we listened.
© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) Building Momentum Launch Strategy 5.1.
Software Architecture April-10Confidential Proprietary Master Data Management mainly inspired from Enterprise Master Data Management – An SOA approach.
® IBM Software Group © IBM Corporation IBM Information Server Service Oriented Architecture WebSphere Information Services Director (WISD)
Plan Introduction What is Cloud Computing?
Business Intelligence: The Next Big Thing (Really!) John Bair CTO, Ajilitee Sep 14, 2012 Presented to TDWI St. Louis Chapter.
FROM DATA STORE TO DATA SERVICES - DEVELOPING SCALABLE DATA ARCHITECTURE AT SURS Tomaž Špeh UNECE Workshop on the Modernisation of Statistical Production.
Presented to: By: Date: Federal Aviation Administration Enterprise Information Management SOA Brown Bag #2 Sam Ceccola – SOA Architect November 17, 2010.
Getting Smarter with Information An Information Agenda Approach
SOA – Development Organization Yogish Pai. 2 IT organization are structured to meet the business needs LOB-IT Aligned to a particular business unit for.
Data Integration in Service Oriented Architectures Rahul Patel Sr. Director R & D, BEA Systems Liquid Data – XML-based data access and integration for.
Word Wide Cache Distributed Caching for the Distributed Enterprise.
Optimize your Open Data 5 Best Practices for Designing Data-Driven Apps ​ Glenn Hess ​ Federal Sales Engineer ​ Actuate, Inc.
August 27, 2008 Platform Market, Business & Strategy.
© Copyright 2011 Hewlett-Packard Development Company, L.P. 1 Sundara Nagarajan (“SN”) CLOUD SYSTEMS AUTOMATION.
BI IN THE CLOUD: TIME TO TAKE THE PLUNGE? Sunil Murray Sales Director Birst
The Value of Fusion Middleware for Oracle Applications Shari White Sr. Solutions Consultant, FMW.
System Management for Virtualization and Automation in a Dynamic Data Center SVM’08 Munich Karsten Beins, Sen. Director Infrastructure Technology.
Composite Data Virtualization and Data Service Solutions.
Michael Corcoran Sr. Vice President & CMO New Data Requirements Driven By Analytics 1.
Business and IT Working Together to Streamline Corporate Reporting Stephen Hord, Director of Product Development – UBmatrix.
Plan  Introduction  What is Cloud Computing?  Why is it called ‘’Cloud Computing’’?  Characteristics of Cloud Computing  Advantages of Cloud Computing.
SOA-21: Integrating SAP and Other Packaged Applications into your SOA Infrastructure Wayne Lockhart Sr. Product Manager.
© 2005 IBM Corporation IBM Business-Centric SOA Event SOA on your terms and our expertise Operational Efficiency Achieved through People and SOA Martin.
SOA-25: Data Distribution Solutions Using DataXtend ® Semantic Integrator for Sonic ™ ESB Users Jim Barton Solution Architect.
Cloud Market Readiness Report Finance, Media, and Legal Sectors March 2014 Trend Consulting 2013.
© 2009 IBM Corporation Maximize Cost Savings While Improving Visibility Into Lines of Business Wendy Tam, CDC Product Marketing Manager
Independent Insight for Service Oriented Practice Summary: Service Reference Architecture and Planning David Sprott.
1 ©2015 Talend Inc Talend VAR program Presentation.
Driving Business Agility at Pfizer Martin Brodbeck Application Architecture Director Pfizer Global Pharmaceuticals June 7, 2004.
Rajesh Bhat Director, PLM Analytics Applications
Implementing The SOA Reference Model An ESB Developer’s Perspective David Millman Principal Architect 9/8/2008.
Mark Gilbert Microsoft Corporation Services Taxonomy Building Block Services Attached Services Finished Services.
DO YOU TRUST YOUR DATA? KNOW THE ANSWER WITH EIM! Jose Hernandez Director, Business Intelligence Dunn Solutions Group.
Transform the datacenter brought to you by [insert partner name] Speaker name 00/00/0000 Insert your Logo here.
An Introduction To Big Data For The SQL Server DBA.
Managing Data Resources File Organization and databases for business information systems.
1 Cloud-Native Data Warehousing Bob Muglia. 2 Scenarios with affinity for cloud Gartner 2016 Predictions: By 2018, six billion connected things will be.
Designing Cisco Data Center Unified Fabric
Making the Case for Business Intelligence
Data Services for Service Oriented Architecture in Finance
Unlock the Business Value of Virtualization with Analytics
Empowering Business Transformation with Mobile BI & Analytics
Organizations Are Embracing New Opportunities
Big Data Enterprise Patterns
Enable the Hybrid Data Platform
with the Microsoft BI Ecosystem
Solution Summary Business Service Management Solution on AIX® 6.1.
Business Performance Management works for everyone
Agile Power BI for self service.
Ashish Pandit, Louis Zelus, Jonathan Whitman
Logical Data Warehousing and Tableau 10
2/25/2019.
Windows Azure Hybrid Architectures and Patterns
SQL Server 2019 Bringing Apache Spark to SQL Server
Presentation transcript:

David Besemer, CTO On Demand Data Integration with Data Virtualization

2 Agenda State of Enterprise Information The Case for Data Virtualization How Data Virtualization Works Data Virtualization Adoption Patterns © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

3 The State Of Enterprise Information More demanding business users  Competition drives faster time-to-information  Younger staff want more “do-it-yourself”  “IT’s challenges are not my problem.” Information overload  Exponential data volume growth  Omnipresent delivery “Over the top” IT complexity  New sources, uses, and enabling technology  Layered on byzantine IT infrastructures © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

4 Data Management Trends Changing role of the Data Warehouse  Data warehouse no longer viewed as only focal point for all data integration Lower latencies required  Information needs moving toward real time Rising “fit-for-purpose” storage and processing  Appliances, MPP, NoSQL Data Quality being addressed at every layer  Source, Consolidation, Virtual, and Visualization Clouds are approaching…  Most enterprises looking to leverage cloud computing © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

5 Agenda State of Enterprise Information The Case for Data Virtualization How Data Virtualization Works Data Virtualization Adoption Patterns © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

6 The Challenge Big DataFilesPackaged Applications Web Services RDBMS BI, CPM, and Reporting Custom and Composite Apps Portals and Dashboards SOA Initiatives Source Data Siloed & Rigid Constant Change Business Solutions Data Integration Challenge © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

7 Traditional Physical Data Consolidation Big DataFilesRDBMS Web Services Packaged Applications Enterprise Data Warehouse Physical Data Marts Physical Operational Data Stores Physical Intermediate Stores & ETL Middleware Source Data Business Solutions BI, CPM, and Reporting Custom and Composite Apps Portals and Dashboards SOA Initiatives © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

8 Traditional Physical Data Consolidation Big DataFilesRDBMS Web Services Packaged Applications BI, CPM, and Reporting Custom and Composite Apps Portals and Dashboards SOA Initiatives Enterprise Data Warehouse Physical Data Marts Physical Operational Data Stores Physical Intermediate Stores & ETL Middleware Source Data Business Solutions More silos & complexity  Slows future IT progress More silos & complexity  Slows future IT progress Physical consolidation  Forces the business to wait longer for solutions Physical consolidation  Forces the business to wait longer for solutions Wait, wait, wait! Uncontrolled data replication  Reduced data quality  Significant hidden costs Uncontrolled data replication  Reduced data quality  Significant hidden costs $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ Batch integration  Delay real-time information Batch integration  Delay real-time information Customer X Invoice UNPAID Customer X Invoice UNPAID Customer X Invoice PAID IN FULL Customer X Invoice PAID IN FULL Batch Data On-Demand Data OLD © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

Data Integration Architectures and Patterns: Build a Portfolio to Address the Range of Needs Physical Movement and Consolidation (e.g., ETL) Abstraction/Virtual Consolidation (Data Federation) Change-Capture and Propagation (Replication or Messaging) Common Metadata (Location, Format, Structure, Quality, Meaning) Common Connectivity (Full range of source/target types) BI Tools/Apps. Master Data Mgmt. Operational Apps. Interenterprise Leading organizations support multiple styles of data integration and delivery to address a range of business requirements — breadth enables leverage and agility. Common Design, Admin., Governance

10 © 2010 Composite Software, Inc. / Composite Proprietary and Confidential Physical Movement and Consolidation (ETL, CDC) Abstraction / Virtual Consolidation (Data Federation) Middle- ware ETLCDCData VirtualizationEAI / ESB Purpose Attribute How Data Virtualization Differs Synchronization and Propagation (Messaging) DB  DB Scheduled Event Driven Application  Application DB  Application On Demand Event Driven DB  DB © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

11 Traditional Physical Data Consolidation Big DataFilesRDBMS Web Services Packaged Applications BI, CPM, and Reporting Custom and Composite Apps Portals and Dashboards SOA Initiatives Physical Data Marts Physical Operational Data Stores Enterprise Data Warehouse Physical Intermediate Stores & ETL Middleware © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

12 Data Virtualization Increases Agility Big DataFilesRDBMS Web Services Packaged Applications BI, CPM, and Reporting Custom and Composite Apps Portals and Dashboards Enterprise Search Physical Data Marts Physical Operational Data Stores Virtual Data Marts Virtual Operational Data Stores Enterprise Data Warehouse Data Virtualization Physical Intermediate Stores & ETL Middleware © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

13 Shared Data Services & Relational Views Further Extend Flexibility and Agility Big DataFilesRDBMS Web Services Packaged Applications Physical Data Marts Physical Operational Data Stores Virtual Data Layer Virtual Data Marts Virtual Operational Data Stores Web Data Services & Relational Views Enterprise Data Warehouse Composite Information Server Physical Intermediate Stores & ETL Middleware BI, CPM, and Reporting Custom and Composite Apps Portals and Dashboards SOA Initiatives © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

14 A Complete Data Integration Architecture Big DataFilesRDBMS Web Services Packaged Applications BI, CPM, and Reporting Custom and Composite Apps Portals and Dashboards SOA Initiatives Physical Data Consolidation Layer Virtual Data Layer Virtual Data Marts Virtual Operational Data Stores Shareable Data Services & Relational Views Physical Data Marts Physical Operational Data Stores Enterprise Data Warehouse © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

15 Forrester Data Management Reference Architecture © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

16 Agenda State of Enterprise Information The Case for Data Virtualization How Data Virtualization Works Data Virtualization Adoption Patterns © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

17 How Data Virtualization Works – Example Scenario 1) I need to build an application that looks like this… 2) The view or data service needs to look like this… 3) And the data comes from these sources, in these formats… © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

18 Composite Information Server Studio Data Discovery and Design Design Steps 1.Discover data and relationships 2.Model individual view/service 3.Validate view/service 4.Modify as required Benefits Faster time to solution Easy to learn and use Extensible / reusable objects Discovery © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

19 Composite Information Server Data Virtualization Production Production Steps 1.Application invokes request 2.Optimized query (single statement) executes 3.Deliver data in proper form Benefits Up-to-the-minute data High performance Less replication required Optimizer © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

20 Composite Information Server Data Virtualization Production with Caching Production Steps 1.Cache essential data 2.Application invokes request 3.Optimized query (leveraging cached data) executes 4.Deliver data in proper form Benefits Removes network constraints 7-24 availability Optimal performance CacheOptimizer © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

21 Agenda State of Enterprise Information The Case for Data Virtualization How Data Virtualization Works Data Virtualization Adoption Patterns © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

22 Data Federation DW Extension Cloud Data Integration Data Virtualization Adoption Patterns Data Virtualization Layer Big Data Integration © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

23 Data Federation Data Federation for Business Intelligence “My application requires data from multiple incompatible sources.” Project Manager © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

24 “My data warehouse does not contain all the data required for the reports we need to build.” Data Warehouse Extension Data Warehouse Extension for 360 o View Data Warehouse Owner © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

25 Data Virtualization Layer Data Virtualization Layer for Business & IT Agility “How do I build an agile data layer for easy data access and delivery.” IT Director © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

26 Cloud Data Integration Cloud Data Integration for IT Extensibility “I need to integrate data between on- premise systems and applications running in the cloud.” CIO © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

27 “More and more of my data now lives in MPP and Hadoop sources. How do I combine big data with traditional data for analysis? Big Data Integration Big Data for Analytics Business Analyst © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

28 Data Federation DW Extension Cloud Data Integration Data Virtualization Adoption Patterns Data Virtualization Layer Big Data Integration Semantic Abstraction Federated Query Loose Coupling Caching Location Independence = Data Virtualization © 2011 Composite Software, Inc. / Composite Proprietary and Confidential

29 Composite Software Contact For more information please contact: Pamela Sotnick Director, Federal Accounts Mobile Katy Mann Director, Federal Accounts Mobile David Besemer CTO

Questions