1. Data Platform Vision Vu Tuyet Trinh trinhvt-fit@mail.hut.edu.vn Hanoi University of Technology

2. MicrosoftMS. SQL Server 2008 Outline Overview of Microsoft Data Platform Vision Analysis Services Reporting Services Integration Service

3. MicrosoftMS. SQL Server 2008 DATA PLATFORM VISION Types of Data Services to interact XML e-mail time/calendar file, document geospatial search query data analysis reporting data integration robust synchronization

4. MicrosoftMS. SQL Server 2008 Microsoft Data Platform Vision

5. MicrosoftMS. SQL Server 2008 Improved Productivity ADO.NET Entity Framework: Provides a data programming interface that makes it: Easy to understand the conceptual data model Easy to design and develop applications Easy to maintain applications

6. MicrosoftMS. SQL Server 2008 Improved Productivity LINQ LINQ to SQL. LINQ to Entities. LINQ to DataSet. LINQ to XML. LINQ to Object. Visual Studio Providing features such as source code control, tracking, and deployment tools.

7. MicrosoftMS. SQL Server 2008 Improved Productivity Microsoft Office 2007 See Part 2-Analysis Services.

8. MicrosoftMS. SQL Server 2008 SERVICES

9. MicrosoftMS. SQL Server 2008 SERVICES services Analysis Services Reporting Services Intergration Services Data Platform

10. MicrosoftMS. SQL Server 2008 1. Analysis Services Microsoft SQL Server 2008 Analysis Services builds on a strong foundation of analytical tools to provide a truly enterprise scale solution. Analysis Services provides optimized Office interoperability to provide a familiar interface and an open, embeddable architecture to allow developers to integrate the data.

11. MicrosoftMS. SQL Server 2008 Analysis Services Build Enterprise- Scale Solutions Analysis Services Extend Reach with Comprehensive Analytics Drive Actionable Insight through Familiar Tools

12. MicrosoftMS. SQL Server 2008 Build Enterprise-Scale Solutions Microsoft SQL Server 2008 Analysis Services is designed to provide exceptional performance and scales to support applications with millions of records and thousands of users. Innovative, consolidated tools help improve developer productivity and result in better design and faster implementation.

13. MicrosoftMS. SQL Server 2008 Build Enterprise-Scale Solutions High Developer Productivity Scalable Infrastructure Superior Performance

14. MicrosoftMS. SQL Server 2008 High Developer Productivity SQL Server 2008 Analysis Services introduces a set of new, innovative Best Practice Design Alerts that provide automatic notification of potential design issues early in the development process, which reduces wasted time caused by design mistakes and facilitates a faster development process.

15. MicrosoftMS. SQL Server 2008 High Developer Productivity Figure 1 shows an alert on the Time dimension and Calendar hierarchy. Figure 1

16. MicrosoftMS. SQL Server 2008 High Developer Productivity Figure 2 shows the current alerts on a design. Figure 2

17. MicrosoftMS. SQL Server 2008 High Developer Productivity SQL Server 2008 Analysis Services further increases developer productivity with new, enhanced cube, dimension, and attribute designers. Figure 3

18. MicrosoftMS. SQL Server 2008 Scalable Infrastructure Analysis Services can scale to support databases of many terabytes in size with many thousands of users. SQL Server 2008 Analysis Services provides Dynamic Management Views similar to those available to the database engine.

19. MicrosoftMS. SQL Server 2008 Superior Performance Analysis Services cubes are multidimensional structures and stores bussiness data in a highly optimized and compressed format called Multidimensional OLAP (MOLAP). AS can improve query performance by orders of magnitude and therefore allow a finer granularity of analysis.

20. MicrosoftMS. SQL Server 2008 Superior Performance SQL Server provides attribute-based hierarchies that avoid the need for any duplication and improve performance and scalability. SQL Server 2008 Analysis Services allows writeback data to be stored in MOLAP format resulting in significantly better performance for query and writeback operations. AS prevent users from overloading the relational database by providing a high performance, transparent, synchronized aggregate cache.

21. MicrosoftMS. SQL Server 2008 Extend Solutions with Comprehensive Analytics Analysis Services takes the analytical platform to a new level offering more advanced features than those traditionally related to OLAP. This enables organizations to accommodate multiple analytical needs within one solution offering so much more than a traditional OLAP platform. In this effort, the Unified Dimensional Model (UDM) plays a central role, providing extensive analytical capabilities.

22. MicrosoftMS. SQL Server 2008 Extend Reach with Comprehensive Analytics Unified Dimensional Model Predictive Analysis Central Manageability of Key Enterprise Metrics

23. MicrosoftMS. SQL Server 2008 Unified Dimensional Model The UDM was a new concept for Analysis Services that was introduced with the release of SQL Server 2005. The UDM provides an intermediate logical layer between the physical relational database used as the data source and the proprietary cube and dimension structures that are used to resolve user queries. In this way, you can think of the UDM as the centerpiece of the OLAP solution.

24. MicrosoftMS. SQL Server 2008 Central Manageability of Key Enterprise Metrics In SQL Server 2008 Analysis Services enterprise wide Key Performance Indicators (KPI’s) can be centrally stored and managed. This provides a central repository for users to access key enterprise metrics through a variety of applications including Microsoft Office PerformancePoint Server 2007, Microsoft Office Excel 2007, Microsoft Office SharePoint Services 2007, and Microsoft SQL Server Reporting Services.

25. MicrosoftMS. SQL Server 2008 Predictive Analysis Traditional data analysis looks at historical data and quickly returns results based on this data. However, many questions asked by business users cannot be answered by this sort of analysis as they are not looking for the results of what has happened, but instead they are looking for predictions of what might happen.

26. MicrosoftMS. SQL Server 2008 Predictive Analysis Microsoft SQL Server Data Mining Add-Ins for Office 2007: The Data Mining Add-Ins for Office 2007 empowers end users to perform advanced analysis directly in Microsoft Excel and Microsoft Visio. There are three individual components:  Data Mining Client for Excel enables you to create and manage an entire Analysis Services data mining project from within Excel 2007.  Table Analysis Tools for Excel enables you to use the powerful Analysis Services data mining capabilities to analyze data stored in Excel spreadsheets.  Data Mining Templates for Visio enables you to render decision trees, regression trees, cluster diagrams, and dependency nets in Visio diagrams.

27. MicrosoftMS. SQL Server 2008 Drive Actionable Insight through Familiar Tools Optimized Office Interoperability Rich Partner Extensibility Open Embeddable Architecture MSOffice Excel MS Office Word MS Office Visio MS Office Share Point MS Office Performance Point

28. MicrosoftMS. SQL Server 2008 2. Reporting Service Microsoft SQL Server 2008 Reporting Services provides a complete server- based platform that is designed to support a wide variety of reporting needs including managed enterprise reporting, ad-hoc reporting, embedded reporting, and web based reporting to enable organizations to deliver relevant information where needed across the entire enterprise. Reporting Services 2008 provides the tools and features necessary to author a variety of richly formatted reports from a wide range of data sources and provides a comprehensive set of familiar tools used to manage and secure an enterprise reporting solution.

29. MicrosoftMS. SQL Server 2008 Reporting Services Authoring Report Managing Reporting Services Delivering Reports

30. MicrosoftMS. SQL Server 2008 Authoring Report Accessing Data Sources for Report Creation Using Report Development Tools Creating Compelling Reports Tablix Charts Interactive Features

31. MicrosoftMS. SQL Server 2008 Managing Reporting Services Managing Reporting Services Managing Reporting Services Extending Management Capabilities Configuring a Reporting Services Instance MS Office SharePoint Services Integration Securing Reporting Services

32. MicrosoftMS. SQL Server 2008 Delivering Reports High Performance Report Processing Caching Snapshots Multiple File Formats Delivering Reports through Subscriptions Embedding Reports into Business Applications

33. MicrosoftMS. SQL Server 2008 3. Intergration Services SQL Server 2008 Integration Services (SSIS) helps Information Technology departments to meet data integration requirements in their enterprises. SQL Server 2008 Integration Services meets the challenges of cleansing, transforming, and mapping multiple data sources with large volumes into a useful format. New features improve its ability to scale up and improve performance while speeding development and lowering the TCO.

34. MicrosoftMS. SQL Server 2008 3. Intergration Services Intergration Services Technology Challenges Organizationa l Challenges Economic Challenges SSIS Architecture Integration Scenarios

35. MicrosoftMS. SQL Server 2008 Technology Challenges As illustrated in Figure, with increased staging the time taken to “close the loop,” (i.e., to analyze, and take action on new data) increases as well. These traditional ELT architectures (as opposed to value-added ETL processes that occur prior to loading) impose severe restrictions on the ability of systems to respond to emerging business needs.

36. MicrosoftMS. SQL Server 2008 SSIS Architecture Task flow and data flow engine Pipeline architecture ADO.NET connectivity Thread pooling Persistent lookups

37. MicrosoftMS. SQL Server 2008 Integration Scenarios SSIS for data transfer operations SSIS for data warehouse loading SSIS and Data Quality Application of SSIS Beyond Traditional ETL SSIS, the Integration Platform

38. MicrosoftMS. SQL Server 2008 SSIS for data transfer operations SQL Server 2008 Integration Services has an improved wizard that uses ADO.NET, has an improved user interface, performs automatic data type conversions, and is more scalable than previous versions.

39. MicrosoftMS. SQL Server 2008 SSIS for data warehouse loading SQL Server 2008 includes support for Change Data Capture (CDC). SSIS can consume data from (and load data into) a variety of sources including managed (ADO.NET), OLE DB, ODBC, flat file, Microsoft Office Excel®, and XML by using a specialized set of components called adapters.

40. MicrosoftMS. SQL Server 2008 Figure 3 shows an example of such a flow.

41. MicrosoftMS. SQL Server 2008 Figure 4 shows a page from the SCD Wizard.

42. MicrosoftMS. SQL Server 2008 Figure 5 shows the data flow that is generated by this Wizard

43. MicrosoftMS. SQL Server 2008 SSIS and Data Quality One of the key features of SSIS, as well as its ability to integrate data, is its ability to integrate different technologies to manipulate the data. This has allowed SSIS to include innovative “fuzzy logic”–based data cleansing components. SSIS deeply integrates with the data mining functionality in Analysis Services. Data mining abstracts out the patterns in a dataset and encapsulates them in a mining model. Support for complex data routing in SSIS helps you to not only identify anomalous data, but also to automatically correct it and replace it with better values. This enables “closed loop” cleansing scenarios

44. MicrosoftMS. SQL Server 2008 Figure 6 shows an example of a closed loop cleansing data flow.

45. MicrosoftMS. SQL Server 2008 Application of SSIS Beyond Traditional ETL Service Oriented Architecture Data and text mining On-demand data source

46. MicrosoftMS. SQL Server 2008 On-demand data source Figure 7 shows a SSIS package that sources data from RSS feeds over the Internet, integrates with data from a Web service

47. MicrosoftMS. SQL Server 2008 Figure 8 shows the use of the SSIS package as a data source in the Report Wizard.

48. MicrosoftMS. SQL Server 2008 SSIS, the Integration Platform SSIS goes beyond being an ETL tool not only in terms of enabling nontraditional scenarios, but also in being a true platform for data integration. SSIS is part of the SQL Server Business Intelligence (BI) platform that enables the development of end-to-end BI applications.

49. MicrosoftMS. SQL Server 2008 SSIS, the Integration Platform Integrated development platform Programmability Scripting

50. MicrosoftMS. SQL Server 2008 Integrated development platform SQL Server Integration Services, Analysis Services, and Reporting Services all use a common Microsoft Visual Studio® based development environment called the SQL Server Business Intelligence (BI) Development Studio. BI Development Studio provides an integrated development environment (IDE) for BI application development.

51. MicrosoftMS. SQL Server 2008 Integrated development platform Figure 9 shows a BI Development Studio solution that consists of Integration, Analysis, and Reporting projects.

52. MicrosoftMS. SQL Server 2008 Integrated development platform Figure 10 shows an example of geographic data visualized using a scatter plot and a text grid.

53. MicrosoftMS. SQL Server 2008 Figure 11 shows an example of a script that checks for the existence of an Office Excel file.

54. MicrosoftMS. SQL Server 2008 Making Data Integration Approachable Figure 12, SSIS eliminates (or at least minimizes) unnecessary staging