1. Hanoi University of Technology
3. Data Types
2008
Data Platform Vision
Vu Tuyet Trinh
Hanoi University of Technology
© 2008 Microsoft

2. Outline Overview of Microsoft Data Platform Vision Analysis Services
Reporting Services
Integration Service

3. Types of Data Services to interact XML e-mail time/calendar
file, document
DATA PLATFORM VISION
geospatial
search
query
data analysis
Services to interact
reporting
data integration
robust synchronization

4. Microsoft Data Platform Vision

5. Improved Productivity
ADO.NET Entity Framework:
Provides a data programming interface that makes it:
Easy to understand the conceptual data model
Easy to design and develop applications
Easy to maintain applications

6. Improved Productivity
LINQ
LINQ to SQL .
LINQ to Entities .
LINQ to DataSet .
LINQ to XML .
LINQ to Object .
Visual Studio
Providing features such as source code control, tracking, and deployment tools .

7. Improved Productivity
Microsoft Office 2007
See Part 2-Analysis Services.

8. SERVICES

9. Intergration Services
Analysis Services
Reporting Services
services
Data Platform
Intergration Services

10. 1. Analysis Services
Microsoft SQL Server 2008 Analysis Services builds on a strong foundation of analytical tools to provide a truly enterprise scale solution .
Analysis Services provides optimized Office interoperability to provide a familiar interface and an open, embeddable architecture to allow developers to integrate the data.

11. Analysis Services Analysis Services Build Enterprise-Scale Solutions
Extend Reach with Comprehensive Analytics
Analysis Services
Drive Actionable Insight through Familiar Tools

12. Build Enterprise-Scale Solutions
Microsoft SQL Server 2008 Analysis Services is designed to provide exceptional performance and scales to support applications with millions of records and thousands of users. Innovative, consolidated tools help improve developer productivity and result in better design and faster implementation.

13. Build Enterprise-Scale Solutions
High Developer Productivity
Build Enterprise-Scale Solutions
Scalable Infrastructure
Superior Performance

14. High Developer Productivity
SQL Server 2008 Analysis Services introduces a set of new, innovative Best Practice Design Alerts that provide automatic notification of potential design issues early in the development process, which reduces wasted time caused by design mistakes and facilitates a faster development process.

15. High Developer Productivity
Figure 1 shows an alert on the Time dimension and Calendar hierarchy.
As you can see from Figure 1, the alerts highlight problem areas. However, they do not in any way affect functionality as the alerts can simply be ignored or dismissed individually, or globally
As you can see from Figure 1, the alerts highlight problem areas. However, they do not in any way affect functionality as the alerts can simply be ignored or dismissed individually, or globally.
Figure 1

16. High Developer Productivity
Figure 2 shows the current alerts on a design.
In addition to real time alerts, you can scan your solution design for all alerts
Figure 2

17. High Developer Productivity
SQL Server 2008 Analysis Services further increases developer productivity with new, enhanced cube, dimension, and attribute designers.
SQL Server 2008 Analysis Services further increases developer productivity with new, enhanced cube, dimension, and attribute designers. Figure 3 shows the new Attribute Relationships designer.
Figure 3

18. Scalable Infrastructure
Analysis Services can scale to support databases of many terabytes in size with many thousands of users.
SQL Server 2008 Analysis Services provides Dynamic Management Views similar to those available to the database engine.

19. Superior Performance
Analysis Services cubes are multidimensional structures and stores bussiness data in a highly optimized and compressed format called Multidimensional OLAP (MOLAP).
AS can improve query performance by orders of magnitude and therefore allow a finer granularity of analysis.

20. Superior Performance
SQL Server provides attribute-based hierarchies that avoid the need for any duplication and improve performance and scalability.
SQL Server 2008 Analysis Services allows writeback data to be stored in MOLAP format resulting in significantly better performance for query and writeback operations.
AS prevent users from overloading the relational database by providing a high performance, transparent, synchronized aggregate cache.

21. Extend Solutions with Comprehensive Analytics
Analysis Services takes the analytical platform to a new level offering more advanced features than those traditionally related to OLAP. This enables organizations to accommodate multiple analytical needs within one solution offering so much more than a traditional OLAP platform. In this effort, the Unified Dimensional Model (UDM) plays a central role, providing extensive analytical capabilities.
This enables organizations to accommodate multiple analytical needs within one solution offering so much more than a traditional OLAP platform.

22. Extend Reach with Comprehensive Analytics
Unified Dimensional Model
Extend Reach with Comprehensive Analytics
Central Manageability of Key Enterprise Metrics
Predictive Analysis

23. Unified Dimensional Model
The UDM was a new concept for Analysis Services that was introduced with the release of SQL Server The UDM provides an intermediate logical layer between the physical relational database used as the data source and the proprietary cube and dimension structures that are used to resolve user queries.
In this way, you can think of the UDM as the centerpiece of the OLAP solution.

24. Central Manageability of Key Enterprise Metrics
In SQL Server 2008 Analysis Services enterprise wide Key Performance Indicators (KPI’s) can be centrally stored and managed.
This provides a central repository for users to access key enterprise metrics through a variety of applications including Microsoft Office PerformancePoint Server 2007, Microsoft Office Excel 2007, Microsoft Office SharePoint Services 2007, and Microsoft SQL Server Reporting Services.

25. Predictive Analysis
Traditional data analysis looks at historical data and quickly returns results based on this data.
However, many questions asked by business users cannot be answered by this sort of analysis as they are not looking for the results of what has happened, but instead they are looking for predictions of what might happen.

26. Predictive Analysis
Microsoft SQL Server Data Mining Add-Ins for Office 2007:
The Data Mining Add-Ins for Office 2007 empowers end users to perform advanced analysis directly in Microsoft Excel and Microsoft Visio.
There are three individual components:
Data Mining Client for Excel enables you to create and manage an entire Analysis Services data mining project from within Excel 2007.
Table Analysis Tools for Excel enables you to use the powerful Analysis Services data mining capabilities to analyze data stored in Excel spreadsheets.
Data Mining Templates for Visio enables you to render decision trees, regression trees, cluster diagrams, and dependency nets in Visio diagrams.

27. Drive Actionable Insight through Familiar Tools
MSOffice Excel
Optimized Office Interoperability
MS Office Word
Drive Actionable Insight through Familiar Tools
MS Office Visio
Rich Partner Extensibility
MS Office Share Point
MS Office Performance Point
Open Embeddable Architecture

28. 2. Reporting Service
Microsoft SQL Server 2008 Reporting Services provides a complete server-based platform that is designed to support a wide variety of reporting needs including managed enterprise reporting, ad-hoc reporting, embedded reporting, and web based reporting to enable organizations to deliver relevant information where needed across the entire enterprise.
Reporting Services 2008 provides the tools and features necessary to author a variety of richly formatted reports from a wide range of data sources and provides a comprehensive set of familiar tools used to manage and secure an enterprise reporting solution.

30. Using Report Development Tools
Authoring Report
Using Report Development Tools
Charts
Authoring Report
Accessing Data Sources for Report Creation
Tablix
Interactive Features
Creating Compelling Reports

31. Managing Reporting Services
Extending Management Capabilities
Configuring a Reporting Services Instance
Managing
Reporting Services
MS Office SharePoint Services Integration
Securing Reporting Services

32. Delivering Reports
High Performance Report Processing
Caching
Delivering Reports
Snapshots
Multiple File Formats
Delivering Reports through Subscriptions
Embedding Reports into Business Applications

33. 3. Intergration Services
SQL Server 2008 Integration Services (SSIS) helps Information Technology departments to meet data integration requirements in their enterprises.
SQL Server 2008 Integration Services meets the challenges of cleansing, transforming, and mapping multiple data sources with large volumes into a useful format.
New features improve its ability to scale up and improve performance while speeding development and lowering the TCO.

34. 3. Intergration Services
Technology Challenges
SSIS Architecture
Intergration Services
Organizational Challenges
Integration Scenarios
Economic Challenges

35. Technology Challenges
As illustrated in Figure , with increased staging the time taken to “close the loop,” (i.e., to analyze, and take action on new data) increases as well. These traditional ELT architectures (as opposed to value-added ETL processes that occur prior to loading) impose severe restrictions on the ability of systems to respond to emerging business needs.

36. SSIS Architecture
Task flow and data flow engine
Pipeline architecture
ADO.NET connectivity
Thread pooling
Persistent lookups

37. SSIS for data transfer operations
Integration Scenarios
SSIS for data warehouse loading
SSIS and Data Quality
Application of SSIS Beyond Traditional ETL
SSIS, the Integration Platform

38. SSIS for data transfer operations
SQL Server 2008 Integration Services has an improved wizard that uses ADO.NET, has an improved user interface,
performs automatic
data type conversions,
and is more scalable
than previous versions.

39. SSIS for data warehouse loading
SQL Server 2008 includes support for Change Data Capture (CDC).
SSIS can consume data from (and load data into) a variety of sources including managed (ADO.NET), OLE DB, ODBC, flat file, Microsoft Office Excel®, and XML by using a specialized set of components called adapters.

40. Figure 3 shows an example of such a flow.

41. Figure 4 shows a page from the SCD Wizard.

42. Figure 5 shows the data flow that is generated by this Wizard

43. SSIS and Data Quality
One of the key features of SSIS, as well as its ability to integrate data, is its ability to integrate different technologies to manipulate the data. This has allowed SSIS to include innovative “fuzzy logic”–based data cleansing components.
SSIS deeply integrates with the data mining functionality in Analysis Services. Data mining abstracts out the patterns in a dataset and encapsulates them in a mining model.
Support for complex data routing in SSIS helps you to not only identify anomalous data, but also to automatically correct it and replace it with better values. This enables “closed loop” cleansing scenarios

44. Figure 6 shows an example of a closed loop cleansing data flow.

45. Application of SSIS Beyond Traditional ETL
Service Oriented Architecture
Application of SSIS Beyond Traditional ETL
Data and text mining
On-demand data source

46. On-demand data source
Figure 7 shows a SSIS package that sources data from RSS feeds over the Internet, integrates with data from a Web service

47. Figure 8 shows the use of the SSIS package as a data source in the Report Wizard.

48. SSIS, the Integration Platform
SSIS goes beyond being an ETL tool not only in terms of enabling nontraditional scenarios, but also in being a true platform for data integration. SSIS is part of the SQL Server Business Intelligence (BI) platform that enables the development of end-to-end BI applications.

49. Integrated development platform
SSIS, the Integration Platform
Programmability
Scripting

50. Integrated development platform
SQL Server Integration Services, Analysis Services, and Reporting Services all use a common Microsoft Visual Studio® based development environment called the SQL Server Business Intelligence (BI) Development Studio. BI Development Studio provides an integrated development environment (IDE) for BI application development.

51. Integrated development platform
Figure 9 shows a BI Development Studio solution that consists of Integration, Analysis, and Reporting projects.

52. Integrated development platform
Figure 10 shows an example of geographic data visualized using a scatter plot and a text grid.

53. Figure 11 shows an example of a script that checks for the existence of an Office Excel file.

54. Making Data Integration Approachable
Figure 12, SSIS eliminates (or at least minimizes) unnecessary staging