StreamInsight in SQL Server 2012 Torsten Grabs Lead Program Manager

What’s new in streaminsight for SQL 2012 Microsoft SQL Server 2012 includes the latest version of StreamInsight StreamInsight is Microsoft’s platform for continuous event-driven processing Resiliency to outages Checkpoint recovery Development experience User-defined extensions for prediction and pattern matching LINQ improvements Embracing .NET 4.0 as the default Manageability Performance counters Administrative events in Windows Event Log Improved latency

Resiliency to outages

Resiliency Goal: make StreamInsight applications highly available Planned downtime Unplanned outages Timeliness: recover from outages quickly Goal is simple: as fast as possible StreamInsight doesn’t store event data, but it does store query state Query states can get large Query state can build up over along time and be hard to recreate StreamInsight offers different levels of protection that you can choose from depending on your needs

Resiliency: Levels of protection Choose which level of resiliency you need: Exact equivalence The same stream of events, regardless of outage Equivalent events No missed events, and no wrong events, but duplicates are allowed State retention Don’t lose expensive-to-create state No further guarantees

Checkpointing saves a query’s state to disk What is Checkpointing? Checkpointing saves a query’s state to disk You control when the checkpoint is initiated SI takes care of saving out consistent state After an outage, StreamInsight can restore this state This limits state loss during an outage, speeding recovery Level of correctness depends on additional work we are able to perform Recovery process is coordinated by SI With checkpointing, interruptions in the output can still occur during the downtime period

Developer experience

More Complex Event Processing Predictive models for e.g. trends or extrapolation Time now Pattern matching

More Complex Event Processing What people want to do How: New User-Defined Stream Operator Predictive models Denial-of-service attacks Bottleneck prediction Equipment outages Online user behavior Power grid stability Pattern matching Fraud detection Cheat detection User-defined operator that can be injected in any stream Stateful computations: you can now retain state between operator invocations Arbitrary temporal ranges of interest: you can manage your own windows

Improved Developer experience Support for nested type structures C# classes that nest other C# classes can now be StreamInsight event types StreamInsight transparently does the mapping to its internal flat event representation Primitive payloads: now supported Constant payloads: now supported Many limitations in LINQ addressed Multiple JOIN and FROM clauses per statement now supported Richer support for projection expressions Support for macros Expressions with multiple aggregates supported LET clause supported

Streaminsight demo

summary Resiliency to outages Development experience Manageability Checkpoint recovery Development experience User-defined extensions for prediction and pattern matching LINQ improvements Embracing .NET 4.0 as the default Manageability Performance counters Administrative events in Windows Event Log Improved latency Get ready for the Internet of Things: try out StreamInsight 2.0 in Microsoft SQL Server 2012

Further. Forward. Faster. Learn more Visit the Microsoft Virtual Academy Free technical SQL Server training courses Get more Download SQL Server 2012 Trial Software 180-day evaluation of SQL Server 2012 Do more Participate in virtual launch activities and collect points for prizes The more points you earn, the bigger your prize could be