Has the ETL run yet?
Microsoft StreamInsight 27 CEP Engine Output Adapters Input Adapters Event Standing Queries Event sources Event targets Devices, Sensors Web servers Event stores & Databases Stock tickers & News feeds Event C_IDC_NAMEC_ZIP Event stores & Databases Pagers & Monitoring devices KPI Dashboards, SharePoint UI Trading stations Event CEP Application at Runtime Static reference data IDE.NET C# LINQ CEP Application Development
Events t1 t4 t3 t2 t5 Time Payload/ value a b c d e
Event Types Events in Microsoft’s CEP platform use the.NET type system Events are structured and can have multiple fields Fields are typed using the.NET framework types CEP engine provisioned timestamp fields capture all the different temporal event characteristics Event sources populate time stamp fields Timestamps/Met adata Long pumpID String Type String Location Double flow Double pressure ………………
Event Streams & Adapters 31
LINQ Query Examples LINQ Example – GROUP&APPLY, WINDOW: from e3 in MyStream3 group e3 by e3.i into SubStream from win in SubStream.HoppingWindow( FiveMinutes,ThreeSeconds) select new { i = SubStream.Key, a = win.Avg(e => e.f) }; LINQ Example – GROUP&APPLY, WINDOW: from e3 in MyStream3 group e3 by e3.i into SubStream from win in SubStream.HoppingWindow( FiveMinutes,ThreeSeconds) select new { i = SubStream.Key, a = win.Avg(e => e.f) }; LINQ Example – JOIN, PROJECT, FILTER: from e1 in MyStream1 join e2 in MyStream2 on e1.ID equals e2.ID where e1.f2 == “foo” select new { e1.f1, e2.f4 }; LINQ Example – JOIN, PROJECT, FILTER: from e1 in MyStream1 join e2 in MyStream2 on e1.ID equals e2.ID where e1.f2 == “foo” select new { e1.f1, e2.f4 }; Join Filter Project Grouping Window Project & Aggregate
Tumbling Window
Hopping Window
StreamInsight Hosting Models CEP in-process server (explicit model) Application CEP explicit logic CEP Server Application In-process server mode Hosted server mode
UI application StreamInsight Server Query UI application Output Adapter Input Adapter
UI application StreamInsight Server Query Output Adapter Input Adapter
UI application StreamInsight Server Query Output Adapter Input Adapter Event tracking
PowerPivot UI StreamInsight Server Query Output Adapter Input Adapter Event tracking PowerPivot UI
Sign up for Tech·Ed 2011 and save $500 starting June 8 – June 31 st You can also register at the North America 2011 kiosk located at registration Join us in Atlanta next year