1 Windows Vista Tablet PC: PRS315 Program Managers Microsoft Corporation

2 Tablet PC In The Windows Vista Era Exciting new Tablet PC features Handwriting recognition Shell and usability enhancements Major investments in the Mobile PC space Developing Power Aware Applications Synchronization Manager Auxiliary display technology Support for touch-screen devices

3 What’s new for developers? Two new API sets! Ink in WPF – Second generation Ink collection and rendering platform Ink Analysis – Second generation handwriting recognition platform Not actually Windows Vista features Both APIs will be available down-level (XP SP2 and later) Tablet PC In The Windows Vista Era

4 Tablet PC Today Lots of great hardware! HP TC4200 Toshiba R15/M4 Fujitsu T4000 ThinkPad X41T Gateway Acer Motion Motion

5 Digital Ink In Windows Presentation Foundation Tablet PC platform features are first-class citizens in Windows Presentation Foundation (WPF) Digital ink collection, rendering, and editing Stylus input events on all elements Stroke object model Partial trust support StickyNote annotations …much more!

6 Digital Ink In WPF Tablet PC platform features are first-class citizens in WPF. This means… No separate SDK to build against No separate runtime to redist Add ink to your desktop apps – why not? Anyone with a mouse can play along…

7 Strange Bedfellows? Many points of synergy between Tablet apps and WPF DPI-independence and vector graphics, supporting a wide range of display devices and aspect ratios Flowed layout features help maximize screen real estate in portrait/landscape/widescreen 3D or no 3D? “Tier” the user experience to match hardware capabilities Tablet PC users demand out-of-the-ordinary user interface design

8 The Element Centerpiece of Tablet PC support in WPF Collects ink over any child element(s) Provides a superset of functionality provided by the InkCollector, InkOverlay, and InkPicture components in the traditional Tablet SDK Inherits the layout characteristics of element

9 Hello, InkCanvas!

10 InkCanvas Editing Modes All the modes you know and love… Ink, EraseByStroke, EraseByPoint, Select Plus, selection mode extended to support direct manipulation of any child element on the InkCanvas! Allows development of a mixed text/ink note taking experience similar to Journal or OneNote EditingModeInverted Built-in support for “top-of-pen-erase” feature

11 InkCanvas Editing Modes

12 Build Your Own Stylus Input Decorator Decorator Provides static rendering of ink strokes DynamicRenderer Provides dynamic (real-time) ink rendering UIElement.StylusXxxx events Provide hooks to collect ink strokes into your object model StylusInRange StylusOutOfRange StylusEnter StylusInAirMove StylusLeave StylusDown StylusMove StylusUp StylusButtonDown StylusButtonUp

13 Deeper Integration MIL stands for “Media Integration Layer” Collect ink over live video!

14 InkCanvas Over MediaElement

15 Deeper Integration MIL stands for “Media Integration Layer” Collect ink over live video! UIElement.InputScope Apply bias for handwriting recognition on any input element – TIP picks it up!

16 TextBox.InputScope

17 What Is InkAnalysis? Windows Vista generation handwriting recognition API Combines Recognition Context and InkDivider APIs Architecture supports WPF, Windows Forms and COM COM Application IACOM.dll Microsoft.Ink.A nalysis.dll IAWinFX.dll reco.dll IALoader.dll IACore.dll Windows Form Application WPF Application

18 InkAnalysis Functionality Recognition for 10 languages Writing/Drawing Classification Writing Region, Line and Word/Character segmentation Handwritten Outlines Basic Shapes Ink-on-Ink Annotations Ink-on-Text Annotations

19 InkAnalysis Functionality Easier to use Multiple AnalysisHints (guides, wordlists, input scopes, etc) in a single inking area Multi-language recognition in one call Persists all results, including corrections or partial results More in a minute…

20 How To Call InkAnalysis Similar usage to RecognitionContext API Supports both synchronous analysis and asynchronous analysis operations System.Windows.Ink.InkAnalyzer myIA = new InkAnalyzer(this.Dispatcher); myIA.AddStrokes(myInkCanvas.Strokes);myIA.Analyze(); string myResults = myIA.GetRecognizedString(); System.Windows.Ink.InkAnalyzer myIA = new InkAnalyzer(this.Dispatcher); myIA.AddStrokes(myInkCanvas.Strokes);myIA.BackgroundAnalyze();... void myInkAnalyzer_Results(object sender, ResultsEventArgs e) { string myResults = myIA.GetRecognizedString(); }

21 Basic InkAnalysis

22 t1t1 t2t2 UI Thread IA updated Add Stroke Prune and Clone BackgroundAnalyze Private InkAnalyzer Background Thread InkAnalyzer IA background operation Return Results Sync updates Results Event Recognition IA updated Add Stroke Layout Analysis IA updated Remove Stroke t3t3 t4t4 t5t5 t6t6 t7t7 Reconcile Application IA updated Remove Stroke How InkAnalysis Works Prune only what is needed Clone to background thread Reconcile changes

23 InkAnalysis Functionality Rich events Integrate results into existing document models Integrate previous results back into the InkAnalyzer Dynamically prune in ink and document content Integrate representations of non-ink objects into the InkAnalyzer Support for Ink-on-Text Annotations 2D spatial representation of non-ink content

24 Handwritten Ink Lists

25 How You Can Get Started Visit the Mobile PC Developer Center Download the Mobile PC and Tablet PC September 2005 Beta SDK Visit the Windows Vista Developer Center

26 Other Cool Talks Mobile PC related Developing Power Aware Applications (FUN319) Synchronization Manager (DAT317) Auxiliary display technology (PRS308) Support for touch-screen devices WinFX related Content and Reading (PRS330) Performance and Tiering (PRS327)

27 © 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

28 © 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

29 ISV Ecosystem 15% of professional developers have active projects that include Tablet PCs 300,000 developers working with Tablet PC APIs 700+ registered ISV partners (300% increase since last year) applications enabled for Tablet PC available today partners/software.mspx Tablet Partner Showcase getting 10,000 hits/day!!!

30 ISV Momentum Consumer space Drawing, photo editing, note-taking Artrage, Alias, Corel Painter, Concept7 Education Leaders are adopting Tegrity, Agilix, DyKnow, OneNote Corporate and line of business applications Tablet PC applications in >40% of Fortune ,000 corporate developers using Tablet PC SDK Forms processing and note taking are key! Mi-Co, Design Universe, ActiveInk Tablet PCs validated in enterprise solutions SAP CRM 4.0 is ink-enabled Siebel 7.7 supports running on Tablet PC

31 © 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.