1. Handwritten Mathematical Symbol Recognition for Computer Algebra Applications Xiaofang Xie, Stephen M. Watt Dept. of Computer Science, University of Western Ontario ECCAD 2005 Motivation Provide computer algebra applications a nice pen-based interface Attract more users to Maple, Mathematica. Handwriting recognition is the key to PDA Make mathematics easier input and edited

2. Math Editor Limitations: cannot cover all math symbols Slow comparing with hand writing

3. Literature Overview Pattern Matching: feature matching, element matching, elastic matching Neural Network Hidden Markov Model On-line vs. Off-line recognition

4. Literature Overview(cont.)

5. Recognizer Architecture Data Collection Preprocessing Feature Extraction Hidden M. Model Grouping Vector Quantization Elastic Matching Combined Classifier Context Info

6. Preprocessing Resampling Deslanting Smoothing Size Normalization Selectively Chop Head / Tail

7. Feature Extraction Number of Strokes; Pendown; Pen Pressure Position of end points; Distance to initial. Writing Angle; SgnX; End points directions Point Density; Aspect Ratio Number of Cusps Number of Intersections Number of Loops Velocity; Acceleration

8. Feature Extraction (Cont.)

10. Design Hidden Markov Model Decompose symbols into basic elements

11. Design Hidden Markov Model(Cont.) Multiple Path Hidden Markov Model

12. Allomorph Analysis Variance makes recognition hard Contribute to design Hmm

13. Combine Classifiers Classifiers complement each other Analyze the recognition results Detect Correlated Errors Develop Combination Scheme

14. Context Information Solve Ambiguity Build Dictionary

15. Partial Results ExperimentNo.of PrototypesRecog. Rate(%) P1:T1,2,3,422781.8 P1,2:T1,2,3,445490.1 P1,2,3:T1,2,3,468193.9 P1,2,3,4:T1,2,3,490894.8 Recog. Results on 227 mathematical symbols. P represents prototype, T represents test data.

16. Partial Results(Cont.) ExperimentNo.of Prototypes Candidate Prototypes Percentage Pruned(%) Recog. Rate(%) P1:T1-42272688.576.0 P1,2:T1-43663889.685.5 P1-3:T1-44955289.590.0 P1-4:T1-45756089.691.9 Using features to prune prototypes.