An Analysis of Hamptonese Using Hidden Markov Models Ethan Le and Mark Stamp Department of Computer Science San Jose State University McNair Scholars Program.

Slides:

Advertisements

Similar presentations

Lecture 16 Hidden Markov Models. HMM Until now we only considered IID data. Some data are of sequential nature, i.e. have correlations have time. Example:

Advertisements

Hidden Markov Model in Automatic Speech Recognition Z. Fodroczi Pazmany Peter Catholic. Univ.

Automatic Speech Recognition II  Hidden Markov Models  Neural Network.

Machine Learning Hidden Markov Model Darshana Pathak University of North Carolina at Chapel Hill Research Seminar – November 14, 2012.

TESTING LISTENING By: Nane Magdalena

Introduction to Hidden Markov Models

Language Model based Information Retrieval: University of Saarland 1 A Hidden Markov Model Information Retrieval System Mahboob Alam Khalid.

O PTICAL C HARACTER R ECOGNITION USING H IDDEN M ARKOV M ODELS Jan Rupnik.

Ch 9. Markov Models 고려대학교 자연어처리연구실 한 경 수

Hidden Markov Models Theory By Johan Walters (SR 2003)

Foundations of Statistical NLP Chapter 9. Markov Models 한 기 덕한 기 덕.

1 Hidden Markov Models (HMMs) Probabilistic Automata Ubiquitous in Speech/Speaker Recognition/Verification Suitable for modelling phenomena which are dynamic.

Hidden Markov Model based 2D Shape Classification Ninad Thakoor 1 and Jean Gao 2 1 Electrical Engineering, University of Texas at Arlington, TX-76013,

Lecture 15 Hidden Markov Models Dr. Jianjun Hu mleg.cse.sc.edu/edu/csce833 CSCE833 Machine Learning University of South Carolina Department of Computer.

Spring 2003Data Mining by H. Liu, ASU1 7. Sequence Mining Sequences and Strings Recognition with Strings MM & HMM Sequence Association Rules.

Hidden Markov Models First Story! Majid Hajiloo, Aria Khademi.

SPEECH RECOGNITION Kunal Shalia and Dima Smirnov.

Albert Gatt Corpora and Statistical Methods Lecture 8.

INTRODUCTION TO Machine Learning 3rd Edition

ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.

Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.

Hamptonese1 Hamptonese and Hidden Markov Models or When is a Cipher not a Cipher? Ethan Le and Mark Stamp Department of Computer Science San Jose State.

Metamorphic Malware Research

Hidden Markov Models Usman Roshan BNFO 601. Hidden Markov Models Alphabet of symbols: Set of states that emit symbols from the alphabet: Set of probabilities.

1 Hidden Markov Model Instructor : Saeed Shiry  CHAPTER 13 ETHEM ALPAYDIN © The MIT Press, 2004.

Hidden Markov Model: Extension of Markov Chains

Hidden Markov Models Usman Roshan BNFO 601. Hidden Markov Models Alphabet of symbols: Set of states that emit symbols from the alphabet: Set of probabilities.

INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.

Software Uniqueness: How and Why? Puneet Mishra Dr. Mark Stamp Department of Computer Science San José State University, San José, California.

Pairwise Alignment of Metamorphic Computer Viruses Student:Scott McGhee Advisor:Dr. Mark Stamp Committee:Dr. David Taylor Dr. Teng Moh.

Multimedia Data Mining Arvind Balasubramanian Multimedia Lab (ECSS 4.416) The University of Texas at Dallas.

Multimedia Data Mining Arvind Balasubramanian Multimedia Lab The University of Texas at Dallas.

Handwritten Character Recognition using Hidden Markov Models Quantifying the marginal benefit of exploiting correlations between adjacent characters and.

Introduction to Profile Hidden Markov Models

ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.

A Revealing Introduction to Hidden Markov Models

Graphical models for part of speech tagging

BINF6201/8201 Hidden Markov Models for Sequence Analysis

Comparative study of various Machine Learning methods For Telugu Part of Speech tagging -By Avinesh.PVS, Sudheer, Karthik IIIT - Hyderabad.

7/03Data Mining – Sequences H. Liu (ASU) & G Dong (WSU) 1 7. Sequence Mining Sequences and Strings Recognition with Strings MM & HMM Sequence Association.

Some Probability Theory and Computational models A short overview.

Machine Learning Lecture 1. Course Information Text book “Introduction to Machine Learning” by Ethem Alpaydin, MIT Press. Reference book “Data Mining.

Hidden Markov Models Usman Roshan CS 675 Machine Learning.

Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Using Inactivity to Detect Unusual behavior Presenter : Siang Wang Advisor : Dr. Yen - Ting Chen Date : Motion and video Computing, WMVC.

Processing Sequential Sensor Data The “John Krumm perspective” Thomas Plötz November 29 th, 2011.

Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Mining Logs Files for Data-Driven System Management Advisor.

1 CSE 552/652 Hidden Markov Models for Speech Recognition Spring, 2005 Oregon Health & Science University OGI School of Science & Engineering John-Paul.

1 CONTEXT DEPENDENT CLASSIFICATION  Remember: Bayes rule  Here: The class to which a feature vector belongs depends on:  Its own value  The values.

CHAPTER 8 DISCRIMINATIVE CLASSIFIERS HIDDEN MARKOV MODELS.

Dongfang Xu School of Information

Automated Interpretation of EEGs: Integrating Temporal and Spectral Modeling Christian Ward, Dr. Iyad Obeid and Dr. Joseph Picone Neural Engineering Data.

Discovering Evolutionary Theme Patterns from Text - An Exploration of Temporal Text Mining Qiaozhu Mei and ChengXiang Zhai Department of Computer Science.

Training Phase Modeling Jazz Artist Similarities Mathematically Andres Calderon Jaramillo - Mentor: Dr. Larry Lucas Department of Mathematics and Statistics,

Hidden Markov Models (HMMs) –probabilistic models for learning patterns in sequences (e.g. DNA, speech, weather, cards...) (2 nd order model)

1 Hidden Markov Model: Overview and Applications in MIR MUMT 611, March 2005 Paul Kolesnik MUMT 611, March 2005 Paul Kolesnik.

Classification of melody by composer using hidden Markov models Greg Eustace MUMT 614: Music Information Acquisition, Preservation, and Retrieval.

CPSC 7373: Artificial Intelligence Lecture 12: Hidden Markov Models and Filters Jiang Bian, Fall 2012 University of Arkansas at Little Rock.

Discovering Evolutionary Theme Patterns from Text -An exploration of Temporal Text Mining KDD’05, August 21–24, 2005, Chicago, Illinois, USA. Qiaozhu Mei.

Pattern Recognition NTUEE 高奕豪 2005/4/14. Outline Introduction Definition, Examples, Related Fields, System, and Design Approaches Bayesian, Hidden Markov.

Hidden Markov Models CISC 5800 Professor Daniel Leeds.

By: Nicole Cappella. Why I chose Speech Recognition  Always interested me  Dr. Phil Show Manti Teo Girlfriend Hoax  Three separate voice analysts proved.

Tasneem Ghnaimat. Language Model An abstract representation of a (natural) language. An approximation to real language Assume we have a set of sentences,

HMM Applications Mark Stamp HMM Applications.

Purpose of Study & Introduction to Sarf (Morphology)

HCI/ComS 575X: Computational Perception

CONTEXT DEPENDENT CLASSIFICATION

The APA Citation Style:

A Gentle Tutorial of the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models Jeff A. Bilmes International.

A Gentle Tutorial of the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models Jeff A. Bilmes International.

Presentation transcript:

An Analysis of Hamptonese Using Hidden Markov Models Ethan Le and Mark Stamp Department of Computer Science San Jose State University McNair Scholars Program Summer Research Project, 2003

Agenda James Hampton Purpose What is Hamptonese? Hidden Markov Models (HMMs) HMMs and Hamptonese Other approach Results Questions

James Hampton WWII veteran Janitor in Washington D.C. Life of solitude Died in 1964 Hamptonese discovered after his death “The Throne” also found

“The Throne of the Third Heaven of the Nations’ Millennium General Assembly” James Hampton alongside his Throne Pieces of The Throne

Purpose Analyzed Hamptonese using Hidden Markov Model to determine whether Hamptonese was created using simple substitution of English letters (or other languages). Consider alternative interpretations of Hamptonese

What is Hamptonese?

What is Hamptonese? (Cont’d) Unknown origin and content Spans 167 pages Could it be:  A cipher system?  Gibberish?  Example of human randomness?  Other?

Hidden Markov Models (HMMs) Markov process with hidden states HMMs provide probabilistic information about the underlying state of a model, given a set of observations of the system.

HMMs (Cont’d) Three solvable problems 1. Find probability of observed sequence 2. Find “optimal” state sequence 3. Train the model to fit observations

HMMs examples Example 1: Music Information Retrieval System (MIR) Example 2: Deciphering English text (Cave and Neuwirth)  27 symbols (alphabet letters plus space)  Assume 2 hidden states  Train HMM to best fit input data  Results: separation of consonants and vowels

HMM Example (Cont’d) – English Text CharacterInitialFinal A B C D E F G H I J K

HMMs and Hamptonese Transcribed 103 pages About 30,000 observations More than 40 distinct symbols Assume 2 hidden states 3 different reading techniques

Other Approach Hamptonese vs. 246 different languages  HMM for other languages Religious references & organizational patterns  Analysis of first 40 pages  Pattern recognition

Results Hamptonese is not a simple substitution for English letters Hamptonese is probably not a simple substitution for any other language First comprehensive study of Hamptonese  Transcription of entire text  Future research suggestions

Acknowledgments… Dr. Mark Stamp SJSU McNair Scholars Program SCCUR UC Irvine

Questions???

References Chai, Wei and Vercoe, Barry. (n.d.). Folk Music Classification Using Hidden Markov Models. MIT Media Lab. M. Stamp, A revealing introduction to Hidden Markov Models M. Stamp and E. Le, Hamptonese website. html html R.L. Cave and L.P. Neuwirth, Hidden Markov Models for English, in Hidden Markov Models for Speech, IDA-CRD, Princeton, NJ, 1980