1. End-to-End Integration with Desktop Cortana…
ETW Event logs
Real-time capture of Cortana response
Seq-2-Seq, NL-NL model
TTS
wav file
Windows 10 Desktop (Anniversary Edition)
MS Cognitive Services
Bing Speech API
NL input:
Cortana’s utterance
NL output:
User Sim’s
utterance
Audio samples from simulated-user generated reminder dialogs:
A seemingly fickle user:
Single shot:
Multi-turn:
(NB the audio of Cortana’s speech fades out early on long utterances, but the full utterance is in the ETW logs.)