1. 7-Speech Quality Assessment Quality Levels Subjective Tests Objective Tests IntelligibilityNaturalness

2. Quality Levels Synthetic Quality (Under 4.8 kbps) Communication Quality (4.8 to 13 kbps) Toll Quality (13 to 64 kbps) Broadcast Quality (Upper than 64 kbps)

3. Test Types IntelligibilityNaturalness Subjective DRT, MRT MOS, DAM ObjectiveNone. Future ASR systems AI, Global SNR, Seg. SNR, FW-Seg. SNR, Itakura Measure, WSSM

4. First Class Subjective Intelligibility Tests Diagnostic Rhyme Test (DRT) –Selecting between two CVC by different first C –First C should have specific properties –Ex. hop - fop And than - dan Modified Rhyme Test (MRT) –Selecting between CVC’s by different first C –Ex. Cat, bat, rat, mat, fat, sat

5. First Class (Cont’d) Subjective Intelligibility tests DRT is very applicable and credible In this test user can hear the speech only once

6. Second Class Subjective Naturalness tests Mean Opinion Score (MOS) –MOS is very applicable and credible –In this test user can hear the speech a lot Diagnostic Acceptability Measure (DAM) –This test is very complex

7. Mean Opinion Score (MOS) Scores for MOS are like this ScoreSpeech Quality 1234512345 Not Acceptable Weak Medium Good Excellent

8. Diagnostic Acceptability Measure (DAM) This test is very complex In this test there is 19 different parameters for score. These parameters divide into 3 main groups: –Signal Quality –Background Quality –Total Quality

9. Objective Tests These tests can not be used for intelligibility. Because system couldn’t recognize speech intelligibility Objective tests can only be used for speech Naturalness

10. Objective Tests (Cont’d) Articulation Index (AI) Signal to Noise Ratio (SNR) –Global (Classic) SNR –Segmental SNR –Frequency Weighted Segmental SNR

11. Articulation Index (AI) AI assumes that different frequency bands distortion are independent, and measure signal quality in different bands. In each band determines percentage of perceptible signal by listener......... 20 Bands HZ 2006100

12. Articulation index (Cont’d) Perceptible by user signal : –1- Upper than human hearing threshold –2- Under than human pain threshold –3- Upper than Masking Noise level –In each case one of the states 1 or 3 is prevail

13. Articulation index (Cont’d) In AI SNR measured isolated in each band

14. Signal To Noise Ratio(SNR)

15. Segmental SNR j’th Frame SNR N : Number of frames M: Frame length Usually averaged over “good frames” “good frames”: having SNRs of higher than -10dB and Saturated at +30dB

16. Frequency Weighted Segmental SNR F : Number of frequency bands N : Number of frames Siemens Formula:

17. Frequency Weighted Segmental SNR Deller Formula

18. Frequency Weighted Segmental SNR Other Formulas:

19. The Final Formula The right formula for fw-seg SNR is thus:

20. The Final Formula Where –M is the number of frames –j is the frame index –k is the frequency band index –w is the weight of the kth band of the jth frame –w j,k is the weight of the kth band of the jth frame –E s,k and E e,k are the energies of the kth band of signal and noise respectively

21. Itakura Measure Is the envelope spectrum Use from All-Pole (AR) Model

22. Itakura Measure (Cont’d) This is based on the spectrum difference between main signal and assessment signal Autoregressive Coefficients Reflection Coefficients Autocorrelation Coefficients

23. Itakura Measure (Cont’d) m :Index of frame l : Index of coefficients

24. Itakura Measure (Cont’d) Is the l’th parameter of the frame that conduces m’th sample

25. Weighted Spectral Slope Measure (WSSM) Is STFT of k’th band of the frame that conduces m’th sample