Abstract

Prosody and prosodic boundaries carry significant information regarding linguistics and paralinguistics and are important aspects of speech. In the field of prosodic event detection, many local acoustic features have been investigated; however, contextual information has not yet been thoroughly exploited. The most difficult aspect of this lies in learning the long-distance contextual dependencies effectively and efficiently. To address this problem, we introduce the use of an algorithm called auto-context. In this algorithm, a classifier is first trained based on a set of local acoustic features, after which the generated probabilities are used along with the local features as contextual information to train new classifiers. By iteratively using updated probabilities as the contextual information, the algorithm can accurately model contextual dependencies and improve classification ability. The advantages of this method include its flexible structure and the ability of capturing contextual relationships. When using the auto-context algorithm based on support vector machine, we can improve the detection accuracy by about 3% and F-score by more than 7% on both two-way and four-way pitch accent detections in combination with the acoustic context. For boundary detection, the accuracy improvement is about 1% and the F-score improvement reaches 12%. The new algorithm outperforms conditional random fields, especially on boundary detection in terms of F-score. It also outperforms an n-gram language model on the task of pitch accent detection.

Highlights

  • Speech is often characterized across two levels of expression: the segmental level encompassing basic phonetic meaning and the prosodic level with additional suprasegmental information

  • We investigate the utilization of contextual information for pitch accent and boundary detection by using the auto-context algorithm, which was first proposed in [3] for high-level computer vision tasks like image segmentation

  • For the n-gram approach, we referred to the results of the representative work [8], in which the same two-way pitch accent detection and binary boundary detection are implemented on the Boston University Radio Speech Corpus (BURSC) dataset using the syllable-level acoustic features of F0, timing cues, and energy

Read more

Summary

Introduction

Speech is often characterized across two levels of expression: the segmental level encompassing basic phonetic meaning and the prosodic level with additional suprasegmental information. We investigate the utilization of contextual information for pitch accent and boundary detection by using the auto-context algorithm, which was first proposed in [3] for high-level computer vision tasks like image segmentation In this algorithm, the classification probabilities obtained from the preceding iteration are used to provide possible contextual clues, together with acoustic features to improve the iteration. Using the posterior probabilities provided by the decision tree, a bigram prosodic label sequence model was combined to detect pitch accent and boundary tones at the syllable level. To investigate the importance of contextual information in prosodic event detection, the work in [16] examined the detection performance of pitch accent at word, syllable, and vowel levels, respectively.

Acoustic representation
Findings
Conclusions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call