2012
pdf
bib
Estimating Adaptation of Dialogue Partners with Different Verbal Intelligence
Kseniya Zablotskaya
|
Fernando Fernández-Martínez
|
Wolfgang Minker
Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
pdf
bib
abs
Investigating Verbal Intelligence Using the TF-IDF Approach
Kseniya Zablotskaya
|
Fernando Fernández Martínez
|
Wolfgang Minker
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
In this paper we investigated differences in language use of speakers yielding different verbal intelligence when they describe the same event. The work is based on a corpus containing descriptions of a short film and verbal intelligence scores of the speakers. For analyzing the monologues and the film transcript, the number of reused words, lemmas, n-grams, cosine similarity and other features were calculated and compared to each other for different verbal intelligence groups. The results showed that the similarity of monologues of higher verbal intelligence speakers was greater than of lower and average verbal intelligence participants. A possible explanation of this phenomenon is that candidates yielding higher verbal intelligence have a good short-term memory. In this paper we also checked a hypothesis that differences in vocabulary of speakers yielding different verbal intelligence are sufficient enough for good classification results. For proving this hypothesis, the Nearest Neighbor classifier was trained using TF-IDF vocabulary measures. The maximum achieved accuracy was 92.86%.
pdf
bib
abs
Relating Dominance of Dialogue Participants with their Verbal Intelligence Scores
Kseniya Zablotskaya
|
Umair Rahim
|
Fernando Fernández Martínez
|
Wolfgang Minker
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
In this work we investigated whether there is a relationship between dominant behaviour of dialogue participants and their verbal intelligence. The analysis is based on a corpus containing 56 dialogues and verbal intelligence scores of the test persons. All the dialogues were divided into three groups: H-H is a group of dialogues between higher verbal intelligence participants, L-L is a group of dialogues between lower verbal intelligence participant and L-H is a group of all the other dialogues. The dominance scores of the dialogue partners from each group were analysed. The analysis showed that differences between dominance scores and verbal intelligence coefficients for L-L were positively correlated. Verbal intelligence scores of the test persons were compared to other features that may reflect dominant behaviour. The analysis showed that number of interruptions, long utterances, times grabbed the floor, influence diffusion model, number of agreements and several acoustic features may be related to verbal intelligence. These features were used for the automatic classification of the dialogue partners into two groups (lower and higher verbal intelligence participants); the achieved accuracy was 89.36%.
2010
pdf
bib
abs
HIFI-AV: An Audio-visual Corpus for Spoken Language Human-Machine Dialogue Research in Spanish
Fernando Fernández-Martínez
|
Juan Manuel Lucas-Cuesta
|
Roberto Barra Chicote
|
Javier Ferreiros
|
Javier Macías-Guarasa
Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)
In this paper, we describe a new multi-purpose audio-visual database on the context of speech interfaces for controlling household electronic devices. The database comprises speech and video recordings of 19 speakers interacting with a HIFI audio box by means of a spoken dialogue system. Dialogue management is based on Bayesian Networks and the system is provided with contextual information handling strategies. Each speaker was requested to fulfil different sets of specific goals following predefined scenarios, according to both different complexity levels and degrees of freedom or initiative allowed to the user. Due to a careful design and its size, the recorded database allows comprehensive studies on speech recognition, speech understanding, dialogue modeling and management, microphone array based speech processing, and both speech and video-based acoustic source localisation. The database has been labelled for quality and efficiency studies on dialogue performance. The whole database has been validated through both objective and subjective tests.