Akinobu Lee


2025

pdf bib
Analyzing Dialogue System Behavior in a Specific Situation Requiring Interpersonal Consideration
Tetsuro Takahashi | Hirofumi Kikuchi | Jie Yang | Hiroyuki Nishikawa | Masato Komuro | Ryosaku Makino | Shiki Sato | Yuta Sasaki | Shinji Iwata | Asahi Hentona | Takato Yamazaki | Shoji Moriya | Masaya Ohagi | Zhiyang Qi | Takashi Kodama | Akinobu Lee | Takashi Minato | Kurima Sakai | Tomo Funayama | Kotaro Funakoshi | Mayumi Usami | Michimasa Inaba | Ryuichiro Higashinaka
Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue

In human-human conversation, interpersonal consideration for the interlocutor is essential, and similar expectations are increasingly placed on dialogue systems. This study examines the behavior of dialogue systems in a specific interpersonal scenario where a user vents frustrations and seeks emotional support from a long-time friend represented by a dialogue system. We conducted a human evaluation and qualitative analysis of 15 dialogue systems under this setting. These systems implemented diverse strategies, such as structuring dialogue into distinct phases, modeling interpersonal relationships, and incorporating cognitive behavioral therapy techniques. Our analysis reveals that these approaches contributed to improved perceived empathy, coherence, and appropriateness, highlighting the importance of design choices in socially sensitive dialogue.

pdf bib
Key Challenges in Multimodal Task-Oriented Dialogue Systems: Insights from a Large Competition-Based Dataset
Shiki Sato | Shinji Iwata | Asahi Hentona | Yuta Sasaki | Takato Yamazaki | Shoji Moriya | Masaya Ohagi | Hirofumi Kikuchi | Jie Yang | Zhiyang Qi | Takashi Kodama | Akinobu Lee | Masato Komuro | Hiroyuki Nishikawa | Ryosaku Makino | Takashi Minato | Kurima Sakai | Tomo Funayama | Kotaro Funakoshi | Mayumi Usami | Michimasa Inaba | Tetsuro Takahashi | Ryuichiro Higashinaka
Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue

Challenges in multimodal task-oriented dialogue between humans and systems, particularly those involving audio and visual interactions, have not been sufficiently explored or shared, forcing researchers to define improvement directions individually without a clearly shared roadmap. To address these challenges, we organized a competition for multimodal task-oriented dialogue systems and constructed a large competition-based dataset of 1,865 minutes of Japanese task-oriented dialogues. This dataset includes audio and visual interactions between diverse systems and human participants. After analyzing system behaviors identified as problematic by the human participants in questionnaire surveys and notable methods employed by the participating teams, we identified key challenges in multimodal task-oriented dialogue systems and discussed potential directions for overcoming these challenges.

2002

pdf bib
Continuous Speech Recognition Consortium an Open Repository for CSR Tools and Models
Akinobu Lee | Tatsuya Kawahara | Kazuya Takeda | Masato Mimura | Atsushi Yamada | Akinori Ito | Katsunobu Itou | Kiyohiro Shikano
Proceedings of the Third International Conference on Language Resources and Evaluation (LREC’02)

2000

pdf bib
IPA Japanese Dictation Free Software Project
Katsunobu Itou | Kiyohiro Shikano | Tatsuya Kawahara | Kasuya Takeda | Atsushi Yamada | Akinori Itou | Takehito Utsuro | Tetsunori Kobayashi | Nobuaki Minematsu | Mikio Yamamoto | Shigeki Sagayama | Akinobu Lee
Proceedings of the Second International Conference on Language Resources and Evaluation (LREC’00)