In Korean medical LLMs, domain-trained models underperform General LLMs of comparable parameter scale. We attribute this *paradoxical failure* to a *cascading two-bottleneck* structure: tokenizer over-fragmentation (*Fragmentation bottleneck, B1*) compounded by a learning-stage representation-alignment failure (*Alignment bottleneck, B2*). Using the Korean medical domain as a case study, we diagnose this paradox and propose **VocMoE**, which is designed to address both bottlenecks: DVE selects domain vocabulary from a medical BERT via an information-theoretic score, and MoDE uses the DVE output (the partition of token ids) as the vocabulary-conditioned, deterministic routing key of the MoE FFN. In this view, the vocabulary partition itself serves as a routing prior, shifting routing from hidden-state learning to vocabulary identity. MediKo-9B-A4B reaches simultaneous SOTA on KorMedMCQA (**57.5**, +14.8 pt), KMMLU Medical, and HAE-RAE, while MediKo-4B-A1B (active 1.69B) surpasses Qwen3-8B (8B) and KULLM3 (10.7B) on KorMedMCQA, updating the active-parameter efficiency frontier.

While LLMs are increasingly used in commercial services, they pose privacy risks such as leakage of sensitive personally identifiable information (PII). For LLMs trained on multilingual corpora, Multilingual Machine Unlearning (MMU) aims to remove information across multiple languages. However, prior MMU evaluations fail to capture such cross-linguistic distribution of information, being largely limited to direct extensions of per-language evaluation protocols. To this end, we propose two metrics to evaluate the information spread across languages: the Knowledge Separability Score (KSS) and the Knowledge Persistence Score (KPS). KSS measures the overall unlearning quality across multiple languages, while KPS more specifically aims to assess consistent removal of information among different language pairs. We evaluated various unlearning methods in the multilingual setting with these metrics and conducted comprehensive analyses. Through our investigation, we provide insights into unique phenomena exclusive to MMU and offer a new perspective on MMU evaluation.

Automated Audio Captioning (AAC) aims to generate natural language descriptions of audio content, enabling machines to interpret and communicate complex acoustic scenes. However, current AAC datasets often suffer from short and simplistic captions, limiting model expressiveness and semantic depth. To address this, we introduce VggCaps, a new multi-modal dataset that pairs audio with corresponding video and leverages large language models (LLMs) to generate rich, descriptive captions. VggCaps significantly outperforms existing benchmarks in caption length, lexical diversity, and human-rated quality. Furthermore, we propose Multi2Cap, a novel AAC framework that learns audio-visual representations through a AV-grounding module during pre-training and reconstructs visual semantics using audio alone at inference. This enables visually grounded captioning in audio-only scenarios. Experimental results on Clotho and AudioCaps demonstrate that Multi2Cap achieves state-of-the-art performance across multiple metrics, validating the effectiveness of cross-modal supervision and LLM-based generation in advancing AAC.