Chia-Yu Hung

Author directory

2026

Diffusion and flow-matching models have revolutionized automatic text-to-audio generation, increasingly capable of generating high-quality audio outputs for speech and acoustic events. However, creative audio generation involving music and songs still has room for improvement. Recent open lyrics-to-song models like DiffRhythm, ACE-Step, and LeVo have set an acceptable standard for recreational use but lack the fine-grained word-level controllability desired by musicians. To our knowledge, our flow-matching-based JAM is the first to provide word-level timing and duration control in song generation, enabling fine-grained vocal control. To better align generated songs with human preferences, we implement aesthetic alignment through Direct Preference Optimization, iteratively refining the model using a synthetic dataset without manual annotations. Additionally, we aim to standardize evaluation of lyrics-to-song models through our public evaluation dataset JAME. We demonstrate that JAM outperforms open models on music-specific attributes.

2025

Inference-time computation methods enhance the performance of Large Language Models (LLMs) by leveraging additional computational resources to achieve superior results. Common techniques, such as Best-of-N sampling, Majority Voting, and variants of tree-search algorithm have proven to be effective in boosting the performance of LLMs. These approaches strategically trade increased computational resource for improved model responses. In this work, we proposed DARWIN, an inference-time alignment method that leverage the guidance of a reward model to achieve alignment through reward-guided tree search. Empirical evidences indicates that our method outperform other inference-time alignment methods such as Best-of-N and ARGS on two widely accepted alignment benchmarks AlpacaEval 2 and MT-Bench. Furthermore, we show that our inference-time approach achieves performance comparable to preference-tuned models on both benchmarks, highlighting the effectiveness of trading inference-time compute for enhanced performance during inference.

2023

Authorship verification (AV) is a fundamental task in natural language processing (NLP) and computational linguistics, with applications in forensic analysis, plagiarism detection, and identification of deceptive content. Existing AV techniques, including traditional stylometric and deep learning approaches, face limitations in terms of data requirements and lack of explainability. To address these limitations, this paper proposes PromptAV, a novel technique that leverages Large-Language Models (LLMs) for AV by providing step-by-step stylometric explanation prompts. PromptAV outperforms state-of-the-art baselines, operates effectively with limited training data, and enhances interpretability through intuitive explanations, showcasing its potential as an effective and interpretable solution for the AV task.