content type videopublished September 23, 2025
Apple Workshop on Natural Language and Interactive Systems 2025: Mutual Reinforcement of LLM Dialogue Synthesis and Summarization Capabilities
AuthorsRaviteja Vemulapalli (Apple)
Related readings and updates.
The Design Space of Tri-Modal Masked Diffusion Models
October 14, 2026research area Methods and Algorithmsconference NeurIPS
Discrete diffusion models have emerged as strong alternatives to autoregressive language models, with recent work initializing and finetuning a base unimodal model for bi-modal generation. Diverging from previous approaches, we introduce the first tri-modal Masked Diffusion Models (MDM) pretrained from scratch on text, image-text, and audio-text data. We systematically analyze multimodal scaling laws, modality mixing ratios, noise schedules,…
Code-Switching Detection via Language-Selective Dimensions in Speech Foundation Models
October 14, 2026research area Methods and Algorithms, research area Speech and Natural Language Processing
Code-switching (CS), the alternation between languages within an utterance, is common in multilingual speech but underrepresented in pretraining corpora. Increasing CS coverage requires finding relevant utterances in large speech collections so that they can be included in training data. One way to find such utterances is to transcribe the speech and detect language alternation in the text, but this depends on obtaining accurate multilingual…
Discover opportunities in Machine Learning.
Our research in machine learning breaks new ground every day.