Apple Workshop on Human-Centered Machine Learning 2024: Engineering Better UIs via Collaboration with Screen-Aware Foundation Models
AuthorsKevin Moran (University of Central Florida)
Apple Workshop on Human-Centered Machine Learning 2024: Engineering Better UIs via Collaboration with Screen-Aware Foundation Models
AuthorsKevin Moran (University of Central Florida)
The Design Space of Tri-Modal Masked Diffusion Models
October 14, 2026research area Methods and Algorithmsconference NeurIPS
Discrete diffusion models have emerged as strong alternatives to autoregressive language models, with recent work initializing and finetuning a base unimodal model for bi-modal generation. Diverging from previous approaches, we introduce the first tri-modal Masked Diffusion Models (MDM) pretrained from scratch on text, image-text, and audio-text data. We systematically analyze multimodal scaling laws, modality mixing ratios, noise schedules,…
Code-Switching Detection via Language-Selective Dimensions in Speech Foundation Models
October 14, 2026research area Methods and Algorithms, research area Speech and Natural Language Processing
Code-switching (CS), the alternation between languages within an utterance, is common in multilingual speech but underrepresented in pretraining corpora. Increasing CS coverage requires finding relevant utterances in large speech collections so that they can be included in training data. One way to find such utterances is to transcribe the speech and detect language alternation in the text, but this depends on obtaining accurate multilingual…