Diffusion Language Model Knows the Answer Before It Decodes
Pengxiang Li · Yefan Zhou · Dilxat Muhtar · Lu Yin · Shilin Yan · Li Shen · Yi Liang · Soroush Vosoughi · Shiwei Liu
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Pengxiang Li · Yefan Zhou · Dilxat Muhtar · Lu Yin · Shilin Yan · Li Shen · Yi Liang · Soroush Vosoughi · Shiwei Liu
Zhongyu Ouyang · Qianlong Wen · Chunhui Zhang · Yanfang Ye · Soroush Vosoughi
What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that existing preference-alignment approaches largely rely on binary pairwise comparisons, overlooking two critical factors: preference intensity (the structured...
Xiangchi Yuan · Dachuan Shi · Chunhui Zhang · Zheyuan Liu · Shenglong Yao · Soroush Vosoughi · Wenke Lee
Reinforcement learning (RL) is central to post-training, particularly for agentic models that require specialized reasoning behaviors. In this setting, model merging offers a practical mechanism for integrating multiple RL-trained agents from different tasks into a single generalist model. Howeve...
Manzi Fabrice Niyigaba · Ivory Yang · Soroush Vosoughi
Propaganda is a widely used approach for shaping public opinion and disseminating misinformation in news media. While it has recently gained significant attention within the NLP community, research on fine grained propaganda detection remains heavily concentrated in high resource languages. To br...
Yaning Jia · Chunhui Zhang · Xingjian Diao · Xiangchi Yuan · Zhongyu Ouyang · Chiyu Ma · Soroush Vosoughi
Curriculum learning (CL), which orders training data from easy to hard, has become a popular strategy for improving reasoning in large language models (LLMs). Yet prior work employs disparate difficulty metrics and training setups, leaving open fundamental questions: When does curriculum help? Wh...
Elisaveta Samoylov · Soroush Vosoughi
Lean proofs are built as sequences of tactic-induced state transitions, yet learned models often represent proof steps primarily through tactic strings or raw proof-state text. Building on Delta Tokens, which encode a proof step by the local edit it induces between successive proof states, we tra...
Wenhao You · Xingjian Diao · Wenjun Huang · Chunhui Zhang · Keyi Kong · Weiyi Wu · Chiyu Ma · Zhongyu Ouyang · Tingxuan Wu · Ming Cheng · Soroush Vosoughi · Jiang Gui
While recent Multimodal Large Language Models exhibit impressive capabilities for general multimodal tasks, specialized domains like music necessitate tailored approaches. Music Audio-Visual Question Answering (Music AVQA) particularly underscores this, presenting unique challenges with its conti...
Xingjian Diao · Zheyuan Liu · Chunhui Zhang · Weiyi Wu · Keyi Kong · Lin Shi · Kaize Ding · Soroush Vosoughi · Jiang Gui
Large Vision-Language Models (LVLMs) have exhibited strong reasoning capabilities through chain-of-thought mechanisms that generate step-by-step rationales. However, such slow-thinking approaches often lead to overthinking, where models produce excessively verbose responses even for simple querie...
Yahan Zheng · John J. Guerrerio · Soroush Vosoughi · Weicheng Ma
Preprocessing-based methods for stereotype mitigation, such as pre-/post-training on debiased corpora, are widely used in NLP. While these approaches reduce measurable stereotypes for targeted groups, we find they often induce unintended shifts: stereotyping or counter-stereotyping can increase f...