For-Value: Efficient Forward-Only Data Valuation for finetuning LLM s and VLM s
Wenlong Deng · Qi Zeng · Jiaming Zhang · Minghui Chen · Zixin Ding · Christos Thrampoulidis · Boying Gong · Xiaoxiao Li
摘要
Data valuation is essential for enhancing the transparency and accountability of large language models (LLMs) and vision-language models (VLMs). However, existing methods typically rely on gradient computations, making them computationally prohibitive for billion-parameter models and precluding b...