Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training
Pierre-Carl Langlais · Pavel Chizhov · Catherine Arnett · Carlos Hinostroza · Mattia Nee · Eliot Jones · Irène Girard · David Mach · Anastasia Stasenko · Ivan Yamshchikov
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Pierre-Carl Langlais · Pavel Chizhov · Catherine Arnett · Carlos Hinostroza · Mattia Nee · Eliot Jones · Irène Girard · David Mach · Anastasia Stasenko · Ivan Yamshchikov
Pavel Chizhov · Egor Bogomolov · Ivan P. Yamshchikov
Efficiency and safety of Large Language Models (LLMs), among other factors, rely on the quality of tokenization. A good tokenizer not only improves inference speed and language understanding but also provides extra defense against jailbreak attacks and lowers the risk of hallucinations. In this w...
Pierre-Carl Langlais · Pavel Chizhov · Yannick Detrois · Carlos Rosas-Hinostroza · Ivan P. Yamshchikov · Bastien Perroy
Automated analysis of customer feedback on social media is hindered by three challenges: the high cost of annotated training data, the scarcity of evaluation sets, especially in multilingual settings, and privacy concerns that prevent data sharing and reproducibility. We address these issues by d...