哈佛斯坦福MIT等机构首次提出「精度感知」scaling law，揭示了精度、参数规模、数据量之间的统一关系。数据量增加，模型对量化精度要求随之提高，这预示着AI领域低精度加速的时代即将结束！ 就连「量化」也不管用，scaling law真的要终结了吗？ 一提scaling law ...

Much of the tech industry has bet on so-called scaling laws that say more computing power, data and larger models will inevitably pave the way for greater leaps forward in the power of AI. The recent ...

Scaling concerns in Google, OpenAI and Anthropic: While Reuters published a comprehensive report about the subject, concerns around AI scaling have been in discussion for a while now. As per a ...

Despite evidence to the contrary, Amodei believes that “scaling up” models is still a viable path toward more capable AI. By scaling up, Amodei clarified that he means increasing not only the ...

按照结论，对Scaling Law的遵循意味着我们需要保持更高精度，然而一直以来，人们通常会选择量化（将连续值或多精度值转换为较低精度）来节省 ...