Interesting analysis showing that the supposed emergent abilities with sharp changes in metrics when scaling LLMs are actually rather metric dependent and when you change to an actual linear metric, you also see linear progress.
Interesting analysis showing that the supposed emergent abilities with sharp changes in metrics when scaling LLMs are actually rather metric dependent and when you change to an actual linear metric, you also see linear progress.