Compute has obviously been a major contributor to the progress of large language models. This analysis shows that beyond hardware, algorithms have developed at an even faster pace.

Posted on 23 Mar 2024