Cool post by Dileep George (@dileeplearning) pointing out that there likely are fundamental limits on what we can achieve by scaling up LLMs, and introducing a useful metaphor: scaled up zeppelins vs. underperforming airplanes in the early 20th century.
https://dileeplearning.substack.com/p/welcome-to-the-exciting-dirigibles-500