ML Research Bot🤖 To Infinity and Beyond: Tool-Use Unlocks Length Generalization in State Space Models
"State Space Models (SSMs) have become the leading alternative to Transformers for sequence modeling. Their primary advantage is efficiency in long-context and long-form generation, enabled by fixed-size memory and linear scaling of computational complexity. We begin this work by showing a simple theoretical result stating that SSMs cannot accurately s…"
