title: Technologies on Effectiveness and Efficiency: A Survey of State Spaces
    Models
summary: State Space Models (SSMs) have emerged as a promising alternative to the
  popular transformer-based models and have been increasingly gaining attention.
  Compared to transformers, SSMs excel at tasks with sequential data or longer
  contexts, demonstrating comparable performances with significant efficiency
  gains. In this survey, we provide a coherent and systematic overview for SSMs,
  including their theoretical motivations, mathematical formulations, comparison
  with existing model classes, and various applications. We divide the SSM series
  into three main sections, providing a detailed introduction to the original
  SSM, the structured SSM represented by S4, and the selective SSM typified by
  Mamba. We put an emphasis on technicality, and highlight the various key
  techniques introduced to address the effectiveness and efficiency of SSMs. We
  hope this manuscript serves as an introduction for researchers to explore the
  theoretical foundations of SSMs.
paper_authors._id: 67d788b6ba098a0651e1e235
paper_authors.name: Xingtai Lv
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-17T08:44:34.410Z
paper_authors._id: 663f07d029be04778ba97871
paper_authors.avatarUrl: /avatars/fb7c9d4a2c537d918a3267e7cbc03f04.svg
paper_authors.fullname: Xingtai Lv
paper_authors.type: user
paper_authors.user: XingtaiHF
paper_authors._id: 67d788b6ba098a0651e1e236
paper_authors.name: Youbang Sun
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-17T08:50:17.568Z
paper_authors._id: 679ce8c048ebd7903d76a832
paper_authors.avatarUrl: /avatars/5f3fecaacfee6e2d5a72dd19fe87055a.svg
paper_authors.fullname: Youbang Sun
paper_authors.type: user
paper_authors.user: Youbang
paper_authors._id: 67d788b6ba098a0651e1e237
paper_authors.name: Kaiyan Zhang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-17T08:44:26.057Z
paper_authors._id: 60bc94cd85a3ab33829b6211
paper_authors.avatarUrl: /avatars/b57d36c7577fbbb42ea5b963eef4144a.svg
paper_authors.fullname: Kaiyan Zhang
paper_authors.type: user
paper_authors.user: iseesaw
paper_authors._id: 67d788b6ba098a0651e1e238
paper_authors.name: Shang Qu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-17T14:42:23.487Z
paper_authors._id: 65597738deee83130a1301d5
paper_authors.avatarUrl: /avatars/9bcc40aebe4db079927675d95c00463c.svg
paper_authors.fullname: Shang (Lindsay) Qu
paper_authors.type: user
paper_authors.user: lindsay-qu
paper_authors._id: 67d788b6ba098a0651e1e239
paper_authors.name: Xuekai Zhu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-17T08:50:38.118Z
paper_authors._id: 647ffddeb82adfa7cc1a10d9
paper_authors.avatarUrl: /avatars/26aa168d6b2068298ebb16584aa52b6c.svg
paper_authors.fullname: zhu
paper_authors.type: user
paper_authors.user: xuekai
paper_authors._id: 67d788b6ba098a0651e1e23a
paper_authors.name: Yuchen Fan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-17T08:50:54.445Z
paper_authors._id: 672c2d7816766a76a747b7b5
paper_authors.avatarUrl: /avatars/12c7b26d2b81721ccac3a5c71e32a1a1.svg
paper_authors.fullname: Yuchen Fan
paper_authors.type: user
paper_authors.user: yuchenFan
paper_authors._id: 67d788b6ba098a0651e1e23b
paper_authors.name: Yi Wu
paper_authors._id: 67d788b6ba098a0651e1e23c
paper_authors.name: Ermo Hua
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-17T08:44:30.639Z
paper_authors._id: 6445fa2ffc22e309d78bef3e
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6445fa2ffc22e309d78bef3e/FQaINLd0PjgY9EnK_APRk.jpeg
paper_authors.fullname: Messi Hua
paper_authors.type: user
paper_authors.user: Messi-Hua
paper_authors._id: 67d788b6ba098a0651e1e23d
paper_authors.name: Xinwei Long
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-17T08:51:02.068Z
paper_authors._id: 667e577139b49eba118d569f
paper_authors.avatarUrl: /avatars/1a26dd96b4b352b8968561750ecae9a7.svg
paper_authors.fullname: Xinwei Long
paper_authors.type: user
paper_authors.user: xinwei666
paper_authors._id: 67d788b6ba098a0651e1e23e
paper_authors.name: Ning Ding
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-17T08:51:08.621Z
paper_authors._id: 677b80e31ad30ab2c798e776
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/X8IFnIK3TDHOGKZCzLTe8.jpeg
paper_authors.fullname: Ning Ding
paper_authors.type: user
paper_authors.user: BradPitt2025
paper_authors._id: 67d788b6ba098a0651e1e23f
paper_authors.name: Bowen Zhou
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-03-17T08:51:15.825Z
paper_authors._id: 669f614b59adf5b56e05bce3
paper_authors.avatarUrl: /avatars/ffd4189efbceb0e63a03db273065a44b.svg
paper_authors.fullname: BowenZhou
paper_authors.type: user
paper_authors.user: bowenZhou
paper_title: Technologies on Effectiveness and Efficiency: A Survey of State Spaces
    Models
paper_summary: State Space Models (SSMs) have emerged as a promising alternative to the
  popular transformer-based models and have been increasingly gaining attention.
  Compared to transformers, SSMs excel at tasks with sequential data or longer
  contexts, demonstrating comparable performances with significant efficiency
  gains. In this survey, we provide a coherent and systematic overview for SSMs,
  including their theoretical motivations, mathematical formulations, comparison
  with existing model classes, and various applications. We divide the SSM series
  into three main sections, providing a detailed introduction to the original
  SSM, the structured SSM represented by S4, and the selective SSM typified by
  Mamba. We put an emphasis on technicality, and highlight the various key
  techniques introduced to address the effectiveness and efficiency of SSMs. We
  hope this manuscript serves as an introduction for researchers to explore the
  theoretical foundations of SSMs.
paper_ai_summary: This survey provides a comprehensive overview of State Space Models (SSMs), their mathematical foundations, and their applications, emphasizing their efficiency and effectiveness compared to transformer-based models.
paper_ai_keywords: State Space Models SSMs transformers sequential data longer contexts theoretical motivations mathematical formulations structured SSM S4 selective SSM Mamba