๐๏ธ QU-SSM-15M: Continuous Quasi-Unitary State Space Foundation Model
๐ Official Research Paper (PDF) & Open Verification
Title: "Gated Quasi-Unitary Lie-Algebra Recurrent State Space Models"
Author: Prannessh K.V.A. (@prannesshkva)๐ฅ Download Full Research Paper (PDF) | ๐๏ธ Zenodo DOI: 10.5281/zenodo.22283431 | ๐ฎ Live Interactive Space
QU-SSM-15M is the lightweight dense foundation sequence model of the QU-SSM family, designed and invented by Prannessh K.V.A. (Sole Architect & Inventor). Built for embedded edge hardware and micro-controllers, it delivers continuous Lie-group unitary recurrence on SO(2) โ U(1) with dense SwiGLU representations (29.80M parameters).
๐งฌ Base Model Lineage & Technical Notes
- Core Architecture: Dense Continuous Quasi-Unitary Recurrent State Space Foundation Model (SO(2) Lie-group dynamics).
- Tokenizer Lineage: Initialized with standard GPT-NeoX / Pythia vocabulary (50,277 tokens).
- Pre-training & Calibration: Pre-trained from scratch on
roneneldan/TinyStoriesfor ultra-low latency edge devices, microcontrollers, and embedded hardware. - Parameter Footprint: 29.80M Physical Parameters (dense SwiGLU projections, d_model=256, d_state=16, 6 layers).
- Mathematical Invariant: Exact Euclidean norm preservation (||R(theta)||_2 = 1.000) preventing contractive dissipation.
- Official Research Contact: LinkedIn โ Prannesh K. V. A.
๐ What is QU-SSM?
QU-SSM is a state-of-the-art linear-time sequence architecture that replaces real-valued negative dissipation (e^(-ฮฑยทt) โ 0) with non-dissipative SO(2) phase rotations (โR(ฮธ)โโ โก 1.00000).
๐ Intellectual Property & Citation
- Sole Architect & Inventor: Prannessh K.V.A.
- Official Research DOI:
10.5281/zenodo.22283431 - License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
- Official Contact: LinkedIn โ Prannesh K. V. A.
๐ Related QU-SSM Hub Repositories
- Downloads last month
- 3,064