๐Ÿ›๏ธ QU-SSM-15M: Continuous Quasi-Unitary State Space Foundation Model

๐Ÿ“„ Official Research Paper (PDF) & Open Verification

Title: "Gated Quasi-Unitary Lie-Algebra Recurrent State Space Models"
Author: Prannessh K.V.A. (@prannesshkva)

๐Ÿ“ฅ Download Full Research Paper (PDF) | ๐Ÿ›๏ธ Zenodo DOI: 10.5281/zenodo.22283431 | ๐ŸŽฎ Live Interactive Space

Official Paper Zenodo DOI LinkedIn Profile License: CC BY-NC-ND 4.0 Model: qu_ssm-15M Flagship: qu_ssm-130Moe

QU-SSM-15M is the lightweight dense foundation sequence model of the QU-SSM family, designed and invented by Prannessh K.V.A. (Sole Architect & Inventor). Built for embedded edge hardware and micro-controllers, it delivers continuous Lie-group unitary recurrence on SO(2) โ‰… U(1) with dense SwiGLU representations (29.80M parameters).


๐Ÿงฌ Base Model Lineage & Technical Notes

  • Core Architecture: Dense Continuous Quasi-Unitary Recurrent State Space Foundation Model (SO(2) Lie-group dynamics).
  • Tokenizer Lineage: Initialized with standard GPT-NeoX / Pythia vocabulary (50,277 tokens).
  • Pre-training & Calibration: Pre-trained from scratch on roneneldan/TinyStories for ultra-low latency edge devices, microcontrollers, and embedded hardware.
  • Parameter Footprint: 29.80M Physical Parameters (dense SwiGLU projections, d_model=256, d_state=16, 6 layers).
  • Mathematical Invariant: Exact Euclidean norm preservation (||R(theta)||_2 = 1.000) preventing contractive dissipation.
  • Official Research Contact: LinkedIn โ€” Prannesh K. V. A.

๐Ÿ” What is QU-SSM?

QU-SSM is a state-of-the-art linear-time sequence architecture that replaces real-valued negative dissipation (e^(-ฮฑยทt) โ†’ 0) with non-dissipative SO(2) phase rotations (โ€–R(ฮธ)โ€–โ‚‚ โ‰ก 1.00000).


๐Ÿ”’ Intellectual Property & Citation


๐Ÿ”— Related QU-SSM Hub Repositories

Downloads last month
3,306
Safetensors
Model size
30.2M params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Dataset used to train Prannesshkva/QU-SSM-15M

Space using Prannesshkva/QU-SSM-15M 1