💻 **Show HN: WaveletLM – wavelet-based, attention-free model with O(n log n) scaling**

WaveletLM is a wavelet-based, attention-free architecture that replaces self-attention with learned lifting wavelet decomposition, a Fast Walsh-Hadamard Transform, per-scale gated spectral mixing with SwiGLU activation, an inverse FWHT, and wavelet reconstruction. Combined with e...

🔗 https://github.com/ramongougis/WaveletLM

#tech #news