linear-attn 和 DeltaNet

Linear attention

linear-attn

https://haileyschoelkopf.github.io/blog/2024/linear-attn

DeltaNet and GDN

DeltaNet

https://sustcsonglin.github.io/blog/2024/deltanet-1/