Hyper-Connections

Spectral-Sphere-Constrained Hyper-Connections
Hyper-Connections (HC) extend residual connections into multiple streams, employing residual matrices for cross-stream mixing to enrich …
Zhaoyi Liu, Haichuan Zhang, Ang Li
Cite Code