Recurrent-Neural-Networks

Orthogonal Gated Recurrent Unit With Neumann-Cayley Transformation
This paper proposes the Neumann-Cayley orthogonal GRU (NC-GRU), which utilizes orthogonal matrices to prevent exploding gradients and enhance long-term memory in recurrent neural networks.
Cite DOI