In a new #ICLR2026 paper we provide an algorithm for semi-analytically constructing un-/stable manifolds of fixed points and cycles of ReLU-based RNNs:
openreview.net/pdf?id=EAwLA...
These manifolds provide a skeleton for the system’s dynamics, dissecting the state space into basins of attraction.