New preprint: "Linear equivalence of nonlinear recurrent neural networks." For large nonlinear (potentially chaotic) RNNs with random connectivity, the full N×N covariance matrix takes the same form as that of a ~linear~ network with the same couplings, driven by independent noise.
Large nonlinear recurrent neural networks with random couplings generate high-dimensional, potentially chaotic activity whose structure is of interest in neuroscience, machine learning, ecology, and o...
