The paper tackles a core computational problem in fields like financial mathematics and reinforcement learning: how do you efficiently represent and work with processes that evolve randomly over time and depend on the full history of some underlying random signal? These "predictable square-integrable processes" are the mathematical objects that describe things like optimal trading strategies or control policies in continuous time. A classical theoretical framework called Wiener chaos expansion exists for representing such processes, but it becomes computationally impractical because it requires tracking enormous numbers of increasingly complex terms built from repeated integrals of random noise.
To solve this, the authors introduce NeuralChaos, a neural network architecture designed specifically to produce valid representations of these processes using only a finite number of snapshots of the underlying random path, rather than infinite series of complicated integrals. They prove two key theoretical results: first, that NeuralChaos can approximate any such process arbitrarily well (the technical term is "dense in the space"); and second, that it achieves near-optimal approximation rates for processes that have a kind of compressible structure, meaning most of the important information is concentrated in relatively few components. They also show that this compressibility property is not a special assumption but is actually the generic situation for randomly drawn processes, making the approach broadly applicable.
A striking negative result rounds out the theory: conventional neural stochastic differential equation models, which are popular in practice and assume the process depends only on its current state rather than full history, turn out to be a vanishingly small and measure-zero subset of the full space of processes. This means they are fundamentally limited in expressiveness, regardless of how finely you discretize time. Numerical experiments on a stochastic control problem and a dynamic hedging task confirm that NeuralChaos outperforms these Markovian baselines, suggesting it offers a more principled and powerful foundation for modeling complex time-dependent random phenomena.