OptPDE: Discovering Novel Integrable Systems via AI-Human Collaboration

The Big Picture

Imagine searching for a needle in an infinite haystack where the needle can take almost any shape. That’s roughly the challenge facing physicists hunting for integrable systems, special mathematical equations so perfectly balanced they can be solved exactly and predicted indefinitely.

Most equations describing nature are messy, chaotic, resistant to exact solutions. Integrable systems are the rare exceptions. They’ve yielded some of physics’ greatest triumphs, from the mathematics of water waves to the behavior of magnetic materials at the quantum scale.

These equations, technically called partial differential equations (PDEs), describe how quantities like pressure or energy change across space and time. The integrable ones are special because they possess conserved quantities, aspects of the system that never change. Think of how total energy in a frictionless pendulum stays constant forever.

Finding integrable PDEs has always required deep intuition and painstaking symbolic calculation. The search space is astronomically large: even restricting to relatively simple polynomial equations, you’re sifting through a 33-dimensional space of possible coefficients.

Researchers at MIT’s IAIFI have now built a machine learning system that navigates that space automatically and found three families of equations nobody had written down before.

Key Insight: OptPDE is the first machine learning approach that actively designs integrable PDEs by optimizing their coefficients to maximize conserved quantities, discovering new integrable systems through AI-human collaboration.

How It Works

OptPDE flips the usual approach: instead of searching for conserved quantities in a fixed equation, treat the equation’s coefficients as adjustable knobs and turn them until the number of conserved quantities is as large as possible.

This requires two interlocking pieces. The first is CQFinder, a routine that takes any PDE and a library of candidate basis functions, then computes how many conserved quantities that PDE actually has. It translates the conservation condition into a linear system and uses singular value decomposition (SVD) to enumerate all solutions. CQFinder counts how many directions in function space remain perfectly frozen as the equation evolves.

The second piece is OptPDE itself. Because CQFinder runs in PyTorch, the entire pipeline is differentiable. The system can compute gradients (mathematical pointers indicating which direction leads uphill) and use them to find coefficient changes that increase the conserved-quantity count.

OptPDE uses a hybrid optimization strategy:

• Gradient ascent to climb toward higher conserved-quantity counts
• Simulated annealing, which deliberately accepts occasional backward steps to avoid getting stuck in local maxima
• Sparsification to trim discovered equations to their simplest interpretable forms

The team ran this optimization 5,000 times from random starting points, each time reshaping a 33-parameter PDE. After collecting solutions, they applied dimensionality reduction to find clusters, each corresponding to a distinct family of PDEs.

Four families emerged. One was immediately familiar: the Korteweg–De Vries (KdV) equation, one of the most celebrated integrable PDEs in mathematical physics. It describes shallow water waves and self-reinforcing wave packets called solitons. Finding it confirmed the method works.

The other three families were new. The most striking was u_t = (u_x + a²u_xxx)³. Set a = 0 and you get u_t = u_x³, which looks deceptively simple but hides rich behavior: wave-like solutions that develop breaking similar to Burgers’ equation. Before breaking, the system possesses infinitely many conserved quantities. Afterward, the solution’s magnitude decays following a power law, converging to a triangular wave shape.

The machine generates a clean symbolic expression, not a black-box network, and human mathematicians step in to verify properties, prove theorems, and understand the physics. That closed loop is the whole point.

Why It Matters

For physics, this is evidence that machine learning can expand the catalog of known integrable systems. Not just rediscovering what humans already found, but surfacing equations that might have gone unnoticed for years.

The authors point to fusion as a potential application. Inside a tokamak (the donut-shaped reactor used in nuclear fusion research) plasma behaves according to a particular PDE. More conserved quantities could mean more controllable plasma. Whether PDE optimization can actually help with plasma dynamics remains an open question, but it’s one worth tracking.

On the AI side, the paper makes a useful point: the right role for machine learning in science isn’t to replace human reasoning but to handle the combinatorial search that humans can’t. The system doesn’t hide its answers in opaque weights. It returns symbolic equations a physicist can write on a whiteboard.

The method has clear limitations. The current search space is restricted to polynomials with a fixed maximum degree and a single spatial dimension. Extending to higher dimensions, vector fields, or more complex function spaces will require both algorithmic advances and more compute. But the framework is modular: swap in a different PDE basis, adjust the CQ basis, and the same pipeline applies.

Bottom Line: OptPDE discovered three previously unknown families of integrable PDEs by teaching a machine to hunt for conservation laws. It’s a concrete example of what AI-human collaboration in mathematical physics can look like when each side does what it’s best at.