Neural Inverse Operators for Solving PDE Inverse Problems
Roberto MolinaroYunan YangBjörn EngquistSiddhartha Mishra
Proposes Neural Inverse Operators, a framework that stacks DeepONet and Fourier Neural Operators to map boundary observation operators directly to PDE coefficients, delivering solutions orders of magnitude faster than traditional PDE-constrained optimization across electrical impedance tomography, wave scattering, optical tomography, and seismic imaging.
Many critical applications in engineering, geophysics, and medical diagnostics—such as medical tomography, subsurface seismic imaging, and non-destructive material testing—rely on solving partial differential equation (PDE) inverse problems. These problems require inferring internal medium properties (such as tissue conductivity or subsurface rock velocity) solely from indirect boundary or surface measurements. Traditional numerical techniques rely on iterative PDE-constrained optimization or specialized direct algorithms. However, these classical approaches are computationally prohibitive, requiring hours of compute time per sample, and suffer from high sensitivity to initial guesses and measurement noise. While modern data-driven neural operators have accelerated forward PDE simulations, existing deep learning architectures map functions to functions and are fundamentally ill-suited for inverse problems, which mathematically require mapping entire observation operators to interior property fields.
The article designs and evaluates a novel deep learning framework, termed Neural Inverse Operators (NIOs), specifically developed to learn end-to-end inverse mappings from operator measurements directly to underlying spatial fields. The objective is to demonstrate that this architecture can solve challenging, ill-posed PDE inverse problems with higher accuracy, robust generalization, and execution speeds several orders of magnitude faster than both standard deep learning models and traditional numerical inversion techniques.
To achieve this, the authors introduce an architecture that sequentially composes two existing frameworks: Deep Operator Networks (DeepONets) and Fourier Neural Operators (FNOs). The DeepONet component processes boundary-defined measurements and lifts them into internal spatial representations, while the FNO component performs nonlinear mode mixing and final inversion. To ensure the model remains invariant to sample order and input size, the authors introduce a training strategy called randomized batching. The approach was systematically evaluated across four major scientific benchmarks: electrical impedance tomography (the Calderón problem, including a realistic heart-and-lungs model), inverse wave scattering for object detection, optical imaging via radiative transport, and seismic full waveform inversion using standard geophysical datasets. The authors also benchmarked NIO against fully convolutional neural networks, standard DeepONets, traditional direct solvers, and PDE-constrained optimization methods across variations in noise, sensor placement, grid resolution, and out-of-distribution distributions.
The experimental findings show that NIO consistently matches or outperforms all baseline models across every benchmark, often cutting error rates substantially. In electrical impedance tomography, NIO reduced relative L1 reconstruction errors to 0.85% (compared to 1.49% for convolutional baselines and 8.75% for classical direct methods). In inverse wave scattering, NIO achieved a 1.07% median test error compared to 2.53% for convolutional networks. When tested against traditional PDE-constrained optimization, NIO proved to be roughly five times more accurate (2.3% error versus 11.1%) while running in less than one second on a standard CPU—achieving an inference speedup of approximately four orders of magnitude compared to the 8.5 hours required by GPU-based optimization. Furthermore, unlike convolutional baselines whose errors degraded sharply when the number of input measurements fluctuated, NIO remained highly stable across varying measurement counts, sensor locations, grid resolutions, and input noise levels.
These results demonstrate that NIO provides an operationally viable, robust path to real-time imaging and physical property estimation. By replacing expensive iterative solvers with an ultra-fast, direct inference pipeline, organizations can dramatically lower compute costs, accelerate turnaround times from hours to fractions of a second, and make real-time operational decisions in time-critical environments like bedside patient monitoring and hazard assessment.
Based on these outcomes, organizations working on complex inverse physical systems should consider piloting neural inverse operators as high-speed replacements for iterative PDE inversion pipelines. Prior to deployment, teams should validate model robustness against domain-specific measurement noise and establish training data generation protocols using representative forward simulations. For future research, the authors recommend extending NIO to higher-dimensional 3D seismic settings, adapting alternative operator backbones (such as graph neural networks), and developing rigorous theoretical approximation bounds to formalize the architecture's mathematical guarantees.
While confidence in the reported experimental performance is high due to comprehensive benchmarking, practical limitations remain. The current empirical validation is primarily restricted to one- and two-dimensional synthetic and benchmark datasets with modest measurement counts (typically 20 to 32 boundary measurements during training). Real-world field deployments may introduce higher levels of unstructured noise, missing channels, and severe three-dimensional scaling challenges that warrant caution and targeted pilot validation before full-scale adoption.
- Paper: Fourier Neural Operator for Parametric Partial Differential Equations, Zongyi Li et al. (2020). The paper uses Fourier Neural Operators as a core inversion component, so this introduction clarifies the FNO architecture it adapts.
- Paper: Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators, Lu Lu et al. (2021). Because the inverse framework also composes DeepONets, this paper explains the operator-learning architecture used to encode boundary measurements.
- Paper: Neural Operator: Learning Maps Between Function Spaces With Applications to PDEs, Nikola Kovachki et al. (2023). This general neural-operator framework establishes the function-to-function learning foundations that the source repurposes for inverse mappings.
- Paper: Neural Operators with Localized Integral and Differential Kernels, Miguel Liu-Schiaffini et al. (2024). It extends Fourier neural operators with localized differential and integral kernels, addressing fine-scale detail that can matter in inverse reconstructions.
- Paper: Transolver: A Fast Transformer Solver for PDEs on General Geometries, Haixu Wu et al. (2024). This later neural PDE solver carries operator-learning ideas toward efficient modeling on general, unstructured geometries.
- Paper: Score-Based Diffusion Models in Function Space, Jae Hyun Lim 0001 et al. (2025). It advances neural-operator methods into generative modeling of functional data, including a Darcy-flow Bayesian inverse problem.
