A Convergence Theory for Deep Learning via Over-Parameterization

Zeyuan Allen-ZhuYuanzhi LiZhao Song

article2018ICML1,670 citations

Proves that standard stochastic gradient descent finds global minima in polynomial time for deep, over-parameterized neural networks with ReLU activations across fully-connected, convolutional, and residual architectures.

Listen

Modern deep neural networks achieve exceptional practical performance across computer vision and speech tasks, yet their theoretical foundation has historically lagged behind. While empirical practice routinely trains deep networks to near-zero training error using standard first-order optimization, existing optimization theory primarily addressed shallow, two-layer models or relied on idealized assumptions such as infinite network width. The article addresses this fundamental gap by establishing why standard first-order optimization methods reliably succeed on multi-layer deep neural networks.

The main objective of the article is to prove that standard gradient descent and stochastic gradient descent can efficiently find global minimum training solutions in polynomial time for multi-layer, over-parameterized neural networks using non-smooth rectified linear unit (ReLU) activations.

The authors analyze the optimization behavior by evaluating network parameter trajectories in a region surrounding random Gaussian weight initialization. The analysis relies on two minimal assumptions: the input training data points are distinct (non-degenerate), and the network hidden layer width is sufficiently large (over-parameterized polynomially relative to the sample size and depth). The investigation encompasses fully-connected networks, convolutional neural networks, and residual networks across various smooth and non-convex loss functions, supported by empirical landscape visualizations on benchmark image classification datasets.

The article demonstrates several core findings. First, gradient descent and stochastic gradient descent achieve a linear convergence rate, minimizing training regression error exponentially fast or attaining 100% classification accuracy on training datasets in polynomial time and iterations. Second, within a sufficiently large neighborhood around random initialization, the optimization landscape is proven to be almost-convex and semi-smooth, meaning gradients remain large whenever the loss is high and bad local minima or saddle points are avoided. Third, the authors show that finite, polynomially wide networks behave equivalently to the neural tangent kernel, avoiding the exponential gradient explosion or vanishing dependencies that previously hindered deep network theory.

These findings provide rigorous justification for current engineering practices, reducing algorithmic risk by proving that standard first-order optimization methods do not get trapped in sub-optimal local minima when models are sufficiently wide. Furthermore, the analysis demonstrates that deep architectures like residual networks and standard multi-layer networks do not face exponential training slowdowns as depth increases, explaining why practitioners can scale model depth and width effectively.

For engineering and development teams, the results suggest that organizations can confidently utilize standard first-order optimizers on wide, deep architectures without requiring complex second-order curvature corrections during optimization. Future theoretical work should aim to refine the mathematical bounds for smoother activation functions and further explore generalization performance on unseen test data.

The primary limitation noted in the article is that the theoretical width requirements derived from worst-case non-smooth ReLU analysis involve large polynomial factors that exceed the network widths commonly utilized in practical deployments. Nonetheless, high confidence in the qualitative convergence behavior is supported by rigorous mathematical proof and consistent empirical landscape observations across realistic architectures.

arXiv: 1811.03962
Cover for A Convergence Theory for Deep Learning via Over-Parameterization

Abstract

Deep neural networks (DNNs) have demonstrated dominating performance in many fields; since AlexNet, networks used in practice are going wider and deeper. On the theoretical side, a long line of works has been focusing on training neural networks with one hidden layer. The theory of multi-layer networks remains largely unsettled.

In this work, we prove why stochastic gradient descent (SGD) can find global minima\textit{global minima} on the training objective of DNNs in polynomial time\textit{polynomial time}. We only make two assumptions: the inputs are non-degenerate and the network is over-parameterized. The latter means the network width is sufficiently large: polynomial\textit{polynomial} in LL, the number of layers and in nn, the number of samples.

Our key technique is to derive that, in a sufficiently large neighborhood of the random initialization, the optimization landscape is almost-convex and semi-smooth even with ReLU activations. This implies an equivalence between over-parameterized neural networks and neural tangent kernel (NTK) in the finite (and polynomial) width setting.

As concrete examples, starting from randomly initialized weights, we prove that SGD can attain 100% training accuracy in classification tasks, or minimize regression loss in linear convergence speed, with running time polynomial in n,Ln,L. Our theory applies to the widely-used but non-smooth ReLU activation, and to any smooth and possibly non-convex loss functions. In terms of network architectures, our theory at least applies to fully-connected neural networks, convolutional neural networks (CNN), and residual neural networks (ResNet).

Citation

MLA
Allen-Zhu, Z., et al. “A Convergence Theory for Deep Learning via Over-Parameterization”. arXiv, 2018, http://arxiv.org/abs/1811.03962v5.
APA
Allen-Zhu, Z., Li, Y., & Song, Z. (2018). A Convergence Theory for Deep Learning via Over-Parameterization. arXiv. http://arxiv.org/abs/1811.03962v5
Chicago
Allen-Zhu, Z., Y. Li, and Z. Song. 2018. “A Convergence Theory for Deep Learning via Over-Parameterization”. arXiv. http://arxiv.org/abs/1811.03962v5.
Harvard
Allen-Zhu, Z., Li, Y. and Song, Z. (2018) “A Convergence Theory for Deep Learning via Over-Parameterization”, arXiv [Preprint]. Available at: http://arxiv.org/abs/1811.03962v5.
Vancouver
1. Allen-Zhu Z, Li Y, Song Z (2018) A Convergence Theory for Deep Learning via Over-Parameterization. arXiv

BibTeX

@article{allenzhu2018convergence,
  title = {A Convergence Theory for Deep Learning via Over-Parameterization},
  author = {Allen-Zhu, Zeyuan and Li, Yuanzhi and Song, Zhao},
  year = {2018},
  journal = {arXiv},
  url = {http://arxiv.org/abs/1811.03962v5},
  eprint = {1811.03962}
}
Metadata:arXiv

Access the Paper

This paper is available from its original source. Click below to access the PDF.

Open PDF
License: https://creativecommons.org/licenses/by/4.0/