Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction
Xiaolei MaZhuang DaiZhengbing HeJihui NaYong WangYunpeng Wang
Demonstrates that modeling spatiotemporal traffic dynamics as two-dimensional images enables convolutional neural networks to predict large-scale network speeds with a 42.9% accuracy improvement over traditional and recurrent deep learning models.
Urban traffic congestion poses severe operational, economic, and planning challenges for modern metropolitan areas. Effective network-wide traffic management and navigation require accurate forecasts across entire road networks rather than isolated roadway corridors. However, existing statistical and shallow machine learning models often treat traffic variables as isolated time series. Consequently, they fail to capture the complex, two-dimensional spatial correlations and broader propagation patterns across interconnected roadways, and they struggle with the computational burden of large-scale road networks.
The article demonstrates an image-based deep learning framework using a Convolutional Neural Network—a deep learning model specialized in processing visual grid structures—to predict network-wide traffic speeds with high accuracy across large-scale urban transportation networks. It evaluates how effectively converting spatiotemporal traffic dynamics into two-dimensional image matrices enables the automated extraction of deep traffic features for short- and longer-term forecasting.
To evaluate the framework, the analysis used real-world probe data from approximately 10,000 GPS-equipped taxis in Beijing over a 37-day period in 2015, aggregated into two-minute intervals. The evaluation tested two sub-networks of distinct topological complexity: the simple, circular Second Ring Road (236 road segments) and a complex grid in Northeast Beijing (352 road segments). The approach structured continuous time on the horizontal axis and ordered road segments on the vertical axis to create single-channel speed matrices. The proposed four-layer convolutional architecture was evaluated across four distinct prediction horizons (10-minute and 20-minute forecasts using 30 or 40 minutes of prior data) and benchmarked against four prevailing statistical algorithms and three conventional deep learning sequence models.
The findings confirm that the image-based convolutional approach consistently outperformed all baseline methods across all test conditions. First, the proposed framework achieved an average prediction accuracy improvement of 42.91% compared to prevailing models on testing datasets. Second, across three categorized speed regimes (heavy, moderate, and free-flow traffic), the model attained the highest overall accuracy scores, averaging 0.931, whereas traditional regression scored 0.917 and conventional artificial neural networks scored significantly lower. Third, deeper convolutional architectures reduced test error substantially, with a four-layer design outperforming shallower configurations. Fourth, the model maintained superior accuracy even when forecasting longer 20-minute horizons, successfully capturing congestion propagation patterns across complex multi-road networks.
These results demonstrate that capturing spatial and temporal interdependencies simultaneously is essential for reliable network-level congestion forecasting. Operationally, the model maintains a practical balance between computational efficiency and high precision: although simpler statistical models train faster, their inability to model network-wide spatial correlations yields inferior forecasts, while competitive ensemble tree models require excessive training times (around nine hours) that are impractical for large networks. Implementing this framework can enhance intelligent transportation systems, improve route-guidance reliability, and help municipal authorities optimize traffic operations.
For future implementation, transportation agencies and technology teams should explore hybrid architectures, such as combining convolutional feature extraction with recurrent sequence models like Long Short-Term Memory networks to further refine dynamic temporal forecasting. System planners should also conduct pilot deployments in live operational centers to assess real-time performance. Caution should be exercised when mapping non-linear, complex road grids onto two-dimensional matrix axes, as network segmentation can partially disrupt spatial continuity, although the convolutional layers compensate by assembling higher-level feature representations.
- Paper: Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting, Xingjian Shi et al. (2015). Introduces the formulation of spatio-temporal dynamics as image-like matrix sequences processed by convolutional architectures, establishing the conceptual foundation for grid-based traffic forecasting.
- Paper: Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction, Junbo Zhang et al. (2017). Establishes how citywide spatio-temporal transportation flows can be modeled as images using deep residual convolutional networks.
- Paper: Fully convolutional networks for semantic segmentation, Jonathan Long et al. (2015). Provides the seminal methodology for dense, pixel-level prediction using fully convolutional networks that enables feature extraction from whole spatial matrices.
- Paper: An Introduction to Convolutional Neural Networks, Keiron O'Shea et al. (2015). Explains foundational convolutional neural network mechanisms such as local connectivity and weight sharing that underpin 2D matrix traffic modeling.
- Paper: Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting, Bing Yu et al. (2017). Advances beyond regular 2D grid/image formulations of traffic networks by applying graph convolutions directly to arbitrary road network topologies.
- Paper: Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting, Yaguang Li et al. (2017). Extends deep traffic speed forecasting to non-Euclidean road network graphs by modeling traffic dynamics as a diffusion process on directed graphs.
- Paper: T-GCN: A Temporal Graph Convolutional Network for Traffic Prediction, Ling Zhao et al. (2018). Builds on spatial-temporal deep learning for traffic speed forecasting by integrating graph convolutional networks with gated recurrent units.
- Paper: Graph WaveNet for Deep Spatial-Temporal Graph Modeling, Zonghan Wu et al. (2019). Generalizes deep traffic forecasting by combining temporal convolutions with adaptive graph convolutions to learn latent network structures.
- Paper: Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting, Shengnan Guo et al. (2019). Enhances spatio-temporal convolutional traffic forecasting by incorporating attention mechanisms across multiple temporal periodicities.
- Paper: Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting, Lei Bai et al. (2020). Extends network-level traffic prediction by learning node-specific patterns and discovering graph topologies automatically without predefined physical grids or maps.
- Paper: Graph Neural Network for Traffic Forecasting: A Survey, Weiwei Jiang et al. (2021). Provides a comprehensive survey analyzing the transition from grid/image-based CNN traffic models to modern graph neural network architectures.
