InceptionTime: Finding AlexNet for time series classification
Hassan Ismail FawazBenjamin LucasGermain ForestierCharlotte PelletierDaniel F. SchmidtJonathan WeberGeoffrey I. WebbLhassane IdoumgharPierre-Alain MullerFrançois Petitjean
Introduces InceptionTime, an ensemble of deep convolutional neural networks that matches the state-of-the-art accuracy of HIVE-COTE for time series classification while training orders of magnitude faster and scaling to millions of sequences.
Modern organizations across healthcare, remote sensing, and activity recognition are generating unprecedented volumes of time series data. Extracting value from this data requires accurate and automated time series classification, which assigns categories to temporal sequences. While traditional algorithms such as HIVE-COTE deliver high classification accuracy, their extreme computational complexity makes training on massive, real-world datasets practically impossible.
The article introduces and evaluates InceptionTime, an ensemble of deep convolutional neural networks designed to achieve top-tier classification accuracy while drastically reducing training time. The study demonstrates the model's accuracy, scalability, and architectural design principles across standardized benchmarks and synthetic datasets.
To evaluate performance, the authors tested InceptionTime on 85 datasets from the public UCR time series archive and a synthetic dataset designed to isolate parameters such as sequence length and class count. InceptionTime combines five deep neural network models with identical architectures but different random weight initializations, using multiple parallel filters of varying lengths within specialized Inception modules to capture both short and long patterns.
The findings show that InceptionTime achieves classification accuracy on par with the class-leading HIVE-COTE algorithm, winning or tying on 46 of the 85 UCR benchmark datasets with no statistically significant difference in overall error. Crucially, InceptionTime is orders of magnitude faster: on a dataset of 1,500 short series, it trained in 1 hour compared to over 8 days for HIVE-COTE, and it successfully trained on 8 million series in 13 hours—a scale completely inaccessible to traditional methods. It also significantly outperforms the previous best deep learning ensemble, ResNet, winning 54 out of 85 dataset comparisons. Furthermore, architectural tests revealed that incorporating long filter lengths directly expands the model's receptive field to capture long temporal patterns effectively, while ensembling five models provides an optimal trade-off between variance reduction and computational overhead.
These results demonstrate that enterprises no longer need to compromise between high accuracy and computational feasibility in time series analytics. InceptionTime eliminates severe operational bottlenecks by leveraging standard graphics processing unit hardware, making large-scale automated monitoring, diagnostic tools, and predictive maintenance viable and cost-effective.
Organizations handling large-scale time series data should consider adopting InceptionTime as a scalable alternative to traditional ensembles. Data science teams should use an ensemble size of five models to balance training runtime and accuracy, employ bottleneck layers to cut network parameters by roughly half without sacrificing accuracy, and apply transfer learning with fine-tuning when working with small or specialized datasets like spectrography.
While confidence in the model's benchmark performance and scalability is high, the authors note that deeper architectures or excessively long filters can overfit very small datasets due to the limited number of labeled training samples in existing benchmarks. Stakeholders should remain cautious when deploying the model on very small datasets without validating against overfitting or utilizing transfer learning.
- Paper: Deep learning for time series classification: a review, Hassan Ismail Fawaz et al. (2018). This comprehensive benchmark by the same research group establishes deep learning baselines (like ResNet and FCN) on the UCR archive and demonstrates the need to match HIVE-COTE's accuracy with scalable neural networks.
- Paper: Time series classification from scratch with deep neural networks: A strong baseline, Zhiguang Wang et al. (2016). This foundational paper introduced end-to-end fully convolutional and residual architectures for time series classification from raw data, providing the architectural baseline that InceptionTime builds upon and improves.
- Paper: Going Deeper with Convolutions, Christian Szegedy et al. (2015). It introduces the core multi-scale Inception module that InceptionTime directly adapts to 1D temporal convolutions to extract features across various receptive field sizes.
- Paper: Rethinking the Inception Architecture for Computer Vision, Christian Szegedy et al. (2015). It refines Inception module designs and factorization principles that inspired the Inception-v4-based design adapted in InceptionTime.
- Paper: 1D Convolutional Neural Networks and Applications: A Survey, Serkan Kiranyaz et al. (2019). It provides a foundational overview of designing 1D convolutional neural networks for raw sequence and sensor data classification.
- Paper: TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis, Haixu Wu et al. (2023). TimesNet builds upon multi-scale Inception-style architectures by transforming 1D series into 2D temporal variation maps to handle both classification and forecasting tasks.
- Paper: Ensemble deep learning: A review, M. A. Ganaie et al. (2021). This survey provides a broader theoretical and empirical perspective on deep neural network ensembles, analyzing the diversity and variance-reduction mechanisms that underpin InceptionTime's ensembling strategy.
