Built independently by an author, for readers. Read the story and support ChapterPal

keyword

large time series models

Large time series models are deep learning foundation models pre-trained on vast and diverse collections of sequential temporal data to perform a wide range of time series analysis tasks. Analogous to large language models, these architectures, typically built upon scalable transformer frameworks, learn generalized representations of temporal dynamics and dependencies across varied domains rather than being engineered from scratch for a single dataset. By unifying distinct analytical tasks such as forecasting, imputation, classification, and anomaly detection into generalized pre-training and inference paradigms, large time series models provide high scalability, cross-domain transferability, and strong zero-shot or few-shot generalization capabilities across unseen environments.

1 item

Timer: Generative Pre-trained Transformers Are Large Time Series Models

Timer: Generative Pre-trained Transformers Are Large Time Series Models

Yong Liu, Haoran Zhang, Chenyu Li, Xiangdong Huang, Jianmin Wang, Mingsheng Long

OrganizationsTsinghua University

Why you should read this

Presents a billion-point pre-trained GPT-style model that unifies diverse time series forecasting, imputation, and anomaly detection into next-token prediction to deliver strong few-shot and zero-shot performance across heterogeneous domains.

Deep learning has contributed remarkably to the advancement of time series analysis. Still, deep models can encounter performance bottlenecks in real-world data-scarce scenarios, which can be concealed due to the performance saturation with small models on current benchmarks. Meanwhile, large models have demonstrated great powers in these scenarios through large-scale pre-training. Continuous progress has been achieved with the emergence of large language models, exhibiting unprecedented abilities such as few-shot generalization, scalability, and task generality, which are however absent in small deep models. To change the status quo of training scenario-specific small models from scratch, this paper aims at the early development of large time series models (LTSM). During pre-training, we curate large-scale datasets with up to 1 billion time points, unify heterogeneous time series into single-series sequence (S3) format, and develop the GPT-style architecture toward LTSMs. To meet diverse application needs, we convert forecasting, imputation, and anomaly detection of time series into a unified generative task. The outcome of this study is a Time Series Transformer (Timer), which is generative pre-trained by next token prediction and adapted to various downstream tasks with promising capabilities as an LTSM. Code and datasets are available at: https://github.com/thuml/Large-Time-Series-Model.

Added

2026-09-26