ICLabel: An automated electroencephalographic independent component classifier, dataset, and website
Luca Pion-TonachiniKen Kreutz-DelgadoScott Makeig
Introduces ICLabel, an automated EEG independent component classifier backed by a crowdsourced dataset of over 200,000 components that achieves state-of-the-art source categorization accuracy ten times faster than previous public methods.
Electroencephalography provides an accessible, non-invasive method to monitor brain dynamics, but recorded scalp signals invariably mix cortical activity with physiological and non-biological artifacts such as muscle contractions, eye movements, and electrical interference. While independent component analysis successfully separates these mixed recordings into distinct signal sources, the resulting components lack intrinsic labels or ordering. Manually inspecting and categorizing these components is subjective, time-intensive, and impractical for large-scale studies or real-time systems. This article evaluated whether an automated classifier, trained on large-scale crowdsourced annotations, could accurately categorize independent components across multiple categories while maintaining the computational speed required for real-time applications.
The authors developed the ICLabel project, which comprises a massive dataset of over 200,000 independent components drawn from 6,352 recordings, an interactive educational website that collected more than 34,000 component labels from over 250 contributors, and a neural network classifier. Crowdsourced labels were aggregated into probabilistic true-label estimates using an advanced consensus algorithm, yielding nearly 6,000 annotated training examples. The authors trained and cross-validated six candidate artificial neural network architectures and evaluated the final selected models against existing publicly available classifiers on an independent test set of 130 components labeled by six domain experts across diverse experimental conditions.
The evaluation revealed several key findings regarding accuracy, computational efficiency, and architectural choices. First, the final classifier matched or exceeded the accuracy of the best publicly available baseline across standard evaluation metrics, showing particular strength in identifying eye and muscle artifacts. Second, the proposed tool proved roughly ten times faster than the leading automated baseline, processing components in a median time of 170 milliseconds compared to 1.8 seconds. Third, a streamlined variant that omitted autocorrelation features reduced processing time to 120 milliseconds with minimal loss in accuracy. Finally, convolutional neural network architectures that placed double optimization weight on cortical brain components consistently outperformed alternative models, including generative adversarial networks.
These results demonstrate that high-throughput, accurate component classification can be integrated directly into automated preprocessing pipelines and near-real-time brain-computer interfaces without human intervention. The classifier outputs continuous class probabilities across seven categories—including brain, muscle, eye, heart, line noise, and channel noise—allowing practitioners to preserve nuance in ambiguous components or apply custom decision thresholds based on specific experimental needs.
Organizations and researchers processing multichannel electroencephalographic data should integrate the publicly available tool into automated data workflows to reduce manual analysis costs and enhance analytical consistency across studies. Where execution speed is paramount, the streamlined variant offers a practical alternative. Future development should automate periodic model retraining as the crowdsourced database grows and establish recursive feature extraction algorithms to support streaming, causal applications.
Users should exercise caution when applying the model to populations not represented in the training data, such as infant cohorts or clinical populations with significant structural brain trauma, where component properties may differ substantially. In addition, the expert validation set contained limited examples for rare categories like heart-related artifacts and was constrained to a relatively small sample size. Nevertheless, the classifier provides high confidence and strong reliability across standard adult research paradigms.
- Paper: Independent Component Analysis of Electroencephalographic Data, Scott Makeig et al. (1995). This foundational paper establishes the use of Independent Component Analysis (ICA) for separating neural and artifact sources in EEG data, which forms the direct premise and domain background for ICLabel.
- Paper: EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces, Vernon J. Lawhern et al. (2016). This work develops compact convolutional architectures tailored to EEG classification, providing important background on deep learning methodologies designed for electroencephalographic signal features.
- Paper: LabelMe: A Database and Web-Based Tool for Image Annotation, Bryan C. Russell et al. (2008). This paper presents the methodology of building web-based platforms for crowdsourcing expert annotations at scale, an approach directly adapted by the ICLabel project to curate its 200,000+ component dataset.
- Paper: 1D Convolutional Neural Networks and Applications: A Survey, Serkan Kiranyaz et al. (2019). This survey examines the broader architectural design and engineering applications of 1D convolutional neural networks across biomedical and physical signals, expanding beyond specific EEG multi-component pipelines.
