Built independently by an author, for readers. Read the story and support ChapterPal

keyword

Neural Basis Models

Neural Basis Models are a class of inherently interpretable machine learning architectures within the generalized additive model framework that represent feature effects using a shared set of basis functions learned by a neural network. Instead of learning an independent non-linear shape function for every individual input variable, a neural basis model utilizes a single neural network to jointly learn a compact dictionary of continuous basis functions across all features, reconstructing each feature effect as a linear combination of these shared bases. This basis decomposition substantially reduces parameter complexity and computational overhead, allowing the architecture to scale efficiently to high-dimensional datasets while maintaining exact, transparent interpretability and supporting higher-order feature interactions.

1 item

Neural Basis Models for Interpretability

Neural Basis Models for Interpretability

Filip Radenovic, Abhimanyu Dubey, Dhruv Mahajan

OrganizationsMeta

Why you should read this

Proposes Neural Basis Models, an inherently interpretable architecture that shares a compact set of learned basis functions across features to achieve state-of-the-art Generalized Additive Model accuracy while drastically reducing parameter count and scaling to high-dimensional datasets.

Due to the widespread use of complex machine learning models in real-world applications, it is becoming critical to explain model predictions. However, these models are typically black-box deep neural networks, explained post-hoc via methods with known faithfulness limitations. Generalized Additive Models (GAMs) are an inherently interpretable class of models that address this limitation by learning a non-linear shape function for each feature separately, followed by a linear model on top. However, these models are typically difficult to train, require numerous parameters, and are difficult to scale. We propose an entirely new subfamily of GAMs that utilizes basis decomposition of shape functions. A small number of basis functions are shared among all features, and are learned jointly for a given task, thus making our model scale much better to large-scale data with high-dimensional features, especially when features are sparse. We propose an architecture denoted as the Neural Basis Model (NBM) which uses a single neural network to learn these bases. On a variety of tabular and image datasets, we demonstrate that for interpretable machine learning, NBMs are the state-of-the-art in accuracy, model size, and, throughput and can easily model all higher-order feature interactions. Source code is available at github.com/facebookresearch/nbm-spam.

Added

2026-09-26