Built independently by an author, for readers. Read the story and support ChapterPal

keyword

sample-wise bias

Sample-wise bias refers to a systematic distortion, confounding factor, or spurious correlation associated with individual data points in a machine learning dataset rather than the aggregate dataset as a whole. In predictive modeling and computer vision, it characterizes how specific instances contain misleading, non-causal cues—such as confounding background elements, demographic attributes, or co-occurring context—that cause a model to rely on unintended shortcuts during learning or inference. Identifying and evaluating bias at the sample level enables practitioners to detect fine-grained failure patterns, assign granular subgroup labels to individual examples, and apply targeted debiasing strategies such as instance reweighting, data filtering, or distributionally robust optimization to improve overall fairness and generalization.

1 item

Discovering and Mitigating Visual Biases Through Keyword Explanation

Discovering and Mitigating Visual Biases Through Keyword Explanation

Younghyun Kim, Sangwoo Mo, Minkyu Kim, Kyungmin Lee, Jaeho Lee, Jinwoo Shin

OrganizationsKorea Advanced Institute of Science and TechnologyKraftonPohang University of Science and TechnologyUniversity of Michigan

Why you should read this

Proposes the Bias-to-Text framework to automatically discover and explain visual shortcuts in image classifiers as interpretable keywords from mispredicted captions, enabling direct applications in debiased training and model comparison without human supervision.

Addressing biases in computer vision models is crucial for real-world AI deployments. However, mitigating visual biases is challenging due to their unexplainable nature, often identified indirectly through visualization or sample statistics, which necessitates additional human supervision for interpretation. To tackle this issue, we propose the Bias-to-Text (B2T) framework, which interprets visual biases as keywords. Specifically, we extract common keywords from the captions of mispredicted images to identify potential biases in the model. We then validate these keywords by measuring their similarity to the mispredicted images using a vision-language scoring model. The keyword explanation form of visual bias offers several advantages, such as a clear group naming for bias discovery and a natural extension for debiasing using these group names. Our experiments demonstrate that B2T can identify known biases, such as gender bias in CelebA, background bias in Waterbirds, and distribution shifts in ImageNet-R/C. Additionally, B2T uncovers novel biases in larger datasets, such as Dollar Street and ImageNet. For example, we discovered a contextual bias between “bee” and “flower” in ImageNet. We also highlight various applications of B2T keywords, including debiased training, CLIP prompting, and model comparison.

Added

2026-09-26