Built independently by an author, for readers. Read the story and support ChapterPal

keyword

negative commonsense knowledge

Negative commonsense knowledge refers to the shared, intuitive understanding of facts, properties, and relationships that are untrue, invalid, or physically implausible in the everyday world. While positive commonsense knowledge captures what entities naturally are or do, negative commonsense knowledge encompasses the self-evident realities of what they are not or do not do, such as terrestrial animals not inhabiting oceans or inanimate objects lacking biological functions. Because humans take these negative facts for granted and rarely express obvious non-occurrences in everyday communication, negative commonsense knowledge remains largely implicit in written text, presenting distinct challenges for artificial intelligence systems when modeling real-world constraints and plausibility.

1 item

Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledge

Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledge

Jiangjie Chen, Wei Shi, Ziquan Fu, Sijie Cheng, Lei Li, Yanghua Xiao

OrganizationsBrain Technologies, Inc.Fudan-Aishu Cognitive Intelligence Joint Research CenterFudan UniversitySystem Inc.University of California, Santa Barbara

Why you should read this

Reveals a fundamental belief conflict in large language models where they correctly answer yes-or-no questions about negative commonsense facts yet fail to generate text incorporating that same negative knowledge due to pre-training reporting biases.

Large language models (LLMs) have been widely studied for their ability to store and utilize positive knowledge. However, negative knowledge, such as “lions don’t live in the ocean”, is also ubiquitous in the world but rarely mentioned explicitly in the text. What do LLMs know about negative knowledge? This work examines the ability of LLMs to negative commonsense knowledge. We design a constrained keywords-to-sentence generation task (CG) and a Boolean question-answering task (QA) to probe LLMs. Our experiments reveal that LLMs frequently fail to generate valid sentences grounded in negative commonsense knowledge, yet they can correctly answer polar yes-or-no questions. We term this phenomenon the belief conflict of LLMs. Our further analysis shows that statistical shortcuts and negation reporting bias from language modeling pre-training cause this conflict.

Added

2026-09-26