Built independently by an author, for readers. Read the story and support ChapterPal
ChapterPal Logo
Log inSign up

keyword

Detectability Index

The detectability index is a standardized metric used in detection theory and statistical classification to quantify how easily an observer or automated system can differentiate a target signal from background noise. It measures the statistical separation between the probability distributions of signal-present and signal-absent conditions, typically defined as the difference between their means normalized by their standard deviation. A higher index value indicates stronger discriminability and greater ease of detection, while a value of zero represents performance at chance level. Crucially, the detectability index evaluates the intrinsic sensitivity of a detection method independently of decision criteria and response biases, making it a foundational measure for assessing classification performance across artificial intelligence, sensory evaluation, and diagnostic screening.

1 item

Detecting AI-Generated Text: Factors Influencing Detectability with Current Methods

Detecting AI-Generated Text: Factors Influencing Detectability with Current Methods

Kathleen C. Fraser, Hillary Dawkins, Svetlana Kiritchenko

OrganizationsNational Research Council Canada

Why you should read this

Presents a comprehensive review of state-of-the-art AI-generated text detection methods, datasets, and practical factors that govern how reliably machine-written content can be identified across real-world scenarios.

Large language models (LLMs) have advanced to a point that even humans have difficulty discerning whether a text was generated by another human, or by a computer. However, knowing whether a text was produced by human or artificial intelligence (AI) is important to determining its trustworthiness, and has applications in many domains including detecting fraud and academic dishonesty, as well as combating the spread of misinformation and political propaganda. The task of AI-generated text (AIGT) detection is therefore both very challenging, and highly critical. In this survey, we summarize state-of-the art approaches to AIGT detection, including watermarking, statistical and stylistic analysis, and machine learning classification. We also provide information about existing datasets for this task. Synthesizing the research findings, we aim to provide insight into the salient factors that combine to determine how “detectable” AIGT text is under different scenarios, and to make practical recommendations for future work towards this significant technical and societal challenge.

Added

2026-09-26