Weakly supervised causal representation learning
Johann BrehmerPim de HaanPhillip LippeTaco S. Cohen
Proves that high-level causal variables and mechanisms can be identified from pixel-level data paired across unknown interventions, and introduces implicit latent causal models to learn these structures without optimizing discrete graphs.
Modern autonomous systems, such as robotics and self-driving vehicles, must understand high-level causal relationships directly from raw, unstructured sensory inputs like camera feeds. Unsupervised learning cannot uniquely identify underlying causal variables and their structures from passive observational data alone. Standard causal discovery approaches typically require active interventions or explicit labels detailing what changed, both of which are costly and difficult to obtain in large-scale settings.
The article demonstrates that weak supervision—specifically paired observations collected before and after random, unlabeled interventions—is sufficient to uniquely identify latent causal variables and their governing structural models. The authors establish a formal mathematical proof showing that latent causal models are identifiable up to variable reordering and scaling. To translate this theoretical proof into a practical system, the article introduces Implicit Latent Causal Models (ILCMs). These models represent causal relationships implicitly within the neural network's transformation functions, avoiding the severe optimization pitfalls of jointly learning explicit causal graphs alongside latent variables.
Evaluation was conducted across multiple environments, including a two-dimensional synthetic benchmark, an altered 3D object rendering suite (Causal3DIdent), and a simulated robotic manipulation environment (CausalCircuit). Across these benchmarks, ILCMs achieved near-perfect disentanglement scores ranging from 0.97 to 0.99, while accurately identifying intervention targets with 96% to 100% precision. In contrast, standard disentanglement baselines that ignore causal structure achieved disentanglement scores as low as 0.34 to 0.35 and frequently reconstructed incorrect causal graphs. Additionally, empirical scaling tests showed that the method reliably recovers causal graphs in systems containing up to approximately 10 continuous variables.
These findings prove that artificial intelligence systems can discover true cause-and-effect relationships from passive demonstrations—such as video footage of an operator manipulating tools—without manual labeling. This capability reduces the human annotation burden and lowers the operational risk of deploying autonomous agents by enabling them to accurately predict downstream effects and evaluate hypothetical counterfactual scenarios. However, the framework currently requires strict boundary conditions: it assumes continuous real-valued variables and perfect single-variable interventions where background noise remains consistent. Performance drops significantly when handling discrete states or scaling beyond 10 variables.
Organizations evaluating this technology should treat it as an enabling foundational concept rather than an off-the-shelf production tool. Technical teams should conduct pilot studies on constrained, continuous-state robotic pipelines while directing future research toward relaxing theoretical assumptions to support discrete attributes, multi-variable interventions, and real-world temporal video feeds.
- Paper: Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations, Francesco Locatello et al. (2018). Its impossibility result for unsupervised disentanglement clarifies why this paper needs paired intervention data to identify causal representations.
- Paper: Nonparametric Identifiability of Causal Representations from Unknown Interventions, Julius von Kügelgen et al. (2023). It extends the identifiability question to a nonparametric setting with unknown isolated interventions, building on the weak-supervision framework developed here.
