Sequential Kernel-based Conditional Independence Testing via Adaptive Betting
A more reliable way to test when two things are truly independent
Researchers developed a new statistical test that can reliably detect when two variables are independent of each other, even when the underlying assumptions are slightly wrong. The method combines adaptive betting with a kernel-based statistic and a new calibration strategy, reducing false alarms by up to 70% compared to existing approaches while maintaining the ability to find real patterns in both simulated and real-world fairness datasets.
Conditional independence testing underpins decisions in machine learning, fairness auditing, and causal inference. When these tests give false positives—declaring variables independent when they're not—they can lead to flawed models and unfair automated decisions. This method works reliably even when the assumed model has small errors, which is almost always the case in practice, making it directly usable in real applications rather than just theoretical settings.