CommunicationComplexity.pinsker_inequality_of_ac
theoremverifiedimported Lean
Pinsker's inequality under absolute continuity. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$, and suppose that $\mu$ is absolutely continuous with respect to $\nu$. Then the total variation distance $\mathrm{TV}(\mu,\nu)$ and the Kullback–Leibler divergence $D_{\mathrm{KL}}(\mu \,\|\, \nu)$ (both taking values in $[0,\infty]$) satisfy \[ 2\,\mathrm{TV}(\mu,\nu)^2 \le D_{\mathrm{KL}}(\mu \,\|\, \nu). \]
Statement
set_option relaxedAutoImplicit false in set_option autoImplicit false in open MeasureTheory in open ProbabilityTheory in open scoped ENNReal in theorem CommunicationComplexity.pinsker_inequality_of_ac {Ω : Type*} [MeasurableSpace Ω] (μ ν : Measure Ω) [IsProbabilityMeasure μ] [IsProbabilityMeasure ν] (h_ac : μ ≪ ν) : ENNReal.ofReal (2 * tvDistance μ ν ^ 2) ≤ InformationTheory.klDiv μ ν
- Source
- TCSlib, `CommunicationComplexity.pinsker_inequality_of_ac`
- Lean proof
- By Lucy Horowitz, Timothe Kasriel, Mihir Singhal, from github.com/Shilun-Allan-Li/tcslib at
c8a02591b1e5(Copyright (c) 2026 Lucy Horowitz, Timothe Kasriel, and Mihir Singhal. All rights reserved, Apache-2.0). Compiled here against leanprover/lean4:v4.33.1, Mathlib v4.33.1; written for leanprover/lean4:v4.25.0.CommunicationComplexity.pinsker_inequality_of_ac← CommunicationComplexity.pinsker_inequality_of_ac (TCSlib/CommunicationComplexity/NewmanTheorem/Pinsker.lean:680): verbatim
- Verified
- 07 Oct 2026
- Axioms
Classical.choiceQuot.soundpropext- Built on 2
- CommunicationComplexity.tvDistanceThe total variation distance between two probability measures $\mu$ and $\nu$ on $\Omega$ is defined as $\tfrac{1}{2}$ times the…
- CommunicationComplexity.pinsker_inequality_of_ac_of_integrablePinsker's inequality under absolute continuity. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$, and suppose…
- Used by 1
- CommunicationComplexity.pinsker_inequalityPinsker's inequality. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$, and let $\mathrm{TV}(\mu,\nu)$ denote…
Lean source view module on GitHub
Choose a tactic — a marked line — to see the goals Lean had before and after it, as in Lean’s infoview. Step with ← → or j k.
set_option relaxedAutoImplicit false inset_option autoImplicit false inopen MeasureTheory inopen ProbabilityTheory inopen scoped ENNReal in/-- Pinsker's inequality in `ℝ≥0∞` form under `μ ≪ ν`: `2 · TV(μ, ν)² ≤ KL(μ ‖ ν)`; when the log-likelihood ratio is not integrable the divergence is `∞`. -/theorem CommunicationComplexity.pinsker_inequality_of_ac {Ω : Type*} [MeasurableSpace Ω] (μ ν : Measure Ω) [IsProbabilityMeasure μ] [IsProbabilityMeasure ν] (h_ac : μ ≪ ν) : ENNReal.ofReal (2 * tvDistance μ ν ^ 2) ≤ InformationTheory.klDiv μ ν := by by_cases h_int : Integrable (llr μ ν) μ · exact pinsker_inequality_of_ac_of_integrable μ ν h_ac h_int · rw [InformationTheory.klDiv_of_not_integrable h_int] exact le_top