CommunicationComplexity.real_pinsker_inequality_of_ac_of_integrable
theoremverifiedimported Lean
Pinsker's inequality under absolute continuity. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$, and write $\mathrm{TV}(\mu,\nu)$ for their total variation distance. Suppose $\mu$ is absolutely continuous with respect to $\nu$, and that the log-likelihood ratio $x \mapsto \log\frac{d\mu}{d\nu}(x)$ is $\mu$-integrable. Then \[ 2\,\mathrm{TV}(\mu,\nu)^2 \;\le\; \int_\Omega \log\frac{d\mu}{d\nu}(x)\,d\mu(x), \] the right-hand side being the Kullback–Leibler divergence of $\mu$ from $\nu$.
Statement
set_option relaxedAutoImplicit false in set_option autoImplicit false in open MeasureTheory in open ProbabilityTheory in open scoped ENNReal in theorem CommunicationComplexity.real_pinsker_inequality_of_ac_of_integrable {Ω : Type*} [MeasurableSpace Ω] (μ ν : Measure Ω) [IsProbabilityMeasure μ] [IsProbabilityMeasure ν] (h_ac : μ ≪ ν) (h_int : Integrable (llr μ ν) μ) : 2 * tvDistance μ ν ^ 2 ≤ ∫ x, llr μ ν x ∂μ
- Source
- TCSlib, `CommunicationComplexity.real_pinsker_inequality_of_ac_of_integrable`
- Lean proof
- By Lucy Horowitz, Timothe Kasriel, Mihir Singhal, from github.com/Shilun-Allan-Li/tcslib at
c8a02591b1e5(Copyright (c) 2026 Lucy Horowitz, Timothe Kasriel, and Mihir Singhal. All rights reserved, Apache-2.0). Compiled here against leanprover/lean4:v4.33.1, Mathlib v4.33.1; written for leanprover/lean4:v4.25.0.CommunicationComplexity.real_pinsker_inequality_of_ac_of_integrable← CommunicationComplexity.real_pinsker_inequality_of_ac_of_integrable (TCSlib/CommunicationComplexity/NewmanTheorem/Pinsker.lean:649): verbatim
- Verified
- 07 Oct 2026
- Axioms
Classical.choiceQuot.soundpropext- Built on 4
- CommunicationComplexity.tvDistance_eq_half_densityAbsIntegral_of_acTotal variation distance via the density's L¹-deviation from one. Let $\mu$ and $\nu$ be probability measures on a measurable space…
- CommunicationComplexity.density_l1_pinsker_le_kl_integralPinsker-type bound via the KL integral. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$ with $\mu$ absolutely…
- CommunicationComplexity.tvDistanceThe total variation distance between two probability measures $\mu$ and $\nu$ on $\Omega$ is defined as $\tfrac{1}{2}$ times the…
- CommunicationComplexity.densityAbsIntegralThe quantity $\mathrm{densityAbsIntegral}(\mu,\nu) := \int |\mathrm{rnDensity}(\mu,\nu)(x) - 1|\,d\nu$ is the $L^1(\nu)$-distance of the…
- Used by 1
- CommunicationComplexity.pinsker_inequality_of_ac_of_integrablePinsker's inequality under absolute continuity. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$, and suppose…
Lean source view module on GitHub
Choose a tactic — a marked line — to see the goals Lean had before and after it, as in Lean’s infoview. Step with ← → or j k.
set_option relaxedAutoImplicit false inset_option autoImplicit false inopen MeasureTheory inopen ProbabilityTheory inopen scoped ENNReal in/-- Real-valued Pinsker inequality under `μ ≪ ν` and integrability of the log-likelihood ratio: `2 · TV(μ, ν)² ≤ ∫ llr μ ν dμ`. -/theorem CommunicationComplexity.real_pinsker_inequality_of_ac_of_integrable {Ω : Type*} [MeasurableSpace Ω] (μ ν : Measure Ω) [IsProbabilityMeasure μ] [IsProbabilityMeasure ν] (h_ac : μ ≪ ν) (h_int : Integrable (llr μ ν) μ) : 2 * tvDistance μ ν ^ 2 ≤ ∫ x, llr μ ν x ∂μ := by have h_tv := tvDistance_eq_half_densityAbsIntegral_of_ac μ ν h_ac have h_l1 := density_l1_pinsker_le_kl_integral μ ν h_ac h_int calc 2 * tvDistance μ ν ^ 2 = (1 / 2 : ℝ) * densityAbsIntegral μ ν ^ 2 := by rw [h_tv] ring _ ≤ ∫ x, llr μ ν x ∂μ := h_l1