CommunicationComplexity.half_densityAbsIntegral_sq_le_integral_klFun_rnDensity
A Pinsker-type inequality for the Radon–Nikodym density. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$ with $\mu$ absolutely continuous with respect to $\nu$, and write $f = \frac{d\mu}{d\nu}$ for the (real-valued) Radon–Nikodym density. Suppose the log-likelihood ratio $x \mapsto \log\frac{d\mu}{d\nu}(x)$ is $\mu$-integrable. Then \[ \frac{1}{2}\left(\int_\Omega \abs{f(x) - 1}\,d\nu(x)\right)^{2} \;\le\; \int_\Omega \bigl(f(x)\log f(x) - f(x) + 1\bigr)\,d\nu(x), \] where the left-hand inner integral is the $L^1(\nu)$-distance of the density from $1$ and the right-hand integrand is the Kullback–Leibler integrand $t \mapsto t\log t - t + 1$.
Statement
set_option relaxedAutoImplicit false in set_option autoImplicit false in open MeasureTheory in open ProbabilityTheory in open scoped ENNReal in theorem CommunicationComplexity.half_densityAbsIntegral_sq_le_integral_klFun_rnDensity {Ω : Type*} [MeasurableSpace Ω] (μ ν : Measure Ω) [IsProbabilityMeasure μ] [IsProbabilityMeasure ν] (h_ac : μ ≪ ν) (h_int : Integrable (llr μ ν) μ) : (1 / 2 : ℝ) * densityAbsIntegral μ ν ^ 2 ≤ ∫ x, InformationTheory.klFun (rnDensity μ ν x) ∂ν
- Source
- TCSlib, `CommunicationComplexity.half_densityAbsIntegral_sq_le_integral_klFun_rnDensity`
- Lean proof
- By Lucy Horowitz, Timothe Kasriel, Mihir Singhal, from github.com/Shilun-Allan-Li/tcslib at
c8a02591b1e5(Copyright (c) 2026 Lucy Horowitz, Timothe Kasriel, and Mihir Singhal. All rights reserved, Apache-2.0). Compiled here against leanprover/lean4:v4.33.1, Mathlib v4.33.1; written for leanprover/lean4:v4.25.0.CommunicationComplexity.half_densityAbsIntegral_sq_le_integral_klFun_rnDensity← CommunicationComplexity.half_densityAbsIntegral_sq_le_integral_klFun_rnDensity (TCSlib/CommunicationComplexity/NewmanTheorem/Pinsker.lean:600): verbatim
- Verified
- 07 Oct 2026
- Axioms
Classical.choiceQuot.soundpropext- Built on 7
- CommunicationComplexity.integrable_rnDensityIntegrability of the Radon–Nikodym density. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$, and let…
- CommunicationComplexity.half_integral_abs_sub_one_sq_le_integral_klFunA Pinsker-type inequality for the Kullback–Leibler generator. Let $(\Omega, \mu)$ be a probability space, and let…
- CommunicationComplexity.rnDensityFor two probability measures $\mu$ and $\nu$ on a measurable space $\Omega$, the Radon-Nikodym density…
- CommunicationComplexity.measurable_rnDensityMeasurability of the Radon–Nikodym density. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$, and consider the…
- CommunicationComplexity.rnDensity_nonnegNonnegativity of the Radon–Nikodym density. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$. Then at every…
- CommunicationComplexity.densityAbsIntegralThe quantity $\mathrm{densityAbsIntegral}(\mu,\nu) := \int |\mathrm{rnDensity}(\mu,\nu)(x) - 1|\,d\nu$ is the $L^1(\nu)$-distance of the…
- CommunicationComplexity.integral_rnDensity_eq_one_of_acIntegral of the Radon–Nikodym derivative equals one. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$, and…
- Used by 1
- CommunicationComplexity.density_l1_pinsker_le_kl_integralPinsker-type bound via the KL integral. Let $\mu$ and $\nu$ be probability measures on a measurable space $\Omega$ with $\mu$ absolutely…
Lean source view module on GitHub
Choose a tactic — a marked line — to see the goals Lean had before and after it, as in Lean’s infoview. Step with ← → or j k.
set_option relaxedAutoImplicit false inset_option autoImplicit false inopen MeasureTheory inopen ProbabilityTheory inopen scoped ENNReal in/-- If `μ ≪ ν` and the log-likelihood ratio is `μ`-integrable, then `½ (∫ |dμ/dν − 1| dν)² ≤ ∫ klFun (dμ/dν) dν`; this is `half_integral_abs_sub_one_sq_le_integral_klFun` applied to the density `dμ/dν`. -/theorem CommunicationComplexity.half_densityAbsIntegral_sq_le_integral_klFun_rnDensity {Ω : Type*} [MeasurableSpace Ω] (μ ν : Measure Ω) [IsProbabilityMeasure μ] [IsProbabilityMeasure ν] (h_ac : μ ≪ ν) (h_int : Integrable (llr μ ν) μ) : (1 / 2 : ℝ) * densityAbsIntegral μ ν ^ 2 ≤ ∫ x, InformationTheory.klFun (rnDensity μ ν x) ∂ν := by have h_kl_int : Integrable (fun x => InformationTheory.klFun (rnDensity μ ν x)) ν := by simpa [rnDensity] using (InformationTheory.integrable_klFun_rnDeriv_iff (μ := μ) (ν := ν) h_ac).2 h_int simpa [densityAbsIntegral] using half_integral_abs_sub_one_sq_le_integral_klFun (μ := ν) (f := rnDensity μ ν) (measurable_rnDensity μ ν) (integrable_rnDensity μ ν) h_kl_int (rnDensity_nonneg μ ν) (integral_rnDensity_eq_one_of_ac μ ν h_ac)