mutual_f_information
def
For a joint probability mass function p_{XY} on finite sets, the mutual f-information is Ĩ_f(X; Y) = D_f(p_{XY} ‖ p_X p_Y) = Σ_{x,y} p_X(x) p_Y(y) f(p_{XY}(x, y) / (p_X(x) p_Y(y))), where p_X, p_Y are the marginals (terms with p_X(x) p_Y(y) = 0 vanish).
Statement
noncomputable def mutual_f_information {X Y : Type*} [Fintype X] [Fintype Y] (f : ℝ → ℝ) (p : X → Y → ℝ) : ℝ
- Defined in
- arXiv:2610.21231 (On the subadditivity of mutual f-information), Sec. I (definition of the mutual f-information Ĩ_f).
- Verified
- 16 Oct 2026
- Axioms
- none listed
- Used by 15
- jensen_shannon_binary_cid_not_subadditiveThere exists a binary Markov chain with conditionally identically distributed observations Y, Z given X where the unregularized…
- mutual_power_divergence_binary_subadditive_imp_golden_ratio_leFor any positive exponent beta, if the mutual power-divergence information with generator f_beta satisfies subadditivity for all binary…
- mutual_f_theta_selfΘ_{p_X,p_{Y|X}}(p_X) = Ĩ_f(X;Y) when f(1) = 0 (step (17)-(18) of the proof of Theorem 1 of arXiv:2610.21231).
- mutual_power_divergence_information_eq_sum_rpowFor β ∈ (0, 1) and a joint probability mass function p_{XY}, the mutual f_β-information equals (Σ_{x,y} p(x, y)^β (p_X(x) p_Y(y))^{1−β} −…
- mutual_f_information_subadditive_full_supportSubadditivity of mutual f-information on full-support distributions: for all finite X, Y, Z, every p_X > 0 and channels p_{Y|X} > 0,…
- mutual_power_divergence_information_not_subadditive_quarterSubadditivity fails for the power divergence with β = 1/4: there are random variables X, Y, Z on three-element alphabets with Y ← X → Z…
- mutual_f_information_subadditive_full_support_of_weight_boundTheorem 1 of arXiv:2610.21231, on full-support distributions. Let f with f(1) = 0 be convex and four times continuously differentiable on…
- mutual_f_information_of_independentIf f(1) = 0 and X, Y are independent (p_{XY}(x, y) = a(x) b(y) with a, b summing to 1), then Ĩ_f(X; Y) = 0.
- not_mutual_f_information_subadditive_hellingerThe mutual f-information is not subadditive for the Hellinger generator (power divergence with parameter 1/2).
- mutual_f_information_subadditive_full_support_zeroSanity: the zero generator f = 0 is subadditive on full-support distributions (every mutual f-information is 0).
- power_divergence_exists_binary_counterexample_of_lt_golden_ratioFor every exponent beta in (0, (sqrt 5 - 1)/2), there exist strictly positive binary probability mass functions pX, PY, PZ forming a…
- mutual_power_divergence_not_subadditive_of_lt_golden_ratioFor every exponent beta in (0, (sqrt 5 - 1)/2), the mutual power-divergence information with generator f_beta fails to be subadditive…
- mutual_f_information_markov_sub_eq_sum_thetaFor a full-support Markov chain Y → X → Z, Ĩ_f(X;YZ) - Ĩ_f(X;Z) = Σ_z p_Z(z) Θ_{p_X,p_{Y|X}}(p_{X|Z=z}) (eq. (13) of arXiv:2610.21231).
- mutual_hellinger_information_not_subadditiveSubadditivity fails in the Hellinger case β = 1/2: there are binary random variables X, Y, Z with Y ← X → Z and Ĩ_{f_{1/2}}(X; YZ) >…
- mutual_f_information_subadditiveA function f is a subadditive generator for mutual f-information if for all finite random variables X, Y, Z forming a Markov chain Y -> X…
Lean source view module on GitHub
/-- Mutual `f`-information `D_f(p_{XY} ‖ p_X ⊗ p_Y)` of a joint mass function `p : X → Y → ℝ` (terms with a zero marginal vanish). -/ noncomputable def mutual_f_information {X Y : Type*} [Fintype X] [Fintype Y] (f : ℝ → ℝ) (p : X → Y → ℝ) : ℝ := ∑ x, ∑ y, (∑ y', p x y') * (∑ x', p x' y) * f (p x y / ((∑ y', p x y') * (∑ x', p x' y)))