Prajnanabha Volume 1 Issue 2 · V1I2-A04

White Matter Capacity

Aman Chawla
REAL Institute, Gurugram
Source PDF: tractCapacityv5.pdf

Abstract

This paper develops an explicit capacity analysis of the axon tract modeled as a vector Gaussian communication channel with perfect feedback. Building on the generalized ephaptic equation and its modifications, we show how the tract can be reduced to an effective linear Gaussian channel with feedback eliminated. We then derive finite-block capacity expressions, discuss waterfilling and eigenmode allocation, and extend to the stationary infinite-horizon case. Illustrative examples highlight the role of ephaptic coupling in modifying channel capacity. The work bridges neuroscience and information theory, offering a rigorous framework for quantifying the fundamental limits of communication in axon tracts.

Introduction

The axon tract, a bundle of parallel axons, is traditionally studied in neurobiology as a medium for signal propagation. Recent theoretical work has revealed that such tracts can be viewed through the lens of information theory as communication channels. In particular, ephaptic coupling—the interaction between axons mediated by extracellular fields—introduces cross-talk that resembles multiple-input multiple-output (MIMO) systems.

Chapter 5 of the dissertation [1] introduced two modifications to the generalized ephaptic equation: (i) a position-dependent $W_{ip}(z)$ matrix capturing tomographic geometry, and (ii) an additive Gaussian noise term modeling ionic thermal fluctuations. Together, these modifications yield a tract model that behaves like a vector Gaussian channel with perfect feedback. The present paper develops the explicit capacity analysis of this channel.

Table 1: Table of Notation summarizes the principal symbols and meanings as used in this work.

SymbolMeaning
$V_i(z,t)$Transmembrane voltage of axon $i$ at position $z$, time $t$
$W_{ip}(z)$Position-dependent ephaptic coupling matrix along tract axis
$n_{ip}(z,t)$Additive Gaussian noise term (ionic thermal fluctuations)
$A, B$Coefficient matrices from Crank–Nicolson discretization
$V$Voltage vector (state variable)
$j_{\text{ion}}, j_{\text{stim}}$Ionic current, stimulation current
$K = A^{-1}B$Feedback matrix after inversion
$Y_k$Output state vector at epoch $k$
$X_k$Input stimulus vector at epoch $k$
$N_k$Gaussian noise vector at epoch $k$
$D(\cdot)$Deterministic feedback operator
$H_{\text{eff}}$Effective channel matrix after feedback elimination
$\Sigma_{\text{eff}}$Effective Gaussian noise covariance after feedback elimination
$K_X$Input covariance matrix
$P$Power (stimulation energy) constraint
$C_n(P)$Finite-block capacity with blocklength $n$ and power $P$
$R$Eigenmode matrix for waterfilling allocation
$\lambda_i$Eigenvalues of $R$ (channel gains)
$p_i$Power allocated to eigenmode $i$
$C(P)$Stationary infinite-horizon capacity under power constraint $P$
$S_Z(\omega)$Noise spectral density
$S_{YX}(\omega)$Channel frequency response
$S_X(\omega)$Input spectrum
$c(x) = x^T Q x$Quadratic cost function for input $x$
$Q$Positive-definite cost matrix (energetic/metabolic weighting)
$\mathcal{C}_{\text{uc}}$Verdu capacity per unit cost
$D(P_{Y|X=x}\|P_{Y|X=0})$KL divergence between output distributions
$\lambda_{\text{max}}(\cdot)$Maximum generalized eigenvalue
$K_Y$Output covariance matrix
$K_{XY}$Joint input-output covariance matrix
$I(X;Y)$Classical mutual information between input $X$ and output $Y$
$I_{\text{MMI}}(\cdot)$Multivariate mutual information (total correlation)
$I_{\text{CC}}(Y)$Chung–Chan network multivariate mutual information of tract output
$\mathcal{P}$ (partition)Partition of network nodes for MMI evaluation
Table 1. Table of Notation

Background: Ephaptic Equation and Modifications

The generalized ephaptic equation governs the dynamics of transmembrane voltages $V_i(z,t)$ along axons. Two key modifications were introduced:

Modification A: Position-dependent $W_{ip}(z)$

Tomographic data reveals complex geometrical arrangements of axons. To incorporate this, the interaxonal coupling matrix $W_{ip}$ is made position-dependent: \[ W_{ip} \;\; W_{ip}(z), \] yielding a differentiable matrix function along the tract axis. This allows spatially varying coupling strengths.

Modification B: Additive Gaussian Noise

The extracellular medium contains ions undergoing random thermal motion. This is modeled as additive Gaussian noise $n_{ip}(z,t)$ added to ephaptic signals: \[ \frac{\partial^2 V_i}{\partial z^2} \mapsto \frac{\partial^2 V_i}{\partial z^2} + n_{ip}(z,t). \] This transforms the tract into a noisy communication channel.

Tract as a Vector Gaussian Channel

Discretizing the ephaptic equation via the Crank–Nicolson scheme yields:

$$ [A]\tilde{\mathcal{V}} = [B]V + j_{\text{ion}} + j_{\text{stim}}, $$

where $A$ and $B$ are coefficient matrices, $V$ is the present voltage vector, $\mathcal{V}$ the next-step voltage vector, and $j_{{ion}}, j_{{stim}}$ are ionic and stimulation currents.

Inverting $A$ via singular value decomposition gives:

$$ \tilde{\mathcal{V}} = K V + R m + j_{\text{stim}} - S m - I T_2, $$

with $K = A^{-1}B$, $R$ and $S$ matrices coupling ionic variables, and $T_2$ nonlinear terms. This system can be expressed as:

$$ Y_{k+1} = D(Y_k) + X_{k+1} + N_{k+1}, $$

where $Y_k$ is the output state, $X_{k+1}$ the input stimulus, $D(\cdot)$ deterministic feedback, and $N_{k+1}$ Gaussian noise. Thus, the tract acts as a vector Gaussian channel with perfect feedback.

Feedback Elimination

Because $D(\cdot)$ is deterministic and causal, it can be eliminated by algebraic manipulation. Stacking outputs over $n$ epochs: \[ \mathbf{Y} = \mathbf{D}\mathbf{Y} + \mathbf{G}\mathbf{X} + \mathbf{N}. \] Solving, \[ \mathbf{Y} = (\mathbf{I}-\mathbf{D})^{-1}\mathbf{G}\mathbf{X} + (\mathbf{I}-\mathbf{D})^{-1}\mathbf{N}. \] Define effective channel and noise: \[ \mathbf{H}_{\text{eff}} = (\mathbf{I}-\mathbf{D})^{-1}\mathbf{G}, \Sigma_{\text{eff}} = (\mathbf{I}-\mathbf{D})^{-1}\Sigma_N((\mathbf{I}-\mathbf{D})^{-1})^T. \] The tract reduces to: \[ \mathbf{Y} = \mathbf{H}_{\text{eff}}\mathbf{X} + \mathbf{Z}, \quad \mathbf{Z} \sim \mathcal{N}(0,\Sigma_{\text{eff}}). \]

Finite-block Capacity

For block length $n$, input covariance $\mathbf{K}_X$, and power constraint $\frac{1}{n}\text{tr}(\mathbf{K}_X) \le P$, the capacity is:

$$ C_n(P) = \frac{1}{2n}\log\det\left(I + \Sigma_{\text{eff}}^{-1/2}\mathbf{H}_{\text{eff}}\mathbf{K}_X\mathbf{H}_{\text{eff}}^T\Sigma_{\text{eff}}^{-1/2}\right). $$

Maximization over $\mathbf{K}_X$ yields the optimal allocation.

Waterfilling

Diagonalizing \[ R = \Sigma_{\text{eff}}^{-1/2}\mathbf{H}_{\text{eff}}\mathbf{H}_{\text{eff}}^T\Sigma_{\text{eff}}^{-1/2}, \] reveals eigenmodes. Power is allocated across these modes via waterfilling: \[ p_i = (\mu - \frac{1}{\lambda_i})^+, \] where $\lambda_i$ are eigenvalues of $R$, $\mu$ chosen to satisfy $\sum p_i = P$.

Stationary Infinite-horizon Capacity

If $\mathbf{H}_{\text{eff}}$ and $\Sigma_{\text{eff}}$ are block Toeplitz (stationary), as $n$ capacity per epoch converges to:

$$ C(P) = \frac{1}{4\pi}\int_{-\pi}^{\pi}\log\det\left(I + S_Z(\omega)^{-1/2}S_{YX}(\omega)S_X(\omega)S_{YX}(\omega)^TS_Z(\omega)^{-1/2}\right)d\omega, $$

where $S_Z(\omega)$ is noise spectral density, $S_{YX}(\omega)$ channel frequency response, and $S_X(\omega)$ input spectrum optimized under power constraint.

Illustrative Examples

Without Ephaptic Coupling

Setting $W_{ip}(z)=0$ decouples axons. $\mathbf{H}_{\text{eff}}$ becomes block-diagonal, yielding independent channels. Capacity is sum of individual axon capacities.

With Ephaptic Coupling

Nonzero $W_{ip}(z)$ introduces cross-terms, enlarging $\mathbf{H}_{\text{eff}}$. Eigenvalues of $R$ increase, allowing higher capacity via spatial multiplexing. Thus, ephaptic coupling can enhance tract capacity.

Discussion

The tract capacity analysis reveals several insights:

Capacity per Unit Cost: Verdu Regime

Motivation

In biological communication systems, energetic efficiency rather than average power is often the fundamental constraint. Ionic pumping, membrane recovery, and stimulation currents incur a metabolic cost that scales with signal amplitude and duration. This motivates analyzing the capacity per unit cost, as introduced by Verdu, which characterizes the maximum achievable information rate per unit energetic expenditure in the low-cost regime.

This framework is particularly relevant for axon tracts, where signaling is often sparse and near-resting, and where efficiency constraints may dominate over raw throughput.

Effective Channel Model

From Section 4, the axon tract reduces to an equivalent memoryless vector Gaussian channel with deterministic feedback eliminated:

$$ Y = H_{\mathrm{eff}} X + Z, $$

where $Z \sim \mathcal{N}(0,\Sigma_{\text{eff}})$ and $X \in \mathbb{R}^m$ denotes the stimulation input vector.

We assume the existence of a zero-cost input symbol $X=0$, corresponding to the resting state of the tract.

Cost Function

We associate a quadratic cost function to each input:

$$ c(x) = x^{T} Q x, $$

where $Q \succ 0$ is a symmetric positive-definite matrix modeling energetic or metabolic cost. The choice $Q=I$ corresponds to isotropic energy expenditure, while diagonal $Q$ allows axon-dependent energetic efficiencies.

Verdu Capacity per Unit Cost

For a memoryless channel with a zero-cost input, Verdu showed that the capacity per unit cost is given by

$$ \mathcal{C}_{\mathrm{uc}} = \sup_{x \neq 0} \frac{ D\!\left( P_{Y|X=x} \,\|\, P_{Y|X=0} \right) }{ c(x) }, $$

where $D(\cdot\|\cdot)$ denotes the Kullback–Leibler divergence.

This expression characterizes the slope of the capacity–cost curve at zero cost and avoids explicit blocklength optimization.

Evaluation for the Axon Tract

For the effective Gaussian channel,

$$ \begin{align} Y|X=x &\sim \mathcal{N}(H_{\mathrm{eff}}x,\Sigma_{\mathrm{eff}}), Y|X=0 &\sim \mathcal{N}(0,\Sigma_{\mathrm{eff}}). \end{align} $$

The KL divergence evaluates to

$$ D = \frac{1}{2} x^{T} H_{\mathrm{eff}}^{T} \Sigma_{\mathrm{eff}}^{-1} H_{\mathrm{eff}} x. $$

Substituting into Verdu's formula yields

$$ \mathcal{C}_{\mathrm{uc}} = \sup_{x \neq 0} \frac{ \frac{1}{2} x^{T} H_{\mathrm{eff}}^{T} \Sigma_{\mathrm{eff}}^{-1} H_{\mathrm{eff}} x }{ x^{T} Q x }. $$

Generalized Eigenvalue Characterization

The supremum is achieved by the principal generalized eigenvector of the matrix pair

$$ \left( H_{\mathrm{eff}}^{T}\Sigma_{\mathrm{eff}}^{-1}H_{\mathrm{eff}}, \; Q \right). $$

Hence, the capacity per unit cost admits the closed-form expression

$$ \boxed{ \mathcal{C}_{\mathrm{uc}} = \frac{1}{2} \lambda_{\max} \!\left( Q^{-1/2} H_{\mathrm{eff}}^{T} \Sigma_{\mathrm{eff}}^{-1} H_{\mathrm{eff}} Q^{-1/2} \right) } $$

in nats per unit cost. Division by $ 2$ converts this quantity to bits per unit cost.

Relation to Power-Constrained Capacity

Let $C(P)$ denote the power-constrained capacity derived in Sections 5 and 6. Then

$$ \mathcal{C}_{\mathrm{uc}} = \lim_{P \to 0} \frac{C(P)}{P}, $$

showing that the Verdu regime corresponds to the low-power limit of the classical capacity expression.

Implications for Axon Tracts

The capacity per unit cost provides a sharp efficiency bound for tract-level communication:

Relation to Berger–Levy Energy-Efficient Neural Communication

Overview

Berger and Levy [2] developed a seminal information-theoretic theory of neural communication focused on single-neuron spike timing codes optimized for bits per joule. Their framework models a neuron as a stochastic encoder that converts afferent excitation into interspike intervals (ISIs), with optimization performed over ISI distributions under explicit metabolic cost constraints.

The present work addresses a complementary but fundamentally distinct problem: the collective communication capacity of an axon tract, modeled as a vector Gaussian channel with ephaptic coupling and perfect feedback. This section clarifies the relationship between the two formulations and delineates their respective domains of validity.

Level of Description

A primary distinction lies in the level at which communication is modeled.

Thus, Berger–Levy operate at the level of discrete spike events and their timing statistics, whereas the present formulation operates at the level of spatially extended, analog biophysical fields prior to spike generation.

Channel Models

The underlying channel models differ both structurally and mathematically.

agraph{Berger–Levy} The neuron is modeled as a timing channel whose output is a point process. Noise is primarily Poissonian and arises from stochastic afferent spike arrivals. The channel is nonlinear and history-dependent, with the ISI distribution emerging endogenously from the dynamics.

agraph{Present Work} After discretization and feedback elimination, the axon tract reduces to an effective vector Gaussian channel \[ \mathbf{Y} = \mathbf{H}_{\text{eff}}\mathbf{X} + \mathbf{Z}, \] with colored Gaussian noise and deterministic feedback absorbed into $\mathbf{H}_{\text{eff}}$ and $\Sigma_{\text{eff}}$. This enables the use of classical tools such as eigenmode decomposition, waterfilling, and spectral capacity formulas.

In short, Berger–Levy emphasize Poisson timing noise, whereas the tract model emphasizes Gaussian field fluctuations and coupling.

Role of Energy and Cost

Both frameworks are deeply concerned with energetic efficiency, but they formalize cost differently.

The Berger–Levy cost is event-based and metabolic, while the present cost is signal-based and field-theoretic, reflecting different dominant biophysical expenditures at different scales.

Feedback and Memory

Feedback plays markedly different roles in the two theories.

Berger–Levy explicitly account for history dependence arising from refractoriness, excitation correlation time, and ISI-to-ISI dependence, leading to information-rate decrements due to temporal correlations.

In contrast, the present work shows that deterministic, causal feedback in the tract dynamics does not reduce capacity: it can be eliminated algebraically and absorbed into an effective channel. This difference reflects the fact that Berger–Levy feedback is stochastic and energetic, whereas tract-level feedback is deterministic and biophysical.

Complementarity of the Two Approaches

The two formulations should be viewed as complementary rather than competing.

Conceptually, the tract capacity analyzed here provides an upper bound on the information available to downstream spike encoders of the Berger–Levy type. Conversely, Berger–Levy’s bpj-optimal spike codes can be interpreted as candidate mechanisms for approaching this bound at the single-neuron level.

Summary of Key Differences

Table II: Key Differences summarize the key points of variation between the Berger-Levy and present approaches.

Berger–LevyPresent Work
ScaleSingle neuronAxon tract
Signal typeSpike timingContinuous voltages
NoisePoissonGaussian (effective)
CouplingNoneEphaptic (MIMO)
FeedbackStochastic, costlyDeterministic, removable
Efficiency metricBits per jouleCapacity per unit cost
OptimizationISI distributionsEigenmodes of $H_{\text{eff}}$
Table 2. Key Differences

Perspective

Taken together, Berger–Levy and the present work suggest a multiscale picture of neural communication: energy-efficient spike timing emerges as an optimal encoding layer built atop a tract-level analog channel whose capacity and efficiency are governed by geometry, coupling, and noise. Bridging these two levels remains an open and promising direction for future work.

Relation to Ikeda–Manton Capacity Formulations

Overview

Ikeda and Manton developed an information-theoretic framework for the capacity of continuous-time channels governed by stochastic differential equations (SDEs), with particular emphasis on nonlinear dynamics and additive Gaussian diffusion noise. Their work characterizes mutual information rates for channels of the form

$$ dY_t = f(Y_t, X_t)\,dt + G\,dW_t, $$

where $f()$ is generally nonlinear, $X_t$ is the control or input process, and $W_t$ is a Wiener process. Capacity is defined as a supremum over admissible input processes subject to energy or power constraints.

The present work addresses a related but distinct problem: the information-carrying capacity of an axon tract governed by biophysical field equations with ephaptic coupling, discretized in space and time and subsequently reduced to an effective vector Gaussian channel.

Modeling Philosophy

Ikeda and Manton treat the channel as an irreducibly nonlinear stochastic dynamical system. The signal and noise are intertwined at the level of the diffusion process, and capacity is defined directly on the path space of trajectories. Feedback enters naturally through the state dependence of the drift term $f(Y_t,X_t)$.

In contrast, the present work begins from a nonlinear biophysical model (the generalized ephaptic equation) but demonstrates that, after discretization and algebraic manipulation, the deterministic nonlinear feedback can be eliminated. This yields an equivalent linear vector Gaussian channel with modified channel matrix $\mathbf{H}_{\text{eff}}$ and noise covariance $\Sigma_{\text{eff}}$. Capacity analysis is then performed using classical Gaussian tools.

Thus, while Ikeda–Manton retain the nonlinear SDE structure throughout, the present work shows that for axon tracts the relevant nonlinearities are capacity-neutral and can be absorbed into effective linear parameters.

Treatment of Feedback

Feedback plays a central role in both formulations, but with different consequences.

In Ikeda–Manton, feedback is intrinsic to the continuous-time dynamics and generally cannot be removed without altering the channel law. Capacity expressions involve innovations processes and Radon–Nikodym derivatives on path space, reflecting the deep coupling between signal, state, and noise.

In the present work, feedback arising from ephaptic interactions and ionic dynamics is deterministic and causal. As shown in Section 4, this feedback can be eliminated exactly, leaving capacity unchanged. This distinction highlights a key structural difference: Ikeda–Manton feedback is stochastic and diffusion-level, whereas tract-level feedback is deterministic and field-mediated.

Noise Structure

Ikeda and Manton model noise as continuous-time Brownian motion acting directly on the system state, leading to nontrivial stochastic calculus considerations and capacity expressions involving quadratic variation.

By contrast, the axon tract model yields additive Gaussian noise after discretization, with spatial and temporal correlations captured in $\Sigma_{\text{eff}}$. This permits an eigenmode-based interpretation of capacity and an explicit connection to MIMO Gaussian channels.

Capacity Notions

Capacity in Ikeda–Manton is defined as an information rate per unit time over continuous trajectories, typically under average power constraints on $X_t$. Closed-form expressions are rare and generally limited to special cases.

The present work derives explicit finite-block, stationary, and capacity-per-unit-cost expressions. In particular, the Verdu regime yields a closed-form eigenvalue characterization, which has no direct analog in the general Ikeda–Manton setting.

Conceptual Relationship

The present formulation can be viewed as a biophysically grounded specialization of the general Ikeda–Manton framework to a class of systems where nonlinear feedback is deterministic and noise enters additively. From this perspective, the tract model identifies a regime in which the formidable path-space capacity problem collapses to a tractable Gaussian channel without loss of rigor.

Summary

Ikeda and Manton provide a general and mathematically sophisticated theory of capacity for nonlinear stochastic dynamical channels. The present work complements this theory by showing that axon tracts occupy a structurally simpler subclass in which effective linearization is exact, enabling explicit capacity and efficiency results directly tied to neurobiological structure.

Multivariate Mutual Information of the Axon Tract

Vector-Valued Channel Representation

After feedback elimination (Section 4), the axon tract over one signaling epoch is represented as a vector channel

$$ \mathbf{Y} = H_{\mathrm{eff}} \mathbf{X} + \mathbf{Z}, $$

where \( \mathbf{X} = (X_1,\dots,X_m)^T \) and \( \mathbf{Y} = (Y_1,\dots,Y_n)^T \) are random vectors whose components correspond to axons or spatial modes, and \( \mathbf{Z} \sim \mathcal{N}(0,\Sigma_{\text{eff}}) \) is multivariate Gaussian noise.

Unlike scalar mutual information, this formulation naturally invites multivariate mutual information (MMI), since dependence is distributed across multiple random variables within each vector.

Multivariate Mutual Information (MMI)

Given a collection of random variables \( (U_1,\dots,U_k) \), the multivariate mutual information (also known as total correlation) is defined as

$$ I_{\mathrm{MMI}}(U_1;\dots;U_k) = \sum_{i=1}^k H(U_i) - H(U_1,\dots,U_k). $$

MMI quantifies the total statistical dependence among the components and vanishes if and only if the variables are independent.

For the axon tract, two natural MMI quantities arise:

Output MMI of the Tract

Assume $\mathbf{X} \sim \mathcal{N}(0,K_X)$. Then

$$ \mathbf{Y} \sim \mathcal{N}\!\left(0,\, K_Y \right), \quad K_Y = H_{\mathrm{eff}} K_X H_{\mathrm{eff}}^T + \Sigma_{\mathrm{eff}}. $$

The multivariate mutual information among the output components $\{Y_1,\dots,Y_n\}$ is

$$ I_{\mathrm{MMI}}(\mathbf{Y}) = \sum_{i=1}^n H(Y_i) - H(\mathbf{Y}). $$

For Gaussian variables,

$$ \begin{align} H(Y_i) &= \tfrac{1}{2}\log(2\pi e\, [K_Y]_{ii}), H(\mathbf{Y}) &= \tfrac{1}{2}\log\!\big((2\pi e)^n \det K_Y\big), \end{align} $$

yielding

$$ \boxed{ I_{\mathrm{MMI}}(\mathbf{Y}) = \frac{1}{2} \log \left( \frac{\prod_{i=1}^n [K_Y]_{ii}}{\det K_Y} \right). } $$

This quantity measures the degree to which ephaptic coupling and shared noise induce collective dependence across axons.

Input–Output Multivariate Mutual Information

To characterize tract-level information transfer, consider the MMI between the input vector $\mathbf{X}$ and output vector $\mathbf{Y}$, defined as

$$ I_{\mathrm{MMI}}(\mathbf{X};\mathbf{Y}) = \sum_{i=1}^m H(X_i) + \sum_{j=1}^n H(Y_j) - H(\mathbf{X},\mathbf{Y}). $$

For jointly Gaussian $(\mathbf{X},\mathbf{Y})$, with covariance

$$ K_{XY} = \begin{pmatrix} \mathbf{K}_X & \mathbf{K}_X \mathbf{H}_{\text{eff}}^T \\ \mathbf{H}_{\text{eff}} \mathbf{K}_X & K_Y \end{pmatrix}, $$

we obtain

$$ H(\mathbf{X},\mathbf{Y}) = \frac{1}{2} \log\!\big((2\pi e)^{m+n}\det K_{XY}\big). $$

Substitution yields the closed-form expression

$$ \boxed{ I_{\mathrm{MMI}}(\mathbf{X};\mathbf{Y}) = \frac{1}{2} \log \left( \frac{ \prod_{i=1}^m [K_X]_{ii} \prod_{j=1}^n [K_Y]_{jj} }{ \det K_{XY} } \right). } $$

Relation to Classical Mutual Information

Classical mutual information satisfies

$$ I(\mathbf{X};\mathbf{Y}) = H(\mathbf{Y}) - H(\mathbf{Y}|\mathbf{X}) = \frac{1}{2}\log \frac{\det K_Y}{\det \Sigma_{\mathrm{eff}}}. $$

The MMI decomposes this quantity into contributions from marginal entropies and joint dependence. In particular,

$$ I_{\mathrm{MMI}}(\mathbf{X};\mathbf{Y}) = I(\mathbf{X};\mathbf{Y}) + I_{\mathrm{MMI}}(\mathbf{X}) + I_{\mathrm{MMI}}(\mathbf{Y}|\mathbf{X}), $$

making explicit how tract capacity arises from both signal transmission and collective dependence across axons.

Interpretation

The multivariate mutual information provides a tract-level measure of synergistic coding: ephaptic coupling increases not only channel capacity but also the irreducible dependence among axonal signals. Hence, MMI captures structural information integration beyond what is visible from scalar or pairwise mutual information alone.

Relation to Chung–Chan Network MMI Partitions

Chung–Chan Network MMI

Chung and Chan define the multivariate mutual information of a network $\mathcal{V} = \{V_1,\dots,V_N\}$ via its minimum information partition (MIP). Given a partition $\mathcal{P} = \{C_1,\dots,C_k\}$ of $\mathcal{V}$, the partition information is

$$ I_{\mathcal{P}}(\mathcal{V}) = \frac{1}{k-1} \left( \sum_{i=1}^k H(C_i) - H(\mathcal{V}) \right), $$

and the network MMI is defined as

$$ \boxed{ I_{\mathrm{CC}}(\mathcal{V}) = \min_{\mathcal{P}} I_{\mathcal{P}}(\mathcal{V}), } $$

where the minimum is taken over all nontrivial partitions.

This construction identifies the weakest informational cut of the network and yields a principled measure of global integration.

Axon Tract as a Communication Network

In the present work, the axon tract output \( \mathbf{Y} = (Y_1,\dots,Y_n) \) naturally defines a network whose nodes are individual axons or spatial modes. Ephaptic coupling induces statistical dependence among these nodes, making the Chung–Chan framework directly applicable.

Let $\mathcal{V} = \{Y_1,\dots,Y_n\}$. For any partition $\mathcal{P} = \{C_1,\dots,C_k\}$ of the tract, the partition information is

$$ I_{\mathcal{P}}(\mathbf{Y}) = \frac{1}{k-1} \left( \sum_{i=1}^k H(\mathbf{Y}_{C_i}) - H(\mathbf{Y}) \right), $$

where $\mathbf{Y}_{C_i}$ denotes the subvector indexed by cluster $C_i$.

Gaussian Evaluation

Since $\mathbf{Y}$ is jointly Gaussian with covariance $K_Y$, each term admits a closed form:

$$ \begin{align} H(\mathbf{Y}_{C_i}) &= \frac{1}{2} \log\!\left((2\pi e)^{|C_i|} \det K_Y[C_i]\right), H(\mathbf{Y}) &= \frac{1}{2} \log\!\left((2\pi e)^n \det K_Y\right), \end{align} $$

where $K_Y[C_i]$ denotes the principal submatrix indexed by $C_i$.

Thus,

$$ \boxed{ I_{\mathcal{P}}(\mathbf{Y}) = \frac{1}{2(k-1)} \log \left( \frac{ \prod_{i=1}^k \det K_Y[C_i] }{ \det K_Y } \right). } $$

The Chung–Chan network MMI of the tract output is therefore

$$ \boxed{ I_{\mathrm{CC}}(\mathbf{Y}) = \min_{\mathcal{P}} \frac{1}{2(k-1)} \log \left( \frac{ \prod_{i=1}^k \det K_Y[C_i] }{ \det K_Y } \right). } $$

Relation to Output Total Correlation

The output MMI defined in Section X, \[ I_{{MMI}}(\mathbf{Y}) = {1}{2} ( {_{i=1}^n [K_Y]_{ii}}{ K_Y} ), \] corresponds to the special case of the Chung–Chan framework where the partition $\mathcal{P}$ consists solely of singletons, \( \mathcal{P} = {{Y_1},\dots,{Y_n}}. \)

Hence,

$$ I_{\mathrm{CC}}(\mathbf{Y}) \;\le\; I_{\mathrm{MMI}}(\mathbf{Y}), $$

with equality if and only if the singleton partition is the minimum information partition. This occurs when dependence is distributed homogeneously across the tract.

Input–Output Network Partitioning

The Chung–Chan construction also applies to the joint network $\mathcal{V} = \mathbf{X} \cup \mathbf{Y}$. In this case, partitions that separate input and output nodes quantify bottlenecks in tract information transfer.

In particular, the bipartition \( \mathcal{P} = {\mathbf{X},\mathbf{Y}} \) yields

$$ I_{\mathcal{P}}(\mathbf{X},\mathbf{Y}) = H(\mathbf{X}) + H(\mathbf{Y}) - H(\mathbf{X},\mathbf{Y}) = I(\mathbf{X};\mathbf{Y}), $$

showing that classical mutual information is a special case of network MMI under bipartitioning.

Interpretation for Axon Tracts

Within this framework:

Thus, the Chung–Chan network MMI provides a natural measure of tract information integration complementary to channel capacity.

Information-Spectrum Reduction to Point-to-Point Tract Channels

From General Information-Spectrum to Point-to-Point Capacity

Han’s information-spectrum framework provides a capacity characterization for channels without assumptions of stationarity, ergodicity, or memorylessness. While originally developed for multi-user channels, the formalism reduces naturally to the single-user (point-to-point) case, which is the relevant abstraction for an axon tract viewed as a distributed channel between an input vector $\mathbf{X}^n$ and an output vector $\mathbf{Y}^n$.

Consider a general point-to-point channel specified by a sequence of conditional distributions \[ W^n(\mathbf{y}^n \mid \mathbf{x}^n), \] with arbitrary (possibly continuous) alphabets. Let ${\mathbf{X}^n}_{n1}$ be an arbitrary input process and $\mathbf{Y}^n$ the corresponding output process induced by the channel.

The normalized information density is defined as

$$ \imath_n(\mathbf{X}^n;\mathbf{Y}^n) = \frac{1}{n} \log \frac{ W^n(\mathbf{Y}^n \mid \mathbf{X}^n) }{ P_{\mathbf{Y}^n}(\mathbf{Y}^n) }. $$

Following Verdu and Han, the achievable rate for a given input process is determined by the liminf in probability

$$ \underline{\mathbf{I}}(\mathbf{X};\mathbf{Y}) = \mathrm{p\text{-}liminf}_{n\to\infty} \, \imath_n(\mathbf{X}^n;\mathbf{Y}^n). $$

The channel capacity is then

$$ \boxed{ C = \sup_{\mathbf{X}} \underline{\mathbf{I}}(\mathbf{X};\mathbf{Y}), } $$

where the supremum is taken over all admissible input processes, including nonstationary and nonergodic ones.

This formulation remains valid even when the channel exhibits spatial coupling, long memory, or blockwise variability—features intrinsic to axon tract propagation.

Reduction to Gaussian Vector Channels

In the present work, the axon tract is modeled as a linear stochastic channel

$$ \mathbf{Y}^n = H^n \mathbf{X}^n + \mathbf{Z}^n, $$

where:

No assumption of stationarity across $n$ is required. The noise process $\mathbf{Z}^n$ may be nonergodic or mixed, directly aligning with the information-spectrum setting.

For Gaussian inputs and noise, the normalized information density converges in probability, and the information-spectrum capacity reduces to a spectral determinant form:

$$ \underline{\mathbf{I}}(\mathbf{X};\mathbf{Y}) = \lim_{n\to\infty} \frac{1}{2n} \log \frac{ \det(K_{Y^n}) }{ \det(K_{Z^n}) }, $$

provided the limit exists.

Thus, the general information-spectrum capacity coincides with the Gaussian mutual information rate even when classical ergodicity assumptions fail.

Application to the Axon Tract Model

In the tract model developed in this paper, the channel input is a vector $\mathbf{X}^n$ of axonal drive signals, and the output $\mathbf{Y}^n$ represents measured or effective field variables along the tract. The channel law is spatially extended and anisotropic, reflecting axonal geometry and ephaptic coupling.

Let $K_{X^n}$ denote the input covariance subject to a global metabolic or energetic constraint

$$ \frac{1}{n}\mathrm{tr}(K_{X^n}) \le P. $$

The induced output covariance is

$$ K_{Y^n} = H^n K_{X^n} (H^n)^\top + K_{Z^n}. $$

Using the information-spectrum formulation, the achievable rate for a given covariance sequence is

$$ R = \mathrm{p\text{-}liminf}_{n\to\infty} \frac{1}{2n} \log \frac{ \det(H^n K_{X^n} (H^n)^\top + K_{Z^n}) }{ \det(K_{Z^n}) }. $$

Maximizing over admissible $K_{X^n}$ yields the tract capacity

$$ \boxed{ C_{\mathrm{tract}} = \sup_{\{K_{X^n}\}} \mathrm{p\text{-}liminf}_{n\to\infty} \frac{1}{2n} \log \frac{ \det(K_{Y^n}) }{ \det(K_{Z^n}) }. } $$

Importantly, this expression remains valid even if the tract exhibits slowly varying coupling, spatial heterogeneity, or mixed noise regimes, which would invalidate classical Shannon derivations.

Connection to Vector-to-Vector Information Flow

Unlike scalar point-to-point channels, the tract channel maps a vector input to a vector output. Han’s framework accommodates this naturally, since $\mathbf{X}^n$ and $\mathbf{Y}^n$ are treated as arbitrary random objects.

The resulting capacity quantifies aggregate information flow through the tract rather than per-axon throughput. This aligns with the biophysical interpretation that signaling capacity emerges collectively from ephaptically coupled axons, not from isolated fibers.

Moreover, the information-spectrum formulation makes explicit that capacity is determined by the worst-case asymptotic information density, rather than by average mutual information alone. This is particularly relevant for biological systems, where nonstationary fluctuations and rare events may dominate functional performance.

Relation to MMI and Network Integration

The point-to-point capacity derived above complements the multivariate mutual information (MMI) analysis developed earlier. Capacity measures how much information can be reliably conveyed from $\mathbf{X}$ to $\mathbf{Y}$, while MMI quantifies how irreducibly that information is distributed across axonal degrees of freedom.

Within the information-spectrum view, MMI emerges as a structural constraint on achievable capacity: strong output integration (high MMI) implies that capacity cannot be decomposed into independent subchannels. Conversely, weak MMI corresponds to near-block-diagonal covariance structure and additive capacities.

Thus, the tract capacity computed here should be interpreted jointly with the Chung–Chan network MMI as characterizing both quantity and integration of information flow.

Interpretational Summary

The reduction of Han’s general framework to the tract setting yields three key insights:

  1. The axon tract is naturally a general point-to-point channel in the information-spectrum sense.

  2. Capacity remains well-defined without assuming stationarity, ergodicity, or independence.

  3. The resulting expression interfaces cleanly with Gaussian tract models and with multivariate information measures.

This places the present work within a rigorous, modern extension of Shannon theory suitable for structured biological communication systems.

Comparison with Prior Ephaptic Mutual Information Analysis

The present work builds directly on, but also substantially extends, the framework developed in [3], where ephaptic coupling in small axon groups was analyzed primarily through the lens of input–output mutual information computed from simulated Hodgkin–Huxley dynamics. While both works share a common physical substrate and information-theoretic motivation, they differ in modeling abstraction, mathematical scope, and the nature of the information measures employed.

Level of Abstraction and Channel Modeling

In [3], the axon or axon tract is treated as a waveform-to-waveform channel. The transmembrane voltage at an input node and an output node is expanded in a complete orthonormal basis (typically Fourier), and the resulting expansion coefficients are treated as discrete random variables. Mutual information is then computed empirically using histograms derived from repeated numerical simulations.

The present work departs from this explicitly waveform-centric approach by introducing a higher-level vector channel abstraction. Instead of focusing on individual expansion coefficients or their empirical distributions, the tract is modeled as a linear (or linearized) stochastic mapping between high-dimensional input and output vectors, each representing collective axon activity over space and time. This abstraction enables the use of modern multivariate information measures, including multivariate mutual information (MMI) and information-spectrum capacity, which are not directly accessible in the earlier formulation.

Mutual Information versus Capacity

A central distinction lies in the role played by optimization. The prior work explicitly acknowledges that it does not solve the maximization problem required to compute channel capacity, focusing instead on mutual information as a descriptive metric. Capacity is discussed conceptually but not operationally realized.

In contrast, the present work treats capacity as a primary object of study. By invoking Verdu–Han information-spectrum methods and Gaussian vector channel theory, it provides explicit capacity expressions (or lower bounds) under broad conditions, including nonstationarity and spatial coupling. Mutual information appears as an intermediate or structural quantity, whereas capacity emerges as an asymptotic performance limit.

This shift is significant: whereas the earlier work demonstrates how ephaptic coupling can reduce mutual information for fixed signaling distributions, the present work clarifies how ephaptic structure constrains the maximum achievable information flow under optimal signaling.

Role of Ephaptic Coupling

Both works identify ephaptic coupling as a distortion mechanism that tends to reduce pointwise input–output mutual information. In [3], this effect is observed numerically: increased coupling strength leads to reduced mutual information, interpreted as increased synchronization and reduced variability among signals.

The present work reframes this phenomenon in structural information-theoretic terms. Ephaptic coupling is shown to induce statistical dependence across axon outputs, which increases multivariate integration as quantified by MMI. From this perspective, the reduction in pairwise mutual information is not merely a loss, but a redistribution of information from separable channels into integrated collective modes. Thus, ephaptic coupling trades independent capacity for integrated capacity, a distinction not explicit in the earlier analysis.

Dimensionality and Network Perspective

The earlier work primarily treats the $N=2$ axon case, with extensions to higher $N$ discussed formally but not deeply analyzed. Mutual information is computed between aggregate input and output sets, but the internal partitioning structure of the tract is not examined.

The present work explicitly adopts a network information perspective. By using Chung–Chan MMI partitions, it decomposes information flow according to how it is distributed across axonal subsets. This allows one to distinguish between reducible information (attributable to sub-tracts) and irreducible information (emergent at the tract level). In this sense, the present work adds a layer of explanatory power by characterizing not only how much information flows, but how it is integrated.

Mathematical Generality

Methodologically, [3] relies on discrete approximations, empirical probability mass functions, and simulation-based estimation. This approach is well suited for detailed biophysical modeling but becomes cumbersome for large-scale theoretical analysis.

The present work abstracts away many microscopic details to achieve greater generality. Information-spectrum methods allow arbitrary noise statistics, nonergodicity, and spatial heterogeneity, while Gaussian vector models yield closed-form or asymptotic expressions. As a result, the theory applies not only to specific Hodgkin–Huxley simulations, but to a broad class of distributed biological channels.

Interpretational Shift

Finally, there is a conceptual shift in interpretation. The earlier paper frames ephaptic coupling primarily as detrimental to communication, in the sense of reducing mutual information between predefined input and output variables. The present work adopts a more nuanced view: ephaptic coupling reduces decomposability but increases integration. Whether this is "beneficial" or "detrimental" depends on the computational or functional objective of the neural system.

In summary, the present work should be viewed not as a replacement for [3], but as a theoretical extension. The earlier work establishes detailed numerical evidence and biophysical grounding, while the present formulation situates ephaptic axon tracts within modern multivariate and information-spectrum information theory, enabling capacity analysis, integration quantification, and principled comparison with communication networks.

Acknowledgments

This work was prepared with the assistance of LLMs.

References

  1. [1]

    A. Chawla, Axon-axon Interaction Using Currents and Fields. Tampa, FL, USA: University of South Florida, 2017.

  2. [2]

    S. Verdu, "On channel capacity per unit cost," IEEE Transactions on Information Theory, vol. 36, no. 5, pp. 1019–1030, Sept. 1990.

  3. [3]

    S. Verdu and T. S. Han, "A general formula for channel capacity," IEEE Transactions on Information Theory, vol. 40, no. 4, pp. 1147–1157, July 1994.

  4. [4]

    T. S. Han, Information-Spectrum Methods in Information Theory. Berlin, Germany: Springer, 2003.

  5. [5]

    T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York, NY, USA: Wiley, 2006.

  6. [6]

    T. W. Berger and W. B. Levy, "A mathematical theory of energy-efficient neural communication," IEEE Transactions on Information Theory, vol. 56, no. 2, pp. 852–874, Feb. 2010.

  7. [7]

    S. Ikeda and J. H. Manton, "Capacity of continuous-time Gaussian channels with feedback," IEEE Transactions on Information Theory, vol. 55, no. 9, pp. 4174–4185, Sept. 2009.

  8. [8]

    S. Ikeda and J. H. Manton, "Stochastic differential equation approach to capacity of continuous-time channels," in Proc. IEEE International Symposium on Information Theory (ISIT), Austin, TX, USA, 2010, pp. 236–240.

  9. [9]

    K. M. Chung and T. H. Chan, "Multivariate mutual information and its applications to network information theory," IEEE Transactions on Information Theory, vol. 60, no. 7, pp. 3953–3972, July 2014.

  10. [10]

    R. W. Yeung, "A new outlook on Shannon's information measures," IEEE Transactions on Information Theory, vol. 37, no. 3, pp. 466–474, May 1991.

  11. [11]

    S. Watanabe, "Information theoretical analysis of multivariate correlation," IBM Journal of Research and Development, vol. 4, no. 1, pp. 66–82, Jan. 1960.

  12. [12]

    T. M. Cover and S. Pombra, "Gaussian feedback capacity," IEEE Transactions on Information Theory, vol. 35, no. 1, pp. 37–43, Jan. 1989.

  13. [13]

    R. M. Gray, Toeplitz and Circulant Matrices: A Review. Hanover, MA, USA: Now Publishers, 2006.

  14. [14]

    A. Chawla and S. D. Morgera, "Ephaptic information flow: Information processing in groups of neurons," IEEE Transactions on Molecular, Biological and Multi-Scale Communications, vol. 11, no. 1, pp. 1–14, 2025.

  15. [15]

    A. Goldsmith, Wireless Communications. Cambridge, UK: Cambridge Univ. Press, 2005.

  16. [16]

    A. Lapidoth, A Foundation in Digital Communication. Cambridge, UK: Cambridge Univ. Press, 2009.

Received on December 18, 2025; Accepted in Prajnanabha: Information and Physics on December 18, 2025; Revised and Published Online in January 2026.