Quantum mutual information


In quantum information theory, quantum mutual information, or von Neumann mutual information, after John von Neumann, is a measure of correlation between subsystems of quantum state. It is the quantum mechanical analog of Shannon mutual information.

Motivation

For simplicity, it will be assumed that all objects in the article are finite-dimensional.
The definition of quantum mutual entropy is motivated by the classical case. For a probability distribution of two variables p, the two marginal distributions are
The classical mutual information I is defined by
where S denotes the Shannon entropy of the probability distribution q.
One can calculate directly
So the mutual information is
But this is precisely the relative entropy between p and p'p. In other words, if we assume the two variables x and y to be uncorrelated, mutual information is the discrepancy in uncertainty resulting from this assumption.
It follows from the property of relative entropy that I ≥ 0 and equality holds if and only if p = p'p.

Definition

The quantum mechanical counterpart of classical probability distributions are modelled with density matrices.
Consider a quantum system that can be divided into two parts, A and B, such that independent measurements can be made on either part. The state space of the entire quantum system is then the tensor product of the spaces for the two parts.
Let ρAB be a density matrix acting on states in HAB. The von Neumann entropy of a density matrix S, is the quantum mechanical analogy of the Shannon entropy.
For a probability distribution p, the marginal distributions are obtained by integrating away the variables x or y. The corresponding operation for density matrices is the partial trace. So one can assign to ρ a state on the subsystem A by
where TrB is partial trace with respect to system B. This is the reduced state of ρAB on system A. The reduced von Neumann entropy of ρAB with respect to system A is
S is defined in the same way.
It can now be seen that the definition of quantum mutual information, corresponding to the classical definition, should be as follows.
Quantum mutual information can be interpreted the same way as in the classical case: it can be shown that
where denotes quantum relative entropy.