Tweedie distribution


In probability and statistics, the Tweedie distributions are a family of probability distributions which include the purely continuous normal, gamma and Inverse Gaussian distributions, the purely discrete scaled Poisson distribution, and the class of compound Poisson–gamma distributions which have positive mass at zero, but are otherwise continuous.
Tweedie distributions are a special case of exponential dispersion models and are often used as distributions for generalized linear models.
The Tweedie distributions were named by Bent Jørgensen after Maurice Tweedie, a statistician and medical physicist at the University of Liverpool, UK, who presented the first thorough study of these distributions in 1984.

Definitions

The Tweedie distributions are defined as subfamily of exponential dispersion models, with a special mean-variance relationship.
A random variable Y is Tweedie distributed Twp, if with mean, positive dispersion parameter and
where is called Tweedie power parameter.
The probability distribution Pθ,σ2 on the measurable sets A, is given by
for some σ-finite measure νλ.
This representation uses the canonical parameter θ of an exponential disperson model and cumulant function
where we used, or equivalently.

Properties

Additive exponential dispersion models

The models just described are in the reproductive form. An exponential dispersion model has always a dual: the additive form. If Y is reproductive, then with is in the additive form ED*, for Tweedie Tw*p. Additive models have the property that the distribution of the sum of independent random variables,
for which Zi ~ ED* with fixed θ and various λ are members of the family of distributions with the same θ,

Reproductive exponential dispersion models

A second class of exponential dispersion models exists designated by the random variable
where σ2 = 1/λ, known as reproductive exponential dispersion models. They have the property that for n independent random variables Yi ~ ED, with weighting factors wi and
a weighted average of the variables gives,
For reproductive models the weighted average of independent random variables with fixed μ and σ2 and various values for wi is a member of the family of distributions with same μ and σ2.
The Tweedie exponential dispersion models are both additive and reproductive; we thus have the duality transformation

Scale invariance

A third property of the Tweedie models is that they are scale invariant: For a reproductive exponential dispersion model Twp and any positive constant c we have the property of closure under scale transformation,

The Tweedie power variance function

To define the variance function for exponential dispersion models we make use of the mean value mapping, the relationship between the canonical parameter θ and the mean μ. It is defined by the function
with cumulative function.
The variance function V is constructed from the mean value mapping,
Here the minus exponent in τ−1 denotes an inverse function rather than a reciprocal. The mean and variance of an additive random variable is then E = λμ and var = λV.
Scale invariance implies that the variance function obeys the relationship
V = μ p.

The Tweedie deviance

The unit deviance of a reproductive Tweedie distribution is given by

The Tweedie cumulant generating functions

The properties of exponential dispersion models give us two differential equations. The first relates the mean value mapping and the variance function to each other,
The second shows how the mean value mapping is related to the cumulant function,
These equations can be solved to obtain the cumulant function for different cases of the Tweedie models. A cumulant generating function may then be obtained from the cumulant function. The additive CGF is generally specified by the equation
and the reproductive CGF by
where s is the generating function variable.
For the additive Tweedie models the CGFs take the form,
and for the reproductive models,
The additive and reproductive Tweedie models are conventionally denoted by the symbols Tw*p and Twp, respectively.
The first and second derivatives of the CGFs, with s = 0, yields the mean and variance, respectively. One can thus confirm that for the additive models the variance relates to the mean by the power law,

The Tweedie convergence theorem

The Tweedie exponential dispersion models are fundamental in statistical theory consequent to their roles as foci of convergence for a wide range of statistical processes. Jørgensen et al proved a theorem that specifies the asymptotic behaviour of variance functions known as the Tweedie convergence theorem". This theorem, in technical terms, is stated thus: The unit variance function is regular of order p at zero provided that V ~ c0μp for μ as it approaches zero for all real values of p and c0 > 0. Then for a unit variance function regular of order p at either zero or infinity and for
for any, and we have
as or, respectively, where the convergence is through values of c such that cμ is in the domain of θ and cp−2/σ2 is in the domain of λ. The model must be infinitely divisible as c2−p approaches infinity.
In nontechnical terms this theorem implies that any exponential dispersion model that asymptotically manifests a variance-to-mean power law is required to have a variance function that comes within the domain of attraction of a Tweedie model. Almost all distribution functions with finite cumulant generating functions qualify as exponential dispersion models and most exponential dispersion models manifest variance functions of this form. Hence many probability distributions have variance functions that express this asymptotic behaviour, and the Tweedie distributions become foci of convergence for a wide range of data types.

Related distributions

The Tweedie distributions include a number of familiar distributions as well as some unusual ones, each being specified by the domain of the index parameter. We have the
For 0 < p < 1 no Tweedie model exists. Note that all stable distributions mean actually generated by stable distributions.

Occurrence and applications

The Tweedie models and Taylor’s power law

is an empirical law in ecology that relates the variance of the number of individuals of a species per unit area of habitat to the corresponding mean by a power-law relationship. For the population count Y with mean µ and variance var, Taylor's law is written,
where a and p are both positive constants. Since L. R. Taylor described this law in 1961 there have been many different explanations offered to explain it, ranging from animal behavior, a random walk model, a stochastic birth, death, immigration and emigration model, to a consequence of equilibrium and non-equilibrium statistical mechanics. No consensus exists as to an explanation for this model.
Since Taylor's law is mathematically identical to the variance-to-mean power law that characterizes the Tweedie models, it seemed reasonable to use these models and the Tweedie convergence theorem to explain the observed clustering of animals and plants associated with Taylor's law. The majority of the observed values for the power-law exponent p have fallen in the interval and so the Tweedie compound Poisson–gamma distribution would seem applicable. Comparison of the empirical distribution function to the theoretical compound Poisson–gamma distribution has provided a means to verify consistency of this hypothesis.
Whereas conventional models for Taylor's law have tended to involve ad hoc animal behavioral or population dynamic assumptions, the Tweedie convergence theorem would imply that Taylor's law results from a general mathematical convergence effect much as how the central limit theorem governs the convergence behavior of certain types of random data. Indeed, any mathematical model, approximation or simulation that is designed to yield Taylor's law is required to converge to the form of the Tweedie models.

Tweedie convergence and 1/''f'' noise

, or 1/f noise, refers to a pattern of noise characterized by a power-law relationship between its intensities S at different frequencies f,
where the dimensionless exponent γ ∈ . It is found within a diverse number of natural processes. Many different explanations for 1/f noise exist, a widely held hypothesis is based on Self-organized criticality where dynamical systems close to a critical point are thought to manifest scale-invariant spatial and/or temporal behavior.
In this subsection a mathematical connection between 1/f noise and the Tweedie variance-to-mean power law will be described. To begin, we first need to introduce self-similar processes: For the sequence of numbers
with mean
deviations
variance
and autocorrelation function
with lag k, if the autocorrelation of this sequence has the long range behavior
as k and where L is a slowly varying function at large values of k, this sequence is called a self-similar process.
The method of expanding bins can be used to analyze self-similar processes. Consider a set of equal-sized non-overlapping bins that divides the original sequence of N elements into groups of m equal-sized segments so that new reproductive sequences, based on the mean values, can be defined:
The variance determined from this sequence will scale as the bin size changes such that
if and only if the autocorrelation has the limiting form
One can also construct a set of corresponding additive sequences
based on the expanding bins,
Provided the autocorrelation function exhibits the same behavior, the additive sequences will obey the relationship
Since and are constants this relationship constitutes a variance-to-mean power law, with p = 2 - d.
The biconditional relationship above between the variance-to-mean power law and power law autocorrelation function, and the Wiener–Khinchin theorem imply that any sequence that exhibits a variance-to-mean power law by the method of expanding bins will also manifest 1/f noise, and vice versa. Moreover, the Tweedie convergence theorem, by virtue of its central limit-like effect of generating distributions that manifest variance-to-mean power functions, will also generate processes that manifest 1/f noise. The Tweedie convergence theorem thus provides an alternative explanation for the origin of 1/f noise, based its central limit-like effect.
Much as the central limit theorem requires certain kinds of random processes to have as a focus of their convergence the Gaussian distribution and thus express white noise, the Tweedie convergence theorem requires certain non-Gaussian processes to have as a focus of convergence the Tweedie distributions that express 1/f noise.

The Tweedie models and multifractality

From the properties of self-similar processes, the power-law exponent p = 2 - d is related to the Hurst exponent H and the fractal dimension D by
A one-dimensional data sequence of self-similar data may demonstrate a variance-to-mean power law with local variations in the value of p and hence in the value of D. When fractal structures manifest local variations in fractal dimension, they are said to be multifractals. Examples of data sequences that exhibit local variations in p like this include the eigenvalue deviations of the Gaussian Orthogonal and Unitary Ensembles. The Tweedie compound Poisson–gamma distribution has served to model multifractality based on local variations in the Tweedie exponent α. Consequently, in conjunction with the variation of α, the Tweedie convergence theorem can be viewed as having a role in the genesis of such multifractals.
The variation of α has been found to obey the asymmetric Laplace distribution in certain cases. This distribution has been shown to be a member of the family of geometric Tweedie models, that manifest as limiting distributions in a convergence theorem for geometric dispersion models.

Regional organ blood flow

Regional organ blood flow has been traditionally assessed by the injection of radiolabelled polyethylene microspheres into the arterial circulation of animals, of a size that they become entrapped within the microcirculation of organs. The organ to be assessed is then divided into equal-sized cubes and the amount of radiolabel within each cube is evaluated by liquid scintillation counting and recorded. The amount of radioactivity within each cube is taken to reflect the blood flow through that sample at the time of injection. It is possible to evaluate adjacent cubes from an organ in order to additively determine the blood flow through larger regions. Through the work of J B Bassingthwaighte and others an empirical power law has been derived between the relative dispersion of blood flow of tissue samples of mass m relative to reference-sized samples:
This power law exponent Ds has been called a fractal dimension. Bassingthwaighte's power law can be shown to directly relate to the variance-to-mean power law. Regional organ blood flow can thus be modelled by the Tweedie compound Poisson–gamma distribution., In this model tissue sample could be considered to contain a random distributed number of entrapment sites, each with gamma distributed blood flow. Blood flow at this microcirculatory level has been observed to obey a gamma distribution, thus providing support for this hypothesis.

Cancer metastasis

The "experimental cancer metastasis assay" has some resemblance to the above method to measure regional blood flow. Groups of syngeneic and age matched mice are given intravenous injections of equal-sized aliquots of suspensions of cloned cancer cells and then after a set period of time their lungs are removed and the number of cancer metastases enumerated within each pair of lungs. If other groups of mice are injected with different cancer cell clones then the number of metastases per group will differ in accordance with the metastatic potentials of the clones. It has been long recognized that there can be considerable intraclonal variation in the numbers of metastases per mouse despite the best attempts to keep the experimental conditions within each clonal group uniform. This variation is larger than would be expected on the basis of a Poisson distribution of numbers of metastases per mouse in each clone and when the variance of the number of metastases per mouse was plotted against the corresponding mean a power law was found.
The variance-to-mean power law for metastases was found to also hold for spontaneous murine metastases and for cases series of human metastases.
Since hematogenous metastasis occurs in direct relationship to regional blood flow and videomicroscopic studies indicate that the passage and entrapment of cancer cells within the circulation appears analogous to the microsphere experiments it seemed plausible to propose that the variation in numbers of hematogenous metastases could reflect heterogeneity in regional organ blood flow.
The blood flow model was based on the Tweedie compound Poisson–gamma distribution, a distribution governing a continuous random variable. For that reason in the metastasis model it was assumed that blood flow was governed by that distribution and that the number of regional metastases occurred as a Poisson process for which the intensity was directly proportional to blood flow. This led to the description of the Poisson negative binomial distribution as a discrete equivalent to the Tweedie compound Poisson–gamma distribution. The probability generating function for the PNB distribution is
The relationship between the mean and variance of the PNB distribution is then
which, in the range of many experimental metastasis assays, would be indistinguishable from the variance-to-mean power law. For sparse data, however, this discrete variance-to-mean relationship would behave more like that of a Poisson distribution where the variance equaled the mean.

Genomic structure and evolution

The local density of Single Nucleotide Polymorphisms within the human genome, as well as that of genes, appears to cluster in accord with the variance-to-mean power law and the Tweedie compound Poisson–gamma distribution. In the case of SNPs their observed density reflects the assessment techniques, the availability of genomic sequences for analysis, and the nucleotide heterozygosity. The first two factors reflect ascertainment errors inherent to the collection methods, the latter factor reflects an intrinsic property of the genome.
In the coalescent model of population genetics each genetic locus has its own unique history. Within the evolution of a population from some species some genetic loci could presumably be traced back to a relatively recent common ancestor whereas other loci might have more ancient genealogies. More ancient genomic segments would have had more time to accumulate SNPs and to experience recombination. R R Hudson has proposed a model where recombination could cause variation in the time to most common recent ancestor for different genomic segments. A high recombination rate could cause a chromosome to contain a large number of small segments with less correlated genealogies.
Assuming a constant background rate of mutation the number of SNPs per genomic segment would accumulate proportionately to the time to the most recent common ancestor. Current population genetic theory would indicate that these times would be gamma distributed, on average. The Tweedie compound Poisson–gamma distribution would suggest a model whereby the SNP map would consist of multiple small genomic segments with the mean number of SNPs per segment would be gamma distributed as per Hudson's model.
The distribution of genes within the human genome also demonstrated a variance-to-mean power law, when the method of expanding bins was used to determine the corresponding variances and means. Similarly the number of genes per enumerative bin was found to obey a Tweedie compound Poisson–gamma distribution. This probability distribution was deemed compatible with two different biological models: the microarrangement model where the number of genes per unit genomic length was determined by the sum of a random number of smaller genomic segments derived by random breakage and reconstruction of protochormosomes. These smaller segments would be assumed to carry on average a gamma distributed number of genes.
In the alternative gene cluster model, genes would be distributed randomly within the protochromosomes. Over large evolutionary timescales there would occur tandem duplication, mutations, insertions, deletions and rearrangements that could affect the genes through a stochastic birth, death and immigration process to yield the Tweedie compound Poisson–gamma distribution.
Both these mechanisms would implicate neutral evolutionary processes that would result in regional clustering of genes.

Random matrix theory

The Gaussian unitary ensemble consists of complex Hermitian matrices that are invariant under unitary transformations whereas the Gaussian orthogonal ensemble consists of real symmetric matrices invariant under orthogonal transformations. The ranked eigenvalues En from these random matrices obey Wigner's semicircular distribution: For a N×N matrix the average density for eigenvalues of size E will be
as E. Integration of the semicircular rule provides the number of eigenvalues on average less than E,
The ranked eigenvalues can be unfolded, or renormalized, with the equation
This removes the trend of the sequence from the fluctuating portion. If we look at the absolute value of the difference between the actual and expected cumulative number of eigenvalues
we obtain a sequence of eigenvalue fluctuations which, using the method of expanding bins, reveals a variance-to-mean power law.
The eigenvalue fluctuations of both the GUE and the GOE manifest this power law with the power law exponents ranging between 1 and 2, and they similarly manifest 1/f noise spectra. These eigenvalue fluctuations also correspond to the Tweedie compound Poisson–gamma distribution and they exhibit multifractality.

The distribution of [prime number]s

The second Chebyshev function ψ is given by,
where the summation extends over all prime powers not exceeding x, x runs over the positive real numbers, and is the von Mangoldt function. The function ψ is related to the prime-counting function π, and as such provides information with regards to the distribution of prime numbers amongst the real numbers. It is asymptotic to x, a statement equivalent to the prime number theorem and it can also be shown to be related to the zeros of the Riemann zeta function located on the critical strip ρ, where the real part of the zeta zero ρ is between 0 and 1. Then ψ expressed for x greater than one can be written:
where
The Riemann hypothesis states that the nontrivial zeros of the Riemann zeta function all have real part ½. These zeta function zeros are related to the distribution of prime numbers. Schoenfeld has shown that if the Riemann hypothesis is true then
for all. If we analyze the Chebyshev deviations Δ on the integers n using the method of expanding bins and plot the variance versus the mean a variance to mean power law can be demonstrated. Moreover, these deviations correspond to the Tweedie compound Poisson-gamma distribution and they exhibit 1/f noise.

Other applications

Applications of Tweedie distributions include: