Residual time


In the theory of renewal processes, a part of the mathematical theory of probability, the residual time or the forward recurrence time is the time between any given time and the next epoch of the renewal process under consideration. In the context of random walks, it is also known as overshoot. Another way to phrase residual time is "how much more time is there to wait?".
The residual time is very important in most of the practical applications of renewal processes:
Consider a renewal process, with holding times and jump times , and. The holding times are non-negative, independent, identically distributed random variables and the renewal process is defined as. Then, to a given time, there corresponds uniquely an, such that:
The residual time is given by the time from to the next renewal epoch.

Probability distribution of the residual time

Let the cumulative distribution function of the holding times be and recall that the renewal function of a process is. Then, for a given time, the cumulative distribution function of is calculated as:
Differentiating with respect to, the probability density function can be written as
where we have substituted From elementary renewal theory, as, where is the mean of the distribution. If we consider the limiting distribution as, assuming that as, we have the limiting pdf as
Likewise, the cumulative distribution of the residual time is
For large, the distribution is independent of, making it a stationary distribution. An interesting fact is that the limiting distribution of forward recurrence time has the same form as the limiting distribution of the backward recurrence time. This distribution is always J-shaped, with mode at zero.
The first two moments of this limiting distribution are:
where is the variance of and and are its second and third moments.

Waiting time paradox

The fact that is also known variously as the waiting time paradox, inspection paradox, or the paradox of renewal theory. The paradox arises from the fact that the average waiting time until the next renewal, assuming that the reference time point is uniform randomly selected within the inter-renewal interval, is larger than the average inter-renewal interval. The average waiting is only when, that is when the renewals are always punctual or deterministic.

Special case: Markovian holding times

When the holding times are exponentially distributed with, the residual times are also exponentially distributed. That is because and:
This is a known characteristic of the exponential distribution, i.e., its memoryless property. Intuitively, this means that it does not matter how long it has been since the last renewal epoch, the remaining time is still probabilistically the same as in the beginning of the holding time interval.

Related notions

Renewal theory texts usually also define the spent time or the backward recurrence time as. Its distribution can be calculated in a similar way to that of the residual time. Likewise, the total life time is the sum of backward recurrence time and forward recurrence time.