'Time' to wait to observe a events

MR_dice_icon.jpg  Download a complete copy of this risk analysis resource for free here.

See also: The Poisson process

Motivation

If you have understood the Poisson process and are willing to accept that a Gamma distribution models the time to wait to observe a events, this section is superfluous to your needs. We explain here:

Deriving the Exponential distribution

The Poisson process assumes that there is a constant probability that an event will occur per increment of time. If we consider a small element of time Dt, then the probability an event will occur in that element of time is kDt, where k is some constant. Now let P(t) be the probability that the event will not have occurred by time t. The probability that an event occurs the first time during the small interval Dt after time t is then kDtP(t). This is also equal to P(t) - P(t+Dt) and we have:

Making Dt infinitesimally small, this becomes the differential equation:

Integration gives:

If we define F(t) as the probability that the event will have occurred before time t (i.e. (1-P(t)), the cumulative distribution function for t), we then have:

which is the cumulative distribution function for an Exponential distribution Expon(1/k) with mean 1/k. Thus 1/k is the mean time between occurrences of events or, equivalently, k is the mean number of events per unit time, which is the Poisson parameter l. The parameter 1/l, the mean time between occurrences of events, is given the notation b.

Derivation of the Gamma distribution

We have shown above that the time until occurrence of the first event for a Poisson distribution is given by:

t1 = Expon(b)                         where b = 1/l

From the mathematics of convolutions we have:

image643.gif

For X = Gamma(a,b) and Y = Expon(b) this gives:

 

image645.gif

 

Since Gamma(1,b) = Y = Expon(b) we have proven by induction that:

image646.gif

The memoryless property of an Exponential distribution

The probability that the first event will occur at time x, given it has not yet occurred by time t (x>t), is given by:

 

 

which is another Exponential distribution. Thus, although the event may not have occurred after time t, the remaining time until it will occur has the same probability distribution as it had at any prior point in time.

 

 

See Also