Elementary Principles in Statistical Mechanics/Chapter V

CHAPTER V.

AVERAGE VALUES IN A CANONICAL ENSEMBLE OF SYSTEMS.

In the simple but important case of a system of material points, if we use rectangular coördinates, we have for the product of the differentials of the coördinates

and for the product of the differentials of the momenta
The product of these expressions, which represents an element of extension-in-phase, may be briefly written
and the integral
(118)
will represent the probability that a system taken at random from an ensemble canonically distributed will fall within any given limits of phase.

In this case

(119)
and
(120)
The potential energy () is independent of the velocities, and if the limits of integration for the coördinates are independent of the velocities, and the limits of the several velocities are independent of each other as well as of the coördinates, the multiple integral may be resolved into the product of integrals
(121)
This shows that the probability that the configuration lies within any given limits is independent of the velocities, and that the probability that any component velocity lies within any given limits is independent of the other component velocities and of the configuration.

Since

(122)
and
(123)
the average value of the part of the kinetic energy due to the velocity , which is expressed by the quotient of these integrals, is . This is true whether the average is taken for the whole ensemble or for any particular configuration, whether it is taken without reference to the other component velocities, or only those systems are considered in which the other component velocities have particular values or lie within specified limits.

The number of coördinates is or . We have, therefore, for the average value of the kinetic energy of a system

(124)
This is equally true whether we take the average for the whole ensemble, or limit the average to a single configuration.

The distribution of the systems with respect to their component velocities follows the 'law of errors'; the probability that the value of any component velocity lies within any given limits being represented by the value of the corresponding integral in (121) for those limits, divided by , which is the value of the same integral for infinite limits. Thus the probability that the value of lies between any given limits is expressed by

(125)
The expression becomes more simple when the velocity is expressed with reference to the energy involved. If we set
the probability that lies between any given limits is expressed by
(126)
Here is the ratio of the component velocity to that which would give the energy ; in other words, is the quotient of the energy due to the component velocity divided by . The distribution with respect to the partial energies due to the component velocities is therefore the same for all the component velocities.

The probability that the configuration lies within any given limits is expressed by the value of

(127)
for those limits, where denotes the product of all the masses. This is derived from (121) by substitution of the values of the integrals relating to velocities taken for infinite limits.

Very similar results may be obtained in the general case of a conservative system of degrees of freedom. Since is a homogeneous quadratic function of the 's, it may be divided into parts by the formula

(128)
where might be written for in the differential coefficients without affecting the signification. The average value of the first of these parts, for any given configuration, is expressed by the quotient
(129)
Now we have by integration by parts
(130)
By substitution of this value, the above quotient reduces to , which is therefore the average value of for the given configuration. Since this value is independent of the configuration, it must also be the average for the whole ensemble, as might easily be proved directly. (To make the preceding proof apply directly to the whole ensemble, we have only to write for in the multiple integrals.) This gives for the average value of the whole kinetic energy for any given configuration, or for the whole ensemble, as has already been proved in the case of material points.

The mechanical significance of the several parts into which the kinetic energy is divided in equation (128) will be apparent if we imagine that by the application of suitable forces (different from those derived from and so much greater that the latter may be neglected in comparison) the system was brought from rest to the state of motion considered, so rapidly that the configuration was not sensibly altered during the process, and in such a manner also that the ratios of the component velocities were constant in the process. If we write

for the moment of these forces, we have for the period of their action by equation (3)
The work done by the force may be evaluated as follows:
where the last term may be cancelled because the configuration does not vary sensibly during the application of the forces. (It will be observed that the other terms contain factors which increase as the time of the action of the forces is diminished.) We have therefore,
(131)
For since the 's are linear functions of the 's (with coefficients involving the 's) the supposed constancy of the 's and of the ratios of the 's will make the ratio constant. The last integral is evidently to be taken between the limits zero and the value of in the phase originally considered, and the quantities before the integral sign may be taken as relating to that phase. We have therefore
(132)
That is: the several parts into which the kinetic energy is divided in equation (128) represent the amounts of energy communicated to the system by the several forces under the conditions mentioned.

The following transformation will not only give the value of the average kinetic energy, but will also serve to separate the distribution of the ensemble in configuration from its distribution in velocity.

Since is a homogeneous quadratic function of the 's, which is incapable of a negative value, it can always be expressed (and in more than one way) as a sum of squares of linear functions of the 's.[1] The coefficients in these linear functions, like those in the quadratic function, must be regarded in the general case as functions of the 's. Let

where are such linear functions of the 's. If we write
for the Jacobian or determinant of the differential coefficients of the form , we may substitute
for
under the multiple integral sign in any of our formulæ. It will be observed that this determinant is function of the 's alone. The sign of such a determinant depends on the relative order of the variables in the numerator and denominator. But since the suffixes of the 's are only used to distinguish these functions from one another, and no especial relation is supposed between a and a which have the same suffix, we may evidently, without loss of generality, suppose the suffixes so applied that the determinant is positive.

Since the 's are linear functions of the 's, when the integrations are to cover all values of the 's (for constant 's) once and only once, they must cover all values of the 's once and only once, and the limits will be for all the 's. Without the supposition of the last paragraph the upper limits would not always be , as is evident on considering the effect of changing the sign of a . But with the supposition which we have made (that the determinant is always positive) we may make the upper limits and the lower for all the 's. Analogous considerations will apply where the integrations do not cover all values of the 's and therefore of the 's. The integrals may always be taken from a less to a greater value of a .

The general integral which expresses the fractional part of the ensemble which falls within any given limits of phase is thus reduced to the form

(134)

For the average value of the part of the kinetic energy which is represented by whether the average is taken for the whole ensemble, or for a given configuration, we have therefore

(135)
and for the average of the whole kinetic energy, , as before.

The fractional part of the ensemble which lies within any given limits of configuration, is found by integrating (184) with respect to the 's from to . This gives

(136)
which shows that the value of the Jacobian is independent of the manner in which is divided into a sum of squares. We may verify this directly, and at the same time obtain a more convenient expression for the Jacobian, as follows.

It will be observed that since the 's are linear functions of the 's, and the 's linear functions of the 's, the 's will be linear functions of the 's, so that a differential coefficient of the form will be independent of the 's, and function of the 's alone. Let us write for the general element of the Jacobian determinant. We have

(137)
Therefore
(138)
and
(139)

These determinants are all functions of the 's alone.[2] The last is evidently the Hessian or determinant formed of the second differential coefficients of the kinetic energy with respect to . We shall denote it by . The reciprocal determinant

which is the Hessian of the kinetic energy regarded as function of the 's, we shall denote by .

If we set

(140)
and
(141)
the fractional part of the ensemble which lies within any given limits of configuration (136) may be written
(142)
where the constant may be determined by the condition that the integral extended over all configurations has the value unity.[3]

When an ensemble of systems is distributed in configuration in the manner indicated in this formula, i. e., when its distribution in configuration is the same as that of an ensemble canonically distributed in phase, we shall say, without any reference to its velocities, that it is canonically distributed in configuration.

For any given configuration, the fractional part of the systems which lie within any given limits of velocity is represented by the quotient of the multiple integral

or its equivalent
taken within those limits divided by the value of the same integral for the limits . But the value, of the second multiple integral for the limits is evidently
We may therefore write
(143)

or

(144)
or again
(145)
for the fractional part of the systems of any given configuration which lie within given limits of velocity.

When systems are distributed in velocity according to these formulae, i. e., when the distribution in velocity is like that in an ensemble which is canonically distributed in phase, we shall say that they are canonically distributed in velocity.

The fractional part of the whole ensemble which falls within any given limits of phase, which we have before expressed in the form

(146)
may also be expressed in the form
(147)

  1. The reduction requires only the repeated application of the process of 'completing the square' used in the solution of quadratic equations.
  2. It will be observed that the proof of (137) depends on the linear relation between the 's and 's, which makes constant with respect to the differentiations here considered. Compare note on p. 12.
  3. In the simple but important case in which is independent of the 's, and a quadratic function of the 's, if we write for the least value of (or of ) consistent with the given values of the external coördinates, the equation determining may be written
    If we denote by the values of which give its least value , it is evident that is a homogenous quadratic function of the differences , etc., and that may be regarded as the differentials of these differences. The evaluation of this integral is therefore analytically similar to that of the integral
    for which we have found the value . By the same method, or by analogy, we get
    where is the Hessian of the potential energy as function of the 's. It will be observed that depends on the forces of the system and is independent of the masses, while or its reciprocal depends on the masses and is independent of the forces. While each Hessian depends on the system of coördinates employed, the ratio is the same for all systems.

    Multiplying the last equation by (140), we have

    For the average value of the potential energy, we have

    The evaluation of this expression is similar to that of

    which expresses the average value of the kinetic energy, and for which we have found the value . We have accordingly

    Adding the equation

    we have