Phase Space and Liouville's Theorem
In statistical mechanics, we often deal with systems that have a very large number of particles. It's impossible to track the exact position and momentum of each individual particle. Instead, we use a probabilistic approach. To do this, we need a way to represent the state of the entire system at any given moment. This is where the concept of phase space comes in.
Phase Space
Phase space is a multi-dimensional abstract space where each dimension represents a degree of freedom of the system. For a single particle moving in one dimension, its state can be described by its position (q) and its momentum (p). So, the phase space for this single particle would be a 2-dimensional space with axes q and p.
For a system of N particles in three dimensions, each particle has 3 position coordinates (x, y, z) and 3 momentum coordinates (px, py, pz). Therefore, a system of N particles has 3N position coordinates and 3N momentum coordinates. The total number of dimensions in the phase space for such a system is 6N. A single point in this 6N-dimensional phase space represents the instantaneous state of the entire system.
As the system evolves over time, the point representing its state traces out a trajectory in phase space.
Liouville's Theorem
Liouville's theorem is a fundamental result in classical statistical mechanics. It states that the density of states in phase space remains constant along the trajectory of a system. In simpler terms, if you consider a collection of systems (an ensemble) starting from different initial states but evolving under the same Hamiltonian, the volume occupied by these systems in phase space remains constant over time.
Mathematically, let ρ(q, p, t) be the probability density function in phase space. Liouville's theorem states that the total time derivative of ρ is zero:
where f is the number of degrees of freedom (f = 6N for N particles in 3D), qi are the generalized coordinates, and pi are the corresponding generalized momenta.
The terms and
are related to the Hamiltonian of the system by Hamilton's equations of motion:
Substituting these into the total time derivative equation, we get:
The term in the parenthesis is the Poisson bracket {H, ρ}. So, the equation can be written as:
This means that if the probability density is not explicitly dependent on time (), then the density is conserved along the trajectories.
Microcanonical Ensemble
An ensemble is a collection of a large number of identical systems that are macroscopically indistinguishable but microscopically different. We use ensembles to calculate the average properties of a system.
The microcanonical ensemble is one of the fundamental ensembles in statistical mechanics. It represents an isolated system, meaning it does not exchange energy or particles with its surroundings.
Key characteristics of a system in the microcanonical ensemble:
- Fixed Energy (E): The total energy of the system is constant.
- Fixed Volume (V): The system is confined to a fixed volume.
- Fixed Number of Particles (N): The number of particles in the system is constant.
According to the postulates of statistical mechanics, for an isolated system in equilibrium, all accessible microstates corresponding to a given total energy E are equally probable.
If is the number of microstates with energy between E and E + δE (where δE is a small energy range), then the probability of finding the system in any one of these microstates is:
for each accessible microstate i.
The total number of microstates Ω is related to the entropy (S) of the system by Boltzmann's famous formula:
where kB is Boltzmann's constant. This equation is a cornerstone of statistical mechanics, bridging the microscopic world of states and the macroscopic world of thermodynamics.
Statistical Equations and Thermodynamic Functions of an Ideal Gas
An ideal gas is a theoretical gas composed of point particles that move randomly and do not interact with each other, except through perfectly elastic collisions. Despite its simplicity, the ideal gas model provides a good approximation for the behavior of many real gases at low pressures and high temperatures.
We use ensembles to derive the thermodynamic properties of an ideal gas. For an ideal gas, the Hamiltonian is simply the sum of the kinetic energies of the individual particles, as there are no potential energy terms due to interactions.
For N particles, each of mass m, moving in a volume V, the Hamiltonian is:
The Canonical Ensemble
While the microcanonical ensemble describes isolated systems, the canonical ensemble is more convenient for deriving thermodynamic properties when a system is in thermal contact with a heat reservoir at a constant temperature T. In this ensemble, the system can exchange energy with the reservoir, but its volume and number of particles are fixed.
The probability of a system being in a particular microstate with energy Ei is given by the Boltzmann distribution:
where kB is Boltzmann's constant, T is the absolute temperature, and Z is the partition function. The partition function is a normalization constant and is defined as the sum of the Boltzmann factors over all possible microstates:
Partition Function for an Ideal Gas
For a system of N non-interacting identical particles (an ideal gas), the total energy is the sum of individual particle energies. This simplifies the calculation of the partition function.
First, consider the partition function for a single particle (z1):
We can treat the sum over states as an integral over phase space. For a single particle in volume V, the integral is:
Here, h is Planck's constant (introduced for quantum mechanical reasons, though we are primarily dealing with classical mechanics here, it provides the correct units and scale), and
.
The spatial integral over the volume V simply gives V.
The momentum integral is a standard Gaussian integral:
For the momentum integral, a = 1 / (2mkBT). So, the integral over is:
Therefore, the single-particle partition function is:
For N identical, indistinguishable particles, the system partition function Z is related to z1 by:
The N! in the denominator accounts for the indistinguishability of the particles (Gibbs paradox correction).
Substituting z1:
Thermodynamic Functions of an Ideal Gas
Once we have the partition function, we can derive all macroscopic thermodynamic properties.
-
Helmholtz Free Energy (F):
Substituting Z:
Using Stirling's approximation for ln(N!) ≈ N ln N - N:
-
Internal Energy (U):
where β = 1 / kBT.
Alternatively, and more directly from F:
and S = -(\partial F / \partial T)_V.
From F = -N k_B T \ln(\dots), we find the internal energy to be:
This result aligns perfectly with the equipartition theorem.
-
Entropy (S):
This is the Sackur-Tetrode equation for the entropy of a monatomic ideal gas.
-
Pressure (P):
Rearranging gives the ideal gas law: PV = NkBT.
Equipartition of Energy
The equipartition theorem is a classical statistical mechanics result that states that, in thermal equilibrium, each degree of freedom that appears quadratically in the Hamiltonian contributes an average energy of kBT / 2 per particle.
Degrees of Freedom
A degree of freedom refers to an independent parameter that specifies the configuration of a system. For a particle, these are typically its coordinates.
- Translational degrees of freedom: These correspond to the motion of the center of mass of the particle or molecule. A free particle in 3D space has 3 translational degrees of freedom (along x, y, and z axes). The kinetic energy associated with these is (1/2)mvx2, (1/2)mvy2, and (1/2)mvz2. In terms of momentum, it's px2 / 2m, py2 / 2m, and pz2 / 2m.
- Rotational degrees of freedom: These correspond to the rotation of a molecule about its center of mass. A linear molecule (like O2 or CO) has 2 rotational degrees of freedom. A non-linear molecule (like H2O) has 3 rotational degrees of freedom. The energy associated with rotation is also quadratic in angular velocity or angular momentum.
- Vibrational degrees of freedom: If a molecule is treated as a system of atoms connected by springs, the vibrations of these atoms relative to each other contribute vibrational degrees of freedom. Each vibrational mode contributes both kinetic and potential energy terms that are quadratic in the vibrational coordinate and momentum. A single vibrational mode contributes kBT on average (one kBT / 2 from kinetic energy and one kBT / 2 from potential energy).
Statement of the Theorem
The equipartition theorem states that if the Hamiltonian of a system can be written as a sum of terms, each depending on a single coordinate or momentum squared, then the average value of each such term in thermal equilibrium is kBT / 2.
Consider a term in the Hamiltonian of the form A x2 or B p2, where x or p is a coordinate or momentum and A or B is a positive constant. The average value of this term is given by:
Using standard Gaussian integral results (∫ x2 e-ax2 dx = (1/2a)√(π/a) and ∫ e-ax2 dx = √(π/a)), with a = A / kBT:
Similarly, for a momentum term B p2, the average kinetic energy is B 2> = kBT / 2
Applications to Ideal Gases
Let's apply this to different types of ideal gases:
-
Monatomic Ideal Gas (e.g., He, Ne, Ar):
Molecules are single atoms. They have 3 translational degrees of freedom. At moderate temperatures, rotation and vibration are not significantly excited.
Average energy per molecule = 3 × (kBT / 2) = (3/2)kBT.
This matches the internal energy U = (3/2)NkBT derived from the partition function.
The molar heat capacity at constant volume (CV) is the energy change per mole per degree Kelvin. For 1 mole, N = NA (Avogadro's number), and NAkB = R (the universal gas constant).
U = (3/2)NkBT
CV = (∂U/∂T)V / mole = (3/2)R.
-
Diatomic Ideal Gas (e.g., H2, N2, O2):
Molecules have 3 translational degrees of freedom and 2 rotational degrees of freedom (rotation about axes perpendicular to the bond). Vibration is often not significant at room temperature.
At moderate temperatures (room temperature): 3 translational + 2 rotational = 5 degrees of freedom.
Average energy per molecule = 5 × (kBT / 2) = (5/2)kBT.
Molar heat capacity CV = (5/2)R.
At high temperatures: Vibration becomes active. Each vibrational mode contributes kBT (kinetic + potential). So, 3 translational + 2 rotational + 2 vibrational (for a diatomic molecule's internal motion) = 7 degrees of freedom.
Average energy per molecule = 7 × (kBT / 2) = (7/2)kBT.
Molar heat capacity CV = (7/2)R.
Note: The vibrational modes are excited at higher temperatures due to quantum effects; the equipartition theorem strictly applies in the classical limit. However, it provides a good framework for understanding the trends.
-
Polyatomic (Non-linear) Ideal Gas (e.g., H2O):
3 translational + 3 rotational degrees of freedom.
At moderate temperatures: 6 degrees of freedom.
Average energy per molecule = 6 × (kBT / 2) = 3kBT.
Molar heat capacity CV = 3R.
- Translational: 3 degrees of freedom (contributes 3kBT/2 per molecule)
- Rotational (Linear): 2 degrees of freedom (contributes 2kBT/2 per molecule)
- Rotational (Non-linear): 3 degrees of freedom (contributes 3kBT/2 per molecule)
- Vibrational: Each mode contributes kBT per molecule (kinetic + potential)
Limitations of Equipartition Theorem
The equipartition theorem is a classical result and breaks down at low temperatures where quantum effects become important. For example, rotational and vibrational degrees of freedom are "frozen out" at low temperatures, meaning they do not contribute to the heat capacity because the energy quanta required to excite them are larger than the available thermal energy (kBT).
The theorem assumes that all degrees of freedom contribute quadratically to the Hamiltonian. This is true for simple harmonic oscillators and free particles but may not hold for more complex systems.