Thermodynamics is the science of energy flow. Most energy flow in nature is electromagnetic radiation. The electromagnetic radiation has different names for different wavelengths: The longest wavelengths (longer than one centimeter) are called radiowaves, in the millimetric range, microwaves in the microns range, infrared (that we feel as “heat”) in the range between around 0.8 to 0.3 micron, visible waves or light. In the less than microns, ultraviolet or UV, the shortest wavelength is the X-ray and rays that can ionize molecules. The energy of the electromagnetic radiation is moving at the speed of light  and therefore it is, per definition, heat, namely transferred energy from the emitter to the absorber. Heat is characterized by its energy, entropy, and temperature. Hereafter we discuss in a unified way all these quantities for electromagnetic radiation and the laws that are derived from them.
Entropy is a measure of the uncertainty of a system. If a system can be found in distinguishable configurations (microstates), its entropy is the logarithm of multiplied by the Boltzmann constant kB. Therefore, if we assume that each microstate has identical probability as the others, entropy is the measure of lack of knowledge in what microstate the system is. Nevertheless, entropy interpreted as uncertainty mostly in information theory, and in sparse physical systems, like gases, it is described erroneously as a disorder. The concept of uncertainty in physics is dedicated to the Heisenberg uncertainty principle that formulates the limit of the accuracy of simultaneous measurements of energy and time or momentum and space, i.e. if we want to measure the energy with very high accuracy, we need to give up the time resolution, etc. In fact, the Heisenberg uncertainty principle is a direct outcome of Fourier wave analysis  that yields, that the distribution widths multiplication of any Fourier pair is greater than 1/2π, namely,
where is the spectral width, and is the coherence time, is the width of the wavenumber distribution and is the spatial coherence. This uncertainty bound 1/2π, depends on the profile of the beam, i.e. in a Gaussian beam the limit is 1/4π. These relations were known about 100 years before Heisenberg. Basically, Heisenberg following Planck invoked the Planck constant to connect between energy and frequency and momentum and wave number, namely and where is the energy and is the momentum in the direction of the propagation axis. Therefore, for a wave described by , Equation (1) yields the famous uncertainty principle,
Here we address the question, what is the contribution of the Heisenberg uncertainty principle to the entropy, which is also the uncertainty of the energy emission of blackbody radiation.
2. History: blackbody and Planck law
A blackbody is any materialistic body in thermal equilibrium and therefore has a well-defined temperature T. The materialistic particles reach thermal equilibrium by exchanging electromagnetic radiation, namely photons, with each other. The blackbody’s volume V contains many radiation modes, N, in all the frequencies and directions that are possible in its geometric boundaries. The blackbody is linked to a thermal bath of temperature T such that its temperature remains constant despite the electromagnetic radiation that it emits. Till Planck’s publication in 1901 , it was assumed that each oscillator, namely a radiation mode, carries kBT energy, where kB is the Boltzmann constant. This value is the average energy of a classical oscillator in a bath at temperature T (i.e. each oscillation degree of freedom in ideal gas has internal energy kBT). Therefore, to calculate the energy emitted by blackbody radiation we have to count the number of modes and multiply it by the average energy. The amount of heat Q emitted by the blackbody depends on the measuring time . Equation (1) yields that . However, we can increase the measuring time without changing the spectrum as long as we wish, namely . The ratio
, which is the number of the coherence length in the pulse, is called the number of longitudinal
The number of the possible oscillators per unit volume V, in a frequency interval , is derived from the number of radiation modes N calculated from Maxwell equation  is given by,
The fraction of the modes contained within a solid angle will be,
Now assume that a beam of duration emerges from a square on the blackbody surface having a cross-section . Its volume is and the number of modes that participate in its emission is,
Now we go back to Equation (2) and divide both sides of Equation (2) by . Since the wave vector , where is the wavelength, we obtain that , is
the diffraction limit angular divergence in the x direction and is the size of the spot of the focused beam in the x direction, therefore, and the minimum area resolution of the spot size is
. With analogy to the definition of longitudinal modes, the ratio between the spot size resolution and the diffraction limit resolution, namely is called the number of spatial
modes . We see that a spatially coherent beam, in which , cannot be resolved better than . Equation (5) now can be written as,
The number 2 stands for the two independent polarizations, is the number of the coherence length of a beam and is our ability to focus the beam as compared to the diffraction limit spot size .
N is a function of the temporal coherence and the spatial coherence and the polarization. The heat emitted from a blackbody is thus,
The entropy reduction of a Blackbody due to energy emission is,
Equations (7-8) are the expressions of the heat and entropy of N classical modes of electromagnetic
radiation. A single classical radiation mode has an energy and an entropy . This
well-known result is sometimes overlooked and it is assumed by some, that a single-mode pulse has zero entropy. The reason for this somewhat common mistake is that the expression of the entropy in statistical mechanics is proportional to the logarithm of the number of microstates. Since a single oscillator may be considered as one microstate, and since the logarithm of one is zero, one may conclude that a solitary event, well defined in space and time, has zero entropy. However, single-mode radiation, because of the Heisenberg uncertainty principle, has a built-in uncertainty (entropy) in the oscillation itself, namely the potential and the kinetic energy and the spatial resolution, therefore even a single classical oscillator has kB entropy. Moreover, if a single oscillator would have zero entropy since entropy is extensive, it would lead to the conclusion that any combination of single oscillators has zero entropy, including the blackbody radiation that is a plurality of oscillators in different modes. This conclusion is, of course, a violation of the second law. A simple proof that electromagnetic radiation should carry entropy can be demonstrated by building a heat machine which consists of a hot bath that is a blackbody at temperature TH and a cold bath that is also a blackbody with a temperature TC. We replace the cylinder with a piston that contains gas by an ideal fast shutter that can transmit or reflect the electromagnetic emitted radiation. Now we open the shutter for a very short time such that the energy of the electromagnetic radiation leaves the hot blackbody but not yet be absorbed by the cold blackbody. In the short time interval that the electromagnetic radiation is between the two black bodies, the entropy of the hot blackbody decreases but the entropy of the cold blackbody is not yet increased, therefore, if electromagnetic radiation does not carry, entropy, the second law is violated. The only explanation for this “paradox” is that the electromagnetic radiation must carry entropy equal to that removed from the hot blackbody.
Equation (7) is known as Rayleigh-Jeans approximation. The problem in Equation (7) is that when λ is very small, the number of the spatial modes increases to infinity and the blackbody should then emit an infinite amount of energy which is, of course, not possible. This problem was known as the “UV catastrophe”. In 1901 Planck replaced the frequency-independent average energy of a mode in Equation (2) with the famous frequency-dependent formula,
and added a new universal constant h to physics.
The famous Planck’s assumption is that energy is not continuous and can be divided into quanta hv that are a linear function of their frequencies. Therefore, a spatial radiation mode having a very small wavelength has a very high frequency and therefore its quantum, the photon, may have energy that is higher than kBT. Therefore, according to classical mechanics, it cannot emit energy.
In quantum mechanics, the emission of photons with energy higher than the average energy kBT is possible. The reason for this strange phenomenon is the uncertainty expressed by the entropy. The second law is about the propensity of entropy to grow. In a closed system, it will reach its maximum value where it cannot grow anymore. This point is the equilibrium point. Planck was the first to calculate the distribution of photons among the radiation modes that maximized the Boltzmann entropy under the constraint of conservation of energy . His technique is called today MaxEnt or microcanonical ensemble. Planck started by calculating the number of different microstates of B indistinguishable particles (photons having a given frequency) in N distinguishable boxes (radiation modes). This yields,
, applying Stirling’s approximation to calculate he obtained that,
Here Planck replaced the total number of particles B by which is the average number of particles in a box. To maximize the entropy, he applied the conservation of energy constraint
, where, q is the energy per mode, and therefore, to find the equilibrium distribution, he used Lagrange multiplier technique, namely to find the maximum of the function
with respect to n, where is a Lagrange multiplier, namely , where,
Since it can be shown that , he found out his famous result for n that maximizes the entropy namely,
Now the energy carried by a radiation mode is not but as given by Equation (9).
3. Classical limit: Zipf law
In the classical limit, the energy is continuous, the photon’s energy is infinitely small, and therefore the number of photons is infinitely large. We rewrite Equation (12) as
Since the energy of the mode is , in the classical limit where
And the entropy of a classical mode is , namely, one Boltzmann constant as was assumed in the Rayleigh-Jeans formula.
It is worth noting that both the entropy and the frequency of a classical oscillator are independent of its energy. The energy-independent frequency of the classical oscillators is used for time measurements i.e. pendulum clocks and watches. The energy-independent entropy of classical oscillators is used for digital communication . Since the entropy of a sequence of N classical bits is (N bits), theoretically, it is possible to recover the full content of a file, regardless of the unavoidable energy attenuation in its transmission. This explains the huge success of digital communication.
In the classical limit where the energy of the photon is very small, , therefore, from Equation (12) we can see that . Namely, the number of photons is the average energy of a mode
divided by the energy of the photon. That means that the higher the energy of photons the higher their frequency and smaller their number, n. Namely, there are more poor-energy photons than high-energy photons.
To find the exact ratio between the frequency v and the number of photons n in N modes, we normalize the photon energy of Equation (13), by dividing it in the total sum of the energies over the modes. Namely,
The normalized distribution is given by or:
, which is a parameter-free long-tail distribution, called the Planck-Benford distribution [7 - 9], is the relative energy of the modes having n photons as compared to the energy of all the N modes. It is seen that the higher the photon’s energy, the smaller the number of photons having this energy.
The reason for the surprising result, that the Planck-Benford distribution has no physical constants, is that in the classical limit the radiation modes are pure harmonic oscillators and therefore have the universal statistics of harmonic oscillators.
This outcome that in the energy normalization process all “physics” disappeared, namely: h, kB and T are canceled out, makes the Planck-Benford distribution more universal than the Maxwell-Boltzmann distribution. The Planck-Benford law is also the Maximum Entropy distribution of identical balls in N distinguishable boxes, where the number of balls is greater than the number of boxes . This statistics yields that there are more poor people than rich people (energy is money and people are modes), and there are more people in the big cities than there are in small villages (here people are the energy and cities are the modes). Planck-Benford law yields without any free parameter for the Benford law . For large N it yields Zipf law with slop 1 . In the Economy, it yields correctly the wealth distribution in the OECD countries, the average Gini inequality index in the OECD countries, the Pareto 80:20 law, the vote’s distribution among parties in democracies, the population of cities distribution and most of sociological statistics  .
Here we show that Planck-Benford law is the empirical Zipf law. Zipf law is a probability function found in many distributions in nature i.e. n people in N cities or the redundancy n of words in a text of N different words. Zipf law was found, empirically, to be, , where HN is the harmonic number and is some parameter (usually close to one). To show that Zipf law is Planck-Benford law with , we assume that n is a continuous function, therefore, we can use the Riemann sum to find the
area between two sequential integers n and , namely, . Similarly, the Harmonic number defined by becomes,
Note that the integration is until because we start to count the N ranks from and not from zero (from zero to one we are in the quantum regime). Now we can write Planck-Benford law as,
This is the Zipf law with slope 1.
4. Quantum limit: Maxwell-Boltzmann distribution
In the quantum limit, the photon energy has approximately 1/n times more energy than the average energy kBT. One may expect that the probability to emit photons will be also 1/n. However, from Equation (13) we see that in the quantum limit where , the frequency of a photon increases linearly with the temperature of the blackbody and logarithmically with the number of photons n. For very small n’s,
and . This equation usually is written as . When it is normalized, by dividing it by the probability partition function, , we obtain
the famous exponential “canonical energy distribution”.
The canonical distribution derivation deserves some remarks. Zipf law was obtained by energy normalization. However, the energy is inversely proportional to the number of photons in a mode that is proportional to probability. The canonical distribution was obtained directly by probability normalization
in which n was changed to p. The energy emission of a single-mode in this limit is, .
5. Stephan-Boltzmann Law
Stephan-Boltzmann law enables us to calculate the energy flux of a blackbody as a function of its temperature . The general expression of the emission of given single-mode radiation, having frequency v is obtained from Equation (12),
And the entropy of a single mode of frequency v is,
Let’s designate , therefore, the expression for the energy of a single-mode is , and its entropy is . See Figure 1,
To calculate the energy emission of a blackbody we have to integrate Equation (17) over all the temporal modes. Let us start with the emission of a single spatial mode. The energy flux is , is divided by the area of the spot size of a single spatial mode on the surface of the blackbody and multiplied by the two polarizations. Thus the energy flux is,
Since and , we obtain,
The finite integral where is Reimann zeta function, therefore, the energy flux of a single spatial mode is,
where has units of energy per unit area per unit time.
The entropy flux is,
One should remember that the area of a single-mode that is part of the integration, vary from zero to the significant part of the blackbody surface. This point deserves careful consideration. The
function is monotonically decreasing function as is seen in Figure 1. However, in the quantum limit has a maximum.
Figure 1. The entropy of a single oscillator in units of kB as a function of u. The expression of the entropy according to Planck law is where . The entropy of the oscillator reduces very fast from kB in the classical limit were to zero in the quantum limit, when .
The reason for this paradox is that quantum modes have very short wavelengths and the energy flux
increases by the factor as was derived in Equation (19). The function that obtained has a maximum.
Stephan-Boltzmann law was derived in the Ph. D. thesis of Boltzmann under the supervision of Stephan. The derivation was done by classical thermodynamics argumentations and therefore the value of the Stephan-Boltzmann constant was not calculated. The constant that was calculated later was an additional validation of Planck’s theory.
6. Wein’s Displacement law
Another quantity that derives from Planck’s law is the maximum frequency of a blackbody’s emission as a function of its temperature . Wein’s law was discovered several years before the Planck calculation
in 1901. Here it is derived from the Planck law. We start with remembering that , the energy per mode per unit blackbody surface is . To find the maximum frequency on the energy distribution we ask that or,
The function has poles; nevertheless, we can calculate it in the limits. In the classical limit , so then we obtain that and therefore .
In the quantum limit , therefore, .
Substitute and obtain,
In the classical limit and in the quantum limit .
Usually, Wein’s law applied to Maxwell-Boltzmann distribution, which is in the quantum regime. Therefore, Equation (23) converges very fast to the area where b is constant.
7. The temperature of the light
Temperature is considered a macroscopic property. However, a microscopic entity which its energy
can be measured and its entropy can be calculated from Clausius entropy definition , has a temperature. One should ask, what is the physical meaning of it?
In the classical approximation, the answer is straightforward: energy flows from the hot to the cold. I.e. two identical classical pendulums, one hot with high amplitude and one cold with low amplitude, if they linked together, their amplitudes will eventually equate. The laser beam is a classical oscillator as , its beam temperature is the maximum temperature that it can heat a materialistic object. Consider a laser beam having power P and coherence length , therefore, its coherence time is . The
energy per mode is the energy within the coherence time. Therefore, . The temperature of the beam is,
I.e. HeNe laser having a power of 1 mW and coherence length 30 cm yields a temperature of about 1010 K and the energy of a mode is about 10−13 J (1 mW∙0.3/c). This is a very high temperature, but not infinite as it is usually assumed. Nevertheless, for any practical reason, this temperature is equivalent to infinite temperature. The reason that the HeNe laser beam does not fit for heating is its negligible energy per mode 10−13 J. Namely, to heat 1 gram of water in one degree Kelvin one needs about 4 × 1013 modes, which means, of about 4 hours of heating.
Digital communication is done by a transmission of a file that is a sequence of classical oscillators from Bob to Alice. Therefore, the entropy of the file which reflects its amount of data in it is not a function of the temperature of the bits. Nevertheless, we want that it will be well above the ambient’s temperature such that the thermal noise will not add noise bits the file. Therefore the power namely, the temperature of our antenna has practical importance.
The general expression of the temperature of EM radiation is given by Planck expression of Equation (12) for the occupation number n, that can be rewritten as,
It is seen that when n approach to zero both the entropy and the temperature are approaching zero. Entropy is heat divided by the temperature, therefore we might expect that zero temperature will yield infinite entropy, like in a zero temperature bath. The explanation to this “abnormality”, namely that
, is that the energy reduces exponentially to zero, while the temperature decay linearly. From Equation (17) we obtain that in the quantum limit . The temperature of Equation (25), when we multiply by n both nominator and the denominator, yields . Therefore in the quantum limit the temperature converges to zero linearly with n while
the heat converges exponentially so that both temperature and entropy approach to zero when n approach to zero.
How to calculate this temperature? Suppose that we want to measure the temperature of a single photon, a single spatial mode source. We need a sensitive detector that can detect a single photon. Suppose that we measure on the average, P single photons over a time period . The detector is equipped with a filter that passes the frequency v, and its bandwidth is . The number of modes . The
occupation number is . Photons with a narrower bandwidth can also pass the filter, therefore, and .
Can we transmit data with single-photon files? Suppose that we have a file composed of HeNe single-photons bits. We ask that its temperature will be at least ten times higher than that of the ambient, to
reduce thermal noise, namely . At room temperature , thus we obtain or , that is an acceptable limit for communication.
EM radiation is heat. In thermodynamics, heat is characterized by two independent quantities, energy and entropy. EM radiation has many more characteristics namely; frequency, spectral distribution, temporal distribution, temporal coherence, spatial coherence, beam profile, polarization, and direction. How all these properties are connected to that of heat in general? Planck’s law connects between the numbers of photons in a mode (occupation number) and their frequency in a thermal bath (blackbody) of a given temperature. Here we use the spectral distribution, temporal distribution, temporal coherence, spatial
Figure 2. (a) The temperature of a mode (in units of hv/kB) as a function of occupation number of single modes. I.e. for HeNe laser each unit is about 2.28 × 104 K. (b) The same as Figure 2(a) but for small n’s (within the rectangular of Figure 2(a) in the quantum limit).
coherence, beam profile, and polarization to calculate the number of modes. From the EM beam’s power, we calculate the number of photons. This enables us to calculate for EM radiation the entropy and the energy of a mode that is consistent with Planck’s law.
It is shown that the EM radiation statistics vary smoothly from the classical limit in which all the radiation modes in equilibrium have an energy of kBT like in ideal gas oscillators and the quantum limit in which most of the modes are empty and some have very high energy as compared to kBT. Using Planck law, we review in a consistent way the calculation of all the thermodynamical properties, namely classical energy distribution—Zipf law; quantum energy distribution—Maxwell Boltzmann law; Energy flux—Stephan-Boltzmann law, and maximum frequency—Wein displacement law.
The entropy of a single-mode as given by Equation (18) namely where , monotonically increases from zero at very low occupation number in which u is very
large namely, to when the occupation number is going to infinity namely and . From Equation (25) it is seen that for low occupation number temperature increases monotonically from zero in low occupation number to infinity in a very large occupation number.
List of Symbols
: spectral width
: coherence time
: wavenumber’s width
: spatial coherence
h: Planck constant
: speed of light
N: radiation modes
Nl: longitudinal modes
Ns: Spatial modes
: Solid angle
a: beam waist
kB: Boltzmann constant
q: heat per mode
: measuring time
s: entropy per mode
n: occupation number – the number of photons in a mode
B: total number of photons
W: number of microstates
: Lagrange multiplier
: normalized distribution of frequency
HN: Harmonic number
ZP: canonical partition function
u: the energy of a photon relative to the average energy.
I: energy flux
: The frequency of maximum emission of a blackbody.
: The wavelength of maximum emission of a blackbody
b: Stephan Boltzmann constant
 Kafri, O. and Kafri, H. (2013) Entropy-God’s Dice Game. CreateSpace, 198-201.