Topic 7: The Second Law of Thermodynamics and Entropy#

Introduction#

In Section The Carnot cycle: the ‘perfect’ heat engine we said that no heat engine can possibly be more efficient than a Carnot engine, and in Section Introduction we said that when we place two bodies of different temperature in thermal contact, heat flows from the hotter body to the cooler body. These are, in fact, two statements of the Second Law of Thermodynamics:

No process can have as its sole result the transfer of heat from a colder to a hotter body (Clausius Statement)

In other words, heat does not flow spontaneously from cold to hot.

No engine working between two given temperatures can be more efficient than a Carnot engine (Carnot engine statement)

There is also a third statement of the Second Law:

No process can have as its sole result the complete conversion of heat into work (Kelvin statement)

The Clausius and Kelvin statements of the Second Law are in fact precisely equivalent, though this is not obvious at first glance, and the Carnot statement can be proved from the Clausius statement. Notice that both the Clausius and the Kelvin statements imply an arrow of time: if we were to consider a time-reversed version of Clausius statement, we would see heat flowing from the hotter body to the cooler, which is perfectly legitimate, and likewise a time-reversed version of the Kelvin statement would involve the complete conversion of work into heat, which is also legitimate.

Equivalence of the Clausius and Kelvin statements of the Second Law#

In order to prove that two statements A and B are equivalent, we need to prove that A implies B and B implies A. If that is the case, then whenever A is true, B is true, and vice versa, so thy are equivalent. For the Clausius and Kelvin statements, we can prove both implications by contradiction.

Clausius implies Kelvin#

Suppose that Claus’ statement is true but Kelvin’s is not. If Kelvin’s statement is not true we can build an engine K that converts heat into work. We connect this to a Carnot engine working in reverse as shown in Fig. 19.

If Kelvin is false, so is Clausius

Fig. 19 If Kelvin is false, so is Clausius.#

By the First Law, \(W = Q_K\) and also \(W = Q_{H} - Q_{C}\). Therefore \(Q_C{} = Q_{H} - Q_{K}\). Therefore the composite engine has the effect of taking heat \(Q_C\) from the cold reservoir and transferring it to the hot reservoir. But this is in violation of Clausius’ statement, which contradicts our initial assumption. Therefore, Clausius’ statement implies Kelvin’s statement.

Kelvin implies Clausius#

We can use the same approach here. Assume that Clausius’ statement is not true, and that we can therefore build a machine that simply transports heat \(Q_{C}^{'}\) from a cold reservoir to a hot reservoir. Connect this to a Carnot engine running forwards, which takes heat \(Q_{H}\) from a hot reservoir, does work \(W\), and rejects heat \(Q_{C}\). If we adjust the Clausius machine so that \(Q_{C} = Q_{C}^{'}\), then the combined engine takes in heat \(Q_{H} - Q_{C}\) and converts it completely to work, which violates Kelvin’s statement. Therefore, if Kelvin’s statement is true, Clausius’ statement must also be true.

Clausius implies Carnot#

Clausius' statement implies Carnot's.

Fig. 20 Clausius’ statement implies Carnot’s.#

Assume that Carnot’s statement is not true, and we can therefore build an engine \(E\) that has a higher efficiency than a Carnot engine. We connect this super-efficient engine to a Carnot engine running in reverse, as shown in Fig. 20. Engine \(E\) takes in heat \(Q_{H}^{'}\), does work \(W\), and ejects heat Q\(_{C}^{'}\); the Carnot engine takes in heat \(Q_{C}\) and the work done by engine \(E\), and ejects heat \(Q_{H}\). Since \(\eta = W/Q_{H}\), and we have assumed that \(\eta_{E} > \eta_{C}\), it follows that \(Q_{H}^{'} < Q_{H}\). The First Law tells us that

\[ Q_{H} - Q_{C} = Q_{H}^{'} - Q_{C}^{'} \]

(taking all the \(Q\)’s to be positive). Therefore \(Q_{C}^{'} < Q_{C}\) and the net effect of the combined engine is to take heat \(Q_{C} - Q_{C}^{'}\) from the cold reservoir and eject it into the hot reservoir, which violates Clausius’ statement, Therefore Clausius’ statement of the Second Law implies that engine \(E\) cannot exist.

The Third Law of Thermodynamics#

If we could run a Carnot engine with its cold reservoir at 0 K, we could violate Kelvin’s statement, because such an engine would have \(\eta\) = 1, and would therefore convert all the input heat into work. This is forbidden by the Third Law of Thermodynamics, Nernst’s statement of which is

It is impossible for any procedure to lead to the isotherm T = 0 in a finite number of steps.

Entropy#

From the Carnot cycle definition of thermodynamic temperature, Equation (36), we know that \(\frac{|Q_{H}|}{T_{H}} = \frac{|Q_{C}|}{T_{C}}\). Accounting properly for the signs, i.e. recognising that \(Q_{C} < 0\), we also have

(41)#\[\sum_{Cycle} \frac{\Delta Q}{T} = \frac{Q_H}{T_H} + \frac{Q_C}{T_C} = 0.\]

We can generalise this sum to an integral around a closed loop (imagine lots of mini Carnot cycles working between temperatures \(T\) and \(T+dT\), all satisfying Equation (41)):

(42)#\[\oint \frac{\bar{d} Q_{\rm rev}}{T} = 0.\]

This holds only if the loop consists entirely of reversible processes, which is why we put the label ‘rev’ in the \(\bar{d}Q\).

It follows from this that the quantity \(\bar{d}Q_{\rm rev}/T\) is an exact differential, i.e. the value of the integral between two states A and B is independent of the path taken.

Two arbitrary paths between states A and B

Fig. 21 Two arbritrary paths between states A and B#

To see this, consider states A and B in Fig. 21. The two paths connecting A and B are both reversible. We can integrate from A to B along path 1 and get \(\Delta S_{1} = \int_{1} \frac{\bar{d}Q}{T}\), or we can integrate along path 2 and get \(\Delta S_{2} = \int_{2} \frac{\bar{d}Q}{T}\). But we can also reverse the direction of path 2, since we have defined it to be reversible, and integrate from B to A, which must give us \(\int_{-2} \frac{\bar{d}Q}{T} = - \int_{2} \frac{\bar{d}Q}{T} = -\Delta S_{2}\), where the minus sign indicates that path 2 is taken in reverse.

Now, if we integrate from A to B via path 1, and then from B to A via path 2, we have completed a closed reversible cycle, and Eqn (42) tells us that

\[ \oint \frac{\bar{d} Q_{\rm rev}}{T} = \Delta S_{1} - \Delta S_{2} = 0. \]

Therefore since paths 1 and 2 were arbitrary, we must have

\[ \int_{A}^{B} \frac{\bar{d}Q_{\rm rev}}{T} = \Delta S_{1} \]

for any reversible path. Therefore \(\bar{d}Q_{\rm rev}/T\) is an exact differential. It follows that the quantity \(S\) defined by

(43)#\[dS = \frac{\bar{d}Q_{\rm rev}}{T}\]

is a function of state. We call \(S\) the entropy of the state.

This definition only allows us to calculate changes in entropy, \(\Delta S\); if we try to calculate the absolute value of \(S\) we have an undetermined integration constant. To calculate absolute values of \(S\) we need a microscopic definition in terms of individual particles. you will meet this definition (and show that it is equivalent to the definition in Eqn (42)) when you study statistical mechanics next year.

Entropy and the First Law#

We can write Eqn (42) as \(T dS = \bar{d} Q_{\rm rev}\). If we also assume that we are dealing with an ideal gas, such that \(\bar{d}W = -P dV\), we can write the differential form of the First Law as

(44)#\[dU = T dS - P dV\]

But now a miracle has occurred: everything in Eqn (44) is a function of state, and therefore Eqn (44) holds irrespective of the path taken. This can be very useful: if you want to calculate \(\Delta U\) for an irreversible process, and you know the start and end states, you can apply Eqn (44) to any reversible path between the start and end states and the result will be the same as for the irreversible process. (This doesn’t mean that the heat supplied and the work done will be the same: \(\bar{d}Q\) and \(\bar{d}W\) are still inexact differentials. But the changes in internal energy, entropy and volume will be the same.)

Entropy in reversible and irreversible processes#

So far we have considered entropy in the context of reversible processes. What about irreversible processes?

Irreversible processes are irreversible because energy has dissipated in a way that cannot be reversed .e.g friction. This is clearly not work: as we noted in Section 1, work is energy transfer associated with ordered motion, and is therefore reversible. Hence, if we suppose that the maximum work that can be extracted from a reversible transition between state A and state B is \(W_{\rm rev}\) (i.e. \(\Delta U = Q - W_{\rm rev}\), since we’ve defined \(W_{\rm rev}\) as work done by the system), we expect that an irreversible transition between the same two states will extract work \(W_{\rm irr} < W_{\rm rev}\).

If we make this transition infinitesimal, such that states A and B are very close together, we can write

\[ dU = \bar{d} Q_{\rm rev} - \bar{d} W_{\rm rev} = \bar{d} Q_{\rm irr} - \bar{d} W_{\rm irr} \]

(again, recall that the minus sign here is because the work is done by, not on, the system). So we have

(45)#\[dS = \frac{\bar{d}Q_{\rm rev}}{T} = \frac{\bar{d}Q_{\rm irr}}{T} + \frac{1}{T} \left( \bar{d}W_{\rm rev} - \bar{d} W_{\rm irr} \right) > \frac{\bar{d} Q_{\rm irr}}{T}.\]

This emphasises that the definition of \(S\) refers to the heat supplied in a reversible process. If you have an irreversible process, the definition \(dS = \bar{d}Q/T\) does not apply. This means that if we wish to calculate the entropy change associated with an irreversible process, we cannot simply integrate \(\bar{d}Q/T\). Fortunately, there is a solution to this, because entropy is a function of state: if we can define a reversible path with the same initial and final state, we can use this to calculate \(\Delta S\).

Entropy changes for example 7.1

Fig. 22 Entropy changes for example 7.1#

In the above example, the entropy change of the small system is negative when the system cools to equilibrium, and positive when it warms, as we would expect since the heat flow is negative when it cools (heat is transferred from the small system) and positive when it warms (heat is transferred to the small system). However, the total change in entropy, taking the surroundings into account, is always positive (except in the case where the two systems were already in equilibrium before being brought into contact). In contrast, if we have a reversible process, the entropy change in the surroundings will always balance the entropy change in the small system.

(46)#\[dS_{\rm tot}^{\rm rev} - dS_{\rm sys}^{\rm rev} + dS_{\rm surr}^{\rm rev} = 0\]

This is necessary so if the process is quasistatic, since - by definition - we are assuming in a quasistatic process that the system is essentially in equilibrium with its surroundings, i.e. at the same temperature. So, if the system receives heat \(\bar{d}Q_{\rm rev}\) from its surroundings at temperature \(T\), its entropy change is \(dS_{\rm sys} = \bar{d}Q_{\rm rev}/T\) and the entropy change of the surroundings is \(dS_{\rm surr} = -\bar{d}Q_{\rm rev}/T\).

This leads to yet another statement of the Second Law

The entropy of a thermally isolated system cannot decrease

Note the key qualifier: not just any system, but a thermally isolated system. If the system is not thermally isolated, by definition heat can flow into and out of the system, and this will be accompanied by a change in entropy, which can be positive or negative. This explains why we see many processes in nature, e.g. crystal growth, which appear to be associated with a decrease in entropy: in such cases the entropy of the system may indeed decrease, but it is not a thermally isolated system, and the decrease is compensated by an increase in the entropy of the surroundings, as in Example 7.1

The Universe is the ultimate thermally isolated system, so the entropy statement of the Second Law implies that the entropy of the Universe cannot decrease.

Entropy as a measure of disorder#

Total entropy increases in irreversible processes, but is zero in reversible processes. We saw that what makes a process irreversible is the dissipation of energy - in essence, some of the energy that would, in a reversible system, be released as work (ordered motion) is instead dissipated in some disordered fashion. Also, the entropy of a system increases when heat flows into it, and decreases when heat flows out of it, and we saw that heat is energy associated with disordered (i.e. random) motion. These observations suggest that entropy is in some way associated with disorder. This is indeed true, and you will explore the microscopic definition of entropy next year.