Apparent overdetermination in Maxwell's equations and the weirdness of curl
Maxwell’s equations seem to have more equations than degrees of freedom (‘unknowns’) in many reasonable problems, forming an overdetermined system. Writing the equations as $$\begin{align} \nabla \cdot \mathbf {E} &= \rho/\varepsilon_0 , \label{eq:m1}\tag{1}\\ \nabla \cdot \mathbf {B} &= 0 , \label{eq:m2}\tag{2}\\ \nabla \times \mathbf{E} &= -\dot{\mathbf{B}} , \label{eq:m3}\tag{3}\\ \nabla \times \mathbf{B} &= \mu_0 \mathbf{J} + \mu_0 \varepsilon_0 \dot{\mathbf{E} } , \label{eq:m4}\tag{4} \end{align}$$ we see that we have 8 scalar equations in total, since (\ref{eq:m3}) and (\ref{eq:m4}) each have 3 components. Let’s think about a very common and reasonable class of problem: given some specified $\mathbf{J}$ and $\rho$ that satisfy the charge continuity equation1 ${\dot{\rho} + \nabla \cdot \mathbf{J} = 0}$, what are the resulting $\mathbf{E}$ and $\mathbf{B}$? The degrees of freedom are the components of $\mathbf{E}$ and $\mathbf{B}$, so we have only 6 dofs and things don’t look good for this problem — it seems like there won’t in general be enough freedom in $\mathbf{E}$ and $\mathbf{B}$ to satisfy the equations!?
There’s a fairly well known ‘solution’ to this alarming observation2$^,$3$^,$4$^,$5, which goes something like this: Take the divergence of (\ref{eq:m3}) and (\ref{eq:m4}) and exchange the order of time and space derivatives to get $$\begin{align} 0 &= -\frac{\mathrm{d}}{\mathrm{d}t}\left({\nabla \cdot \mathbf{B}} \right), \label{eq:m3div}\tag{5}\\ 0 &= \nabla \cdot \mathbf{J} + \frac{\mathrm{d}}{\mathrm{d}t} \left( \nabla \cdot \varepsilon_0 \mathbf{E} \right) . \label{eq:m4div}\tag{6} \end{align}$$ If we sub our charge continuity condition into the latter it becomes $$0 = \frac{\mathrm{d}}{\mathrm{d}t} \left( \nabla \cdot \mathbf{E} -\rho/ \varepsilon_0 \right) . \label{eq:m4div2}\tag{7}$$ From (\ref{eq:m3div}) and (\ref{eq:m4div2}), we see that as long as the initial $\mathbf{E}$ and $\mathbf{B}$ satisfy (\ref{eq:m1}) and (\ref{eq:m2}), both (\ref{eq:m1}) and (\ref{eq:m2}) are actually redundant in describing the evolution, because (\ref{eq:m3}) and (\ref{eq:m4}) will automatically ensure that (\ref{eq:m1}) and (\ref{eq:m2}) remain satisfied for all time6.
I don’t find this ‘solution’ fully satisfying for at least one reason: it leans on time dynamics in a big way, but electrostatics should be a perfectly well defined (and self-contained) subset of electromagnetic theory, completely consistent with Maxwell’s equations and with no overdetermination problems. In electrostatics we can for sure specify whatever charge distribution $\rho$ we like, and then find the resulting $\mathbf{E}$, while $\mathbf{B}=\mathbf{J}=\mathbf{0}$. But the Maxwell’s equations corresponding to such an electrostatic problem also appear to be overdetermined, in just the same way as before! The components of $\mathbf{E}$ are our 3 dofs, and we have to solve the equations $$\begin{align} \nabla \cdot \mathbf {E} &= \rho/\varepsilon_0 , \label{eq:estat1}\tag{8}\\ \nabla \times \mathbf{E} &= 0, \label{eq:estat2}\tag{9} \end{align}$$ given some specified static $\rho$. This is 4 scalar equations! In my opinion, a complete understanding of the overdetermination problem must be able to explain this problem, in which time does not feature at all.
I believe that it basically boils down to the subtleties of the curl operator, and that (\ref{eq:estat2}) is effectively only 2 scalar equations. Consider how we actually solve this problem usually: we replace (\ref{eq:estat2}) with $\mathbf{E} = -\nabla \phi$, and sub into (\ref{eq:estat1}) to get the Poisson equation for $\phi$ (see my note Electrostatics and simply connectedness for a standard derivation of this). Notice what’s happened here — as soon as we replace (\ref{eq:estat2}) with $\mathbf{E} = -\nabla \phi$, we have only a 1-dof field $\phi$, whereas before we had 3 dofs. In other words, the 3 scalar equations (\ref{eq:estat2}) actually only eliminate 2 dofs to leave us with 1, even though you might expect them to eliminate 3…sorcery!
We can look at magnetostatics similarly: $$\begin{align} \nabla \cdot \mathbf {B} &= 0, \label{eq:mstat1}\tag{10}\\ \nabla \times \mathbf{B} &= \mu_0 \mathbf{J}, \label{eq:mstat2}\tag{11} \end{align}$$ for some given static $\mathbf{J}$ that has $\nabla \cdot \mathbf{J} = 0$. Again, 3 dofs and 4 scalar equations on the face of it. But if we again take the curl equation to only be 2 scalar equations effectively, then we see that the problem is actually properly determined.
I think these statics examples tell us that the curl of any field in some sense only ‘operates on’ two degrees of freedom that the field has, hence why setting the curl equal to zero still leaves the field with a single dof. This weirdness of curl is consistent with the Helmholtz decomposition, which splits a very general 3-dof field into a 1-dof $\nabla \phi$ term, and a divergenceless part that has a curl — the part that has a curl must therefore only correspond to 2 dofs! Sadly, I haven’t really come up with any intuition for why curl has this property — you might say “it’s because ${\mathrm{div}\, \mathrm{curl} = 0}$ shows that the 3 components of a curl have a constraint relating them, so there are only 2 dofs” …but you could say something similar about $\mathrm{curl}\, \mathrm{grad} = 0$, which doesn’t eliminate the single dof that a term like $\nabla \phi$ has! Plus, I don’t think ${\mathrm{div}\, \mathrm{curl} = 0}$ is any more intuitive really.
Anyway, inspired by the static cases, my preferred ‘solution’ to the apparent overdetermination of the full Maxwell equations is that the two curl equations (\ref{eq:m3}) and (\ref{eq:m4}) should each be interpreted as 2 scalar constraints each rather than 3. This is somewhat the other way round from the conventional ‘solution’: I’d say that the divergence equations (\ref{eq:m1}) and (\ref{eq:m2}) provide 1 constraint each, removing 1 dof from $\mathbf{E}$ and 1 from $\mathbf{B}$, and also guaranteeing that the curl equations (\ref{eq:m3}) and (\ref{eq:m4}) have divergenceless fields on both sides and so are mathematically consistent. Via the weirdness of curl, (\ref{eq:m3}) then constrains both of the remaining 2 dofs in $\mathbf{E}$, and (\ref{eq:m4}) does the same for $\mathbf{B}$. Thinking in Helmholtz decomposition terms, (\ref{eq:m1}) and (\ref{eq:m2}) are equations constraining the (1-dof) grad parts of $\mathbf{E}$ and $\mathbf{B}$ respectively, while (\ref{eq:m3}) and (\ref{eq:m4}) are equations constraining the other (2-dof, divergenceless) parts. Everything adds up, and this way of looking at things works for both the static and time-varying cases!
Finally, I’ll just note that another angle on all this: if we write $\mathbf{E}$ and $\mathbf{B}$ in terms of potentials $\mathbf{E} = -\nabla\phi - \dot{\mathbf{A}}$ and $\mathbf{B} = \nabla \times \mathbf{A}$, and go back to the full Maxwell’s equations, then (\ref{eq:m2}) and (\ref{eq:m3}) are satisfied automatically, so we’re left with 4 scalar equations, and 4 scalar unknowns $\phi$ and $\mathbf{A}$. But the system you’re left with, $$\begin{align} -\nabla^2 \phi - \nabla \cdot \dot{\mathbf{A}} &= \rho/\varepsilon_0 , \tag{12}\\ \nabla \times (\nabla \times \mathbf{A}) &= \mu_0 \mathbf{J} - \mu_0 \varepsilon_0 (\nabla \dot{ \phi} + \ddot{\mathbf{A}}) , \tag{13} \end{align}$$ is actually underdetermined! The curl equation is again really only providing 2 constraints, even though it is 3 scalar equations. We can also see it like this: if you have a solution to the above system, then you get another solution by adding any $\nabla f$ to $\mathbf{A}$ as long as you also subtract $\dot f$ from $\phi$. To get a properly determined system we have to add an arbitrary ‘gauge fixing’ condition! This freedom is called gauge invariance, and I think it’s another manifestation of the same weirdness of curl. That curl’s weirdness is intertwined with both gauge invariance and the overdetermination problem is part of why it’s a good way to think about these things imo.
If I’m right about curl’s weirdness being the key thing in all this, then perhaps apparent overdetermination can turn up similarly in other theories where the equations have curl in them, e.g. fluid dynamics?
If you liked this post, please subscribe to this blog to be notified via email about future posts, and/or follow me on twitter.
Some words about how Maxwell's equations look overdetermined but aren't (the usual explanation isn't great imo), and what that has to do with how fundamentally weird curl is:https://t.co/9v3agFBWcE pic.twitter.com/JKZAw1so6N
— Daniel Duffy (@DDuffeh) September 26, 2022
The reason I’m specifying this is that if $\rho$ and $\mathbf{J}$ don’t satisfy charge continuity, then there are definitely no solutions to Maxwell’s equations. To see this, take the divergence of (\ref{eq:m4}) and then sub in (\ref{eq:m1}) and the charge continuity equation pops out — so charge continuity has to hold for Maxwell’s equations to hold! ↩︎
Stratton, Electromagnetic Theory ↩︎
Rosen, Redundancy and superfluity for electromagnetic fields and potentials ↩︎
This is reminiscent of the fact that when solving $\nabla^2 \mathbf{A} = - \mu_0 \mathbf{J}$ for some source $\mathbf{J}$ that has $\nabla \cdot \mathbf{J}=0$, if you impose $\nabla \cdot \mathbf{A} = 0$ as a BC then your solution will actually have $\nabla \cdot \mathbf{A} = 0$ everywhere (see my Consistency of Coulomb gauge post). Sometimes equations can be replaced just with BCs! ↩︎