July 2017 – Simply Curious

Special Relativity; Or how I learned to relax and love the Anti-Particle

The Special Theory of Relativity, which is the name for the set of ideas that Einstein proposed in 1905 in a paper titled “On the Electrodynamics of moving bodies”, starts with the premise that the Laws of Physics are the same for all observers that are traveling at uniform speeds relative to each other. One of the Laws of Physics includes a special velocity – Maxwell’s equations for electromagnetism include a special speed $c$ , which is the same for all observers. This leads to some spectacular consequences. One of them is called the “Relativity of Simultaneity”. Let’s discuss this with the help of the picture below.

Babu is sitting in a railway carriage, manufactured by the famous C-Kansen company, that travels at speeds close to that of light. Babu’s sitting exactly in the middle of the carriage and for reasons best known to himself (I guess the pantry car was closed and he was bored), decides to shoot a laser beam simultaneously at either end of the carriage from his position. There are detectors/mirrors that detect the light at the two ends of the carriage. As far as he is concerned, light travels at $3 \times 10^5 \frac {km}{sec}$ and he will challenge anyone who says otherwise to a gunfight – note that he is wearing a cowboy hat and probably practices open carry.

Since the detectors at the end of the carriage are equidistant from him, he is going to be sure to find the laser beams hit the detectors simultaneously, from his point of view.

Now, consider the situation from the point of view of Alisha, standing outside the train, near the tracks, but safely away from Babu and his openly carried munitions. She sees that the train is speeding away to the left, so clearly since ${\bf she}$ thinks light also travels at $3 \times 10^5 \frac {km}{sec}$ , she would say that the light hit the ${\bf right}$ detector first before the ${\bf left}$ detector. She doesn’t ${\underline {at \: all \: think}}$ that the light hit the two detectors simultaneously. If you asked her to explain, she’d say that the right detector is speeding towards the light, while the left detector is speeding away from the light, which is why the light strikes them at different times.

Wait – it is worse. If you had a third observer, Emmy, who is skiing to the ${\bf {left}}$ at an even higher speed than the C-Kansen (some of these skiers are crazy), she thinks the C-Kansen train is going off to the right (think about it), not able to keep up with her. As far as ${\underline {\bf {she}}}$ is concerned, the laser beam hit the ${\bf {left}}$ detector before the other beam hit the ${\bf {right}}$ detector.

What are we finding? The Events in question are – “Light hits Left Detector” and “Light hits Right Detector”. Babu claims the two events are simultaneous. Alisha claims the second happened earlier. Emmy is insistent that the first happened earlier. Who is right?

They are ALL correct, in their own reference frames. Events that appear simultaneous in one reference frame can appear to occur the one before the other in a different frame, or indeed the one after the other, in another frame. This is called the Relativity of Simultaneity. Basically, this means that you cannot attribute one of these events to have ${\bf {caused}}$ the other, since their order can be changed. Events that are separated in this fashion are called “space-like separated”.

Now, on to the topic of this post. In the physics of quantum field theory, particles interact with each other by exchanging other particles, called gauge bosons. This interaction is depicted, in very simplified fashion so we can calculate things like the effective force between the particles, in a sequence of diagrams called Feynman diagrams. Here’s a diagram that depicts the simplest possible interaction between two electrons

Time goes from the bottom to the top, the electrons approach each other, exchange a photon, then scoot off in different directions.

This is the simplest diagram, though and to get the exact numerical results for such scattering, you have to add higher orders of this diagram, as shown below

When you study such processes, you have to perform mathematical integrals – all you know is that you sent in some particles from far away into your experimental set-up, something happened and some particles emerged from inside. Since you don’t know where and when the interaction occurred (where a particle was emitted or picked up, as at the vertexes in the above diagrams), you have to sum over all possible places and times that the interaction ${\bf {could}}$ have occurred.

Now comes the strange bit. Look at what might happen when you sum over all possible paths for a collision between an electron and a photon.

In the above diagram, the exchange was simultaneous.

In the next one, the electron emitted a photon, then went on to absorb a photon.

and then comes the strange bit –

Here the electron emitted a photon, then went backwards in time, absorbed a photon, then went its way.

When we sum over all possible event times and locations, this is really what the integrals in quantum field theory instruct us to do!

Really, should we allow ourselves to count processes where two events occur simultaneously, which means we would then have to allow for them to happen in reverse order, as in the third diagram? What’s going on? This has to be wrong! And what’s an electron going backwards in time anyway? Have we ever seen such a thing?

Could we simply ban such processes? So, we would only sum over positions and times where the intermediate particles had enough time to go from one place to another,

There’s a problem with this. Notice the individual vertexes where an electron comes in, emits (or absorbs) a photon, then moves on. If this were a “real” process, it wouldn’t be allowed. It violates the principle of energy-momentum conservation. A simple way to understand this is to ask, could a stationary electron suddenly emit a photon and shoot off in a direction opposite to the photon, It looks deceptively possible! The photon would have, say, energy $E$ and momentum $p = E/c$ . This means that the electron would also have momentum $E/c$ , in the opposite direction (for conservation) but then its energy would have to be $\sqrt{E^2+m^2 c^4}$ from the relativistic formula. This is higher than the energy $m c^2$ of the initial electron : $A+ \sqrt{A^2+m^2}$ is bigger than $m$ ! Not allowed !

We are stuck. We have to assume that energy-momentum conservation is violated in the intermediate state – in all possible ways. But then, all hell breaks loose – in relativity, the speed of a particle $v$ is related to its momentum $p$ and its energy $E$ by $v = \frac {p}{E}$ – since $p$ and $E$ can be ${\underline {anything}}$ , the intermediate electron could, for instance, travel faster than light. If so, in the appropriate reference frame, it would be absorbed before it was created. If you can travel faster than light, you can travel backwards in time (read this post in Matt Buckley’s blog for a neat explanation).

If the electron were uncharged, we would probably be hard-pressed to notice. But the electron is charged. This means if we had the following sequence of events,

– the world has -1 net charge

– electron emits a photon and travels forward in time

– electron absorbs a photon and goes on.

This sequence doesn’t appear to change the net charge in the universe.

But consider the following sequence of events

– the world has -1 net charge

– the electron emits a photon and travels backwards in time

– the electron absorbs a photon in the past and then starts going forwards in time

Now, at some intermediate time, the universe seems to have developed two extra negative charges.

This can’t happen – we’d notice! Extra charges tend to cause trouble, as you’d realize if you ever received an electric shock.

The only way to solve this is to postulate that an electron moving backward in time has a positive charge. Then the net charge added for all time slices is always -1.

ergo, we have antiparticles. We need to introduce the concept to marry relativity with quantum field theory.

There is a way out of this morass if we insist that all interactions occur at the same point in space and that we never have to deal with “virtual” particles that violate momentum-energy conservation at intermediate times. This doesn’t work because of something that Ken Wilson discovered in the late ’70s, called the renormalization group – the results of our insistence would be we would disagree with experiment – the effects would be too weak.

For quantum-field-theory students, this is basically saying that the expansion of the electron’s field operator into its components can’t simply be

$\Psi(\vec x, t) = \sum\limits_{spin \: s} \int \frac {d \vec k}{(2 \pi)^3} \frac{1}{\sqrt{2 E_k}} b_s(\vec k) e^{- i E_k t + i {\vec k}.{\vec x}}$

but has to be

$\Psi(\vec x, t) = \sum\limits_{spin \: s} \int \frac {d \vec k}{(2 \pi)^3} \frac{1}{\sqrt{2 E_k}} \left( b_s(\vec k) e^{- i E_k t + i {\vec k}.{\vec x}} +d^{\dagger}_s(\vec k) e^{+ i E_k t - i {\vec k}.{\vec x}} \right)$

including particles being destroyed on par with anti-particles being created and vice versa.

The next post in this sequence will discuss another interesting principle that governs particle interactions – C-P-T.

Quantum field theory is an over-arching theory of fundamental interactions. One bedrock of the theory is something called C-P-T invariance. This means that if you take any physical situation involving any bunch of particles, then do the following

make time go backwards
parity-reverse space (so in three-dimensions, go into a mirror world, where you and everything else is opposite-handed)
change all particles into anti-particles (with the opposite charge)

then you will get a process which could (and should) happen in your own world. As far as we know this is always right, in general and it has been proven under a variety of assumptions. A violation of the C-P-T theorem in the universe would create quite a stir. I’ll discuss that in a future post.

Addendum: After this article was published, I got a message from someone I respect a huge amount that there is an interesting issue here. When we take a non-relativistic limit of the relativistic field theory, where do the anti-particles vanish off to? This is a question that is I am going to try and write about in a bit!

Can a quantum particle come to a fork in the road and take it?

I have always been fascinated by the weirdness of the Universe. One aspect of the weirdness is the quantum nature of things – others relate to the mysteries of Lorentz invariance, Special Relativity, the General Theory of Relativity, the extreme size and age of the Universe, the vast amount of stuff we don't seem to be able to see and so on.

This post is about an experiment that directly points to the fundamental weirdness of small (and these days, not so small) particles. While quantum effects matter at the sub-atomic particle level, these effects can coalesce into macroscopic phenomena like superconductivity, the quantum Hall effect and so on, so they can't be ignored. This experiment, usually referred to as the "Double-Slit" experiment, is described and explained in detail in Vol. 3 of the Feynman Lectures in Physics. While it would be silly of me to try and outdo Feynman's explanation, which by the way was one of the reasons why I was enthused to study physics in the first place, I want to go beyond the Double-Slit experiment to discuss the Delayed-Choice experiment – this extra wrinkle on the Double-Slit experiment was invented by the famous scientist John Wheeler (who was Feynman's Ph.D advisor) and displays for all to see, even more aspects of quantum weirdness.

Let's get started.

The Double-Slit experiment is carried out by shooting electrons at a pair of closely placed slits – the electron flux is sufficiently small that one is able to count the number of times electrons hit various points on a television screen placed past the slits. If no measures are taken to identify which of the two paths the electrons actually took to reach the screen, then the probability density of arrival at various points on the television screen displays an “interference'' pattern. If, however, the experiment is set up so as to identify which slit the electron went through, for example by shining an intense beam of photons at the slits that scatter off the electrons, then the interference pattern for those “which-path'' identified electrons switches to a “clump'' pattern, centered around the open slit. The standard experiment is displayed, schematically, below, where since both slits are open and we don't bother to check which slit the electron goes through, we see an "interference" pattern. If we used photons (light) instead of electrons, we'd see alternate light and dark fringes.

Fig1a

If only one slit were open, we'd get a "clump" pattern as below

Fig1b

Note – no interference "bumps" at places far away from the peak.

This behavior is also what we'd get for light – photons.

Quantum mechanics is the theory that was constructed to "explain" this behavior. We construct a quantity called the "amplitude". The "amplitude" is a complex number that has a (complex) value at every point in space and time. Complex numbers have two properties – a magnitude and a phase. The magnitude squared of the amplitude at some time $t$ times a small volume in space $v$ is the probability of finding the particle (if its an amplitude for the electron, then the probability of finding the electron etc.) in that volume $v$ at time $t$ . Since you need to multiply the magnitude squared by a little volume element, the squared magnitude of the amplitude is referred to as the "Probability Density".

Schrodinger's equation writes down how this amplitude evolves in time – from the electron gun to the screen. To this equation, you need to add the "Born" prescription – that you have to square the magnitude of the amplitude to get the probability density.

Feynman found a neat, equivalent interpretation of Schrodinger's equation – his method basically said – if you want to find the amplitude for the electron (say) at some point in the screen, just write down path-amplitudes for all the different ways the electron could get from the electron gun to the screen. Add these path-amplitudes and then call the net sum the "total" amplitude for the electron to be found at the particular spot on the screen. Square the magnitude of this "total" amplitude and you will get the probability density for the electron to be found at that spot (times the little volume around that spot will give you the probability to find the electron at that spot).

All this discussion of path-amplitudes would be academic if the amplitudes were real numbers. The phase is a critical piece of the amplitude. Though the magnitude (squared) is the physical quantity (related to a probability), the magnitude of a sum of complex numbers depends delicately on the phase difference between the two. As an example, $z_1=1+2i, z_2=-1-2i, z_3=1-2i, z_4=-1+2i$ have the same magnitude $\sqrt{5}$ . However, $z_1+z_2=0, z_1+z_3=2, z_1+z_4=4i$ all of which have magnitudes very different from just the sum of the individual magnitudes. That's the reason we get alternate light and dark fringes on the television screen – the phases of the amplitudes for the electron to get to those spots from either of the two slits sometimes causes the sum amplitude to be 0 (which is called destructive interference) and sometimes causes the sum amplitude to add to the maximum (which is called constructive interference) and all magnitudes between these two extremes. While this behavior is extremely counter-intuitive for particles, it resembles behavior we are used to with waves, as this YouTube video shows, so does this one. This is usually referred to as wave-particle duality.

The thing you need to take away from this experiment is that if you don't force the electron to get to the screen through only one slit, by say, closing off the other slit, it appears to behave like it goes through both slits.

Wait, it gets even more interesting.

The Delayed-Choice experiment was proposed by Marlan Scully (who is an inspiring scientist in his own right) and is portrayed in the accompanying figure.

Fig2

An SPDC (spontaneous parametric down conversion) setup is used – basically, each of the red regions in the picture above produces two photons, when one photon hits it. Since the laser's photon can go through either of the two slits, this is just like the Double-Slit experiment, except that things are arranged so that after going through a slit, the photon would produce two other photons. The photons that travel towards the interferometer/detector $D0$ are referred to as “signal'' photons. The photons that travel towards the prism are the “idler'' photons. After passing through the prism, the “idler'' photons pass through a beam-splitter, that has a $50 \%$ probability of deflecting the incoming photon to detectors $D3$ and $D4$ respectively and $50\%$ probability of letting the photon pass on to the fully silvered (reflecting mirrors) at the bottom of the picture. Another beam-splitter is placed between the detectors $D1$ and $D2$ , so photons that are detected at $D1$ and $D2$ have their “which-path'' information obliterated – for instance, an “idler'' photon arriving at $D1$ could have come along either of two paths. The actual experiment was performed by Kim et. al.

The detector $D0$ accumulates “signal'' photons – a coincidence counter correlates it to “idler'' photons detected at the detectors $D3, D4, D1$ and $D2$ (the “idler'' photons arrive at those detectors a few nanoseconds after the “signal'' photons are received. From the accumulated “signal'' photons received at $D0$ , if we separate the ones received in coincidence with the detectors $D3$ or $D4$ , since the “which-path'' information is clear in those cases, the pattern of interference observed (in the spatial density of the “signal'' photons) is the “clump'' pattern. However, the accumulated “signal'' photons received at $D0$ that are coincident with the ones received at $D1$ display an interference pattern, since one cannot infer the path taken by the “idler'' photons that show up at detector $D1$ , which means one cannot tell which slit the “signal'' photon came through before arriving at detector $D0$ . Similarly, the accumulated “signal'' photons received at $D0$ that are coincident with the ones received at $D2$ display an interference pattern in their spatial distribution, however this pattern is spatially offset half a wavelength off the one due to $D1$ . This is just enough to put peaks where the other pattern has dips and vice versa. So, if you aren't careful to note which detector $D1$ or $D2$ detected the photon coincident with the "signal" photon detector $D0$ , you get a clump pattern. The reason for this offset is little tricky to explain – its called "unitarity" or conservation of probability at the beam-splitter, which forces some delicate phase assignments for the amplitudes we spoke about earlier.

Note, however, that someone could hide the specific arrival times of the photons at $D1$ and $D2$ from you for months and then tell you, say, a year later. All this time, you wouldn't have known there was an interference pattern "hiding" under the massive "clump" pattern you see. When you selectively look at the coincident detections separately for $D1$ and $D2$ , it is then and only then, that you see the interference pattern.

Curious! This experiment, as I said, has been done and the results are as described above.

With a friend, I put together another set up in an interesting locale, a black hole, that we tried to make work. Quantum mechanics defeated us in our attempts too, but its an interesting problem to work through.

A digression on statistics and a party with Ms. Fermi-Dirac and Mr. Bose (Post #5)

To explain the next standard candle, I need to digress a little into the math of statistics of lots of particles. The most basic kind is the statistics of distinguishable particles.

Consider the following scenario. You’ve organized a birthday party for a lot of different looking kids (no twins, triplets, quadruplets, quintuplets …). Each kid has equal access to a large pot of M&Ms in the center of the room. Each kid can grab M&Ms from the pot and additionally when they bounce off each other while playing, can exchange a few M&Ms with each other. After a long while, you notice that all the M&Ms in the central pot are gone. Let’s suppose there are truly a ${\underline {large}}$ number of kids $(K)$ and a truly ${\underline {humongous}}$ number of M&Ms $(N)$ .

Interesting question – how many M&Ms is each kid likely to have? A simpler question might be – how many kids likely have 1 M&M? How many likely have 2?..How many likely have 55?… How many likely have 5,656,005?…

How do we answer this question?

If you use the notation $n_i$ for the number of kids that have $i$ M&Ms?, then, we can easily write down

$\sum\limits_{i} n_i = K$

is the total number of kids.

$\sum\limits_i i n_i = N$

is the total number of M&Ms.

But that isn’t enough to tell! We need some additional method to find the most likely distribution of M&Ms (clearly this wouldn’t work if I were there; I would have all of them and the kids would be looking at the mean dad that took the pot home, but that’s for a different post). The result, that Ludwig Boltzmann discovered, at the end of the 19th century, was ${\bf not}$ simply the one where everybody has an equal number of M&Ms. The most likely distribution is the one with the most number of possible ways to exchange the roles of the kids and still have the same distribution. In other words, maximize the combinatoric number of ways

${\it \Omega} = \frac {K!} {n_1! n_2! n_3! ...n_{5,005,677}! ...}$

which is the way of distributing these kids so that $n_1$ have $1$ M&M, $n_2$ have $2$ M&Ms, $n_3$ have $3$ M&Ms…, $n_{5,005,677}$ have $5,005,677$ M&Ms and so on.

Boltzmann had a nervous breakdown a little after he invented the statistical mechanics, which is this method and its consequences, so don’t worry if you feel a little ringing in your ears. It will shortly grow in loudness!

How do we maximize this ${\it \Omega}$ ?

The simplest thing to do is to maximize the logarithm of ${\it \Omega}$ , which means we maximize

$\log \Omega = \log K! - \sum\limits_{i} \log n_i!$

but we have to satisfy the constraints

$\sum\limits_{i} n_i = K, \hspace{5 mm} \sum\limits_i i n_i = N$

The solution (a little algebra is required here) is that $n_i \propto e^{-\beta i}$ where $\beta$ is some constant for this ‘ere party. For historical reasons and since these techniques were initially used to describe the behavior of gases, it is called the inverse temperature. I much prefer “inverse gluttony” – the lower $\beta$ is, the larger the number of kids with a lot of M&Ms.

Instead of the quantity $i$ , which is the number of M&Ms the children have, if we considered $\epsilon_i$ , which is (say) the dollar value of the $i$ M&Ms, then the corresponding number of kids with $"value" \: \epsilon_i$ is $n_i \propto e^{-\beta \epsilon_i}$

Few kids have a lot of M&Ms, many have very few – so there you go, Socialists, doesn’t look like Nature prefers the equal distribution of M&Ms either.

If you thought of these kids as particles in a gas and $\epsilon_i$ as one of the possible energy levels (“number of M&Ms”) the particles could have, then the fraction of particles that have energy $\epsilon_i$ would be

$n(\epsilon_i) \propto e^{- \beta \epsilon_i}$

This distribution of particles into energy levels is called the Boltzmann distribution (or the Boltzmann rule). The essential insight is that for several ${\bf distinguishable}$ particles the probability that a particular particle is in a state of energy $\epsilon$ is proportional to $e^{-\beta \epsilon}$ .

After Boltzmann discovered this, the situation was static till the early $1920s$ when people started discovering particles in nature that were ${\bf indistinguishable}$ . It is a fascinating fact of nature that every photon or electron or muon or tau particle is $exactly$ identical to every other photon or electron or muon or tau particle (respectively and for all other sub-atomic particles too). While this fact isn’t “explained” by quantum field theory, it is used in the construction of our theories of nature.

Back to our party analogy.

Suppose, instead of a wide variety of kids, you invited the largest $K$ -tuplet the world has ever seen. $K$ kids that ${\bf ALL}$ look identical. They all have the same parents (pity them ${\bf please})$ , but hopefully were born in some physically possible way, like test-tubes. You cannot tell the kids apart, so if one of them has 10 M&Ms, its indistinguishable from $any$ of the kids having 10 M&Ms.

Now what’s the distribution of the number of kids $n_i$ with $\epsilon_i$ value in M&Ms? The argument I am going to present is one I personally have heard from Lubos Motl’s blog (I wouldn’t be surprised if its more widely available, though given the age of the field) and it is a really cute one.

There are a couple of possibilities.

Suppose there was a funny rule (made up by Ms. Fermi-Dirac, a well known and strict party host) that said that there could be at most $1$ kid that had, say $\epsilon_i$ value in M&Ms (for every $i$ ). Suppose $P_0(\epsilon_i)$ were the probability that ${\underline {no}}$ kid had $\epsilon_i$ of value in M&Ms. Then the probability that that 1 kid has $\epsilon_i$ of value in M&Ms is $P_0 e^{-\beta \epsilon_i}$ – remember the Boltzmann rule! Now if no other possibility is allowed (and if one kid has $i$ M&Ms, it is indistinguishable from any of the other kids, so you can’t ask which one has that many M&Ms)

$P_0(\epsilon_i) + P_0(\epsilon_i) e^{-\beta \epsilon_i} = 1$

since there are only two possibilities, the sum of the probabilities has to be 1.

This implies

$P_0(\epsilon_i) = \frac {1}{1 + e^{-\beta \epsilon_i}}$

And we can find the probability of there being $1$ kid with value $\epsilon_i$ in M&Ms. It would be

$P_1({\epsilon_i}) = 1 - P_0({\epsilon_i}) = \frac {e^{-\beta \epsilon_i}}{1 + e^{-\beta \epsilon_i}}$

The $expected$ number of kids with value $\epsilon_i$ in M&Ms would be

${\bar{\bf n}}(\epsilon_i) = 0 P_0(\epsilon_i) + 1 P_1({\epsilon_i}) = {\bf \frac {1}{e^{\beta \epsilon_i}+1} }$

But we could also invite the fun-loving Mr. Bose to run the party. He has no rules! Take as much as you want!

Now, with the same notation as before, again keeping in mind that we cannot distinguish between the particles,

$P_0(\epsilon_i) + P_0(\epsilon_i) e^{-\beta \epsilon_i} + P_0(\epsilon_i) e^{-2 \beta \epsilon_i} + .... = 1$

which is an infinite (geometric) series. The sum is

$\frac {P_0(\epsilon_i) }{1 - e^{-\beta \epsilon_i} } = 1$

which is solved by

$P_0(\epsilon_i) = 1 - e^{-\beta \epsilon_i}$

The expected number of kids with value $\epsilon_i$ in M&Ms is

${\bar{\bf n}}(\epsilon_i) = 0 P_0(\epsilon_i) + 1 P_0(\epsilon_i) e^{-\beta \epsilon_i} + 2 P_0(\epsilon_i) e^{-2 \beta \epsilon_i} + ...$

which is

${\bar{n}}(\epsilon_i) = P_0(\epsilon_i) \frac {e^{-\beta \epsilon_i} } {(1 - e^{-\beta \epsilon_i})^2} = {\bf \frac {1}{e^{\beta \epsilon_i} -1}}$

Now, here’s a logical question. If you followed the argument above, you could ask this -could we perhaps have a slightly less strict host, say Ms. Fermi-Dirac-Bose-2 that allows up to 2 kids to possess a number of M&Ms whose value is $\epsilon_i$ ? How about a general number $L$ kids that are allowed to possess M&Ms of value $\epsilon_i$ (the host being the even more generous Ms. Fermi-Dirac-Bose-L). More about this on a different thread. But the above kinds of statistics are the only ones Nature seems to allow in our 4 – dimensional world (three space and one time). Far more are allowed in 3 – dimensional worlds (two space and one time) and that will also be in a different post (the sheer number of connections one can come up with is fantastic!).

The thing to understand is that particles that obey Fermi-Dirac statistics (a maximum of one particle in every energy state) have a “repulsion” for each other – they don’t want to be in the same state as another Fermi-Dirac particle, because Nature forces them to obey Fermi-Dirac statistics. If the states were characterized by position in a box, they would want to stay apart. This leads to a kind of outwards pressure. This pressure (described in the next post) is called Fermi-degeneracy pressure – its what keeps a peculiar kind of dense star called a white dwarf from collapsing onto itself. However, beyond a certain limit of mass (called the Chandrasekhar limit after the scientist that discovered it), the pressure isn’t enough and the star collapses on itself – leading to a colossal explosion.

These explosions are the next kind of “standard candle”.

${\bf {Addendum}}$ :

I feel the need to address the question I asked above, since I have been asked informally. Can one get statistics with choosing different values of $L$ in the above party? The answer is “No”. The reason is this – suppose you have $K L$ kids at the party, with a maximum of $L$ kids that can carry M&Ms of value $\epsilon_i$ . Then we should be able to divide all our numbers by $L$ (making a scale model of our party that is $L$ times smaller) that has $K$ kids, with a maximum of $1$ kid that is allowed to hold M&Ms of value $\epsilon_i$ . You’d expect the expected number of kids with M&Ms of value $\epsilon_i$ to be, correspondingly, $L$ times smaller! Then, the expected number of particles in a state (with a limit of $L$ particles in each state) is just $L$ times the expected number with a limit of $1$ particle in each state.

So all we have are the basic Fermi-Dirac and Bose statistics (1 or many), in our three-space-dimensional party!

Cosmology: Cepheid Variables – or why Henrietta couldn’t Leavitt alone …(Post #4)

Having exhausted the measurement capabilities for small angles, to proceed further, scientists really needed to use the one thing galaxies and stars put out in plenty – light. The trouble is, to do so, we either need detailed, correct theories of galaxy and star life-cycles (so we know when they are dim or bright) or we need a “standard candle”. That term needs explanation.

If I told you to estimate how far away a bulb was, you could probably make an estimate based on how bright the bulb seemed. For this you need two things. You need to know how bright the bulb is ${\bf intrinsically}$ – this is the absolute luminosity and its measured in $watts$ which is $Joules \: per \: second$ . Remember, however, that a 100 watt bulb right next to you appears brighter (and hotter) than the same 100 watt bulb ten miles away! To account for that, you could use the fact that the bulb distributes its light almost uniformly into a sphere around itself, to compute what fraction of the light energy you are actually able to intercept – we might have a patch of CCD (like the little sensor inside your video camera), of area $A$ capturing the light emitted by the bulb. Putting these together, as in the figure below, the amount of light captured is $I_{Apparent}$ watts while the bulb puts out $I_{Intrinsic}$ watts.

$I_{Apparent} = I_{Intrinsic} \frac{CCD \: Area}{Sphere \: Surface \: Area}$

$I_{Apparent} = A \frac {I_{Intrinsic}}{4 \pi R^2}$

where if you dig into your memory, you should recall that the area of a sphere of radius $R$ is $4 \pi R^2$ !

you can compute $R$

$R = \sqrt{A \frac {I_{Intrinsic}}{4 \pi I_{Apparent}}}$

You know how big your video camera’s sensor area is (it is in that manual that you almost threw away!) You know how much energy you are picking up every second (the apparent luminosity) – you’d need to buy a multimeter from Radio Shack for that (if you can find one now). But to actually compute the distance, you need to know the ${\bf Intrinsic}$ or ${\bf actual}$ luminosity of the light source!

That’s the problem! To do this, we need a set of “standard candles” (a light source of known actual luminosity in watts!) distributed around the universe. In fact the story of cosmology really revolves around the story of standard candles.

The first “standard candles” could well be the stars. If you assume you know how far away the Sun is, and if you assume other stars are just like our Sun, then you could make the first estimates of the size of the Universe.

We already know that the method of parallax could be used with the naked eye to calculate the distance to the moon. Hipparchus calculated that distance to be 59 earth radii. Aristarchus measured the distance to the sun (the method is a tour de force of elementary trigonometry and I will point to a picture here as an exercise!)

His calculation of the Earth-Sun distance was only 5 million miles, a fine example of a large experimental error – the one angle he had to measure was $\alpha$ , he got wrong by a factor of 20. Of course, he was wise – he would have been blinded if he had tried to be very accurate and look at the sun’s geometric center!

Then, if you blindly used this estimate and ventured bravely on to calculate distances to other stars based on their apparent brightness relative to the sun, the results were startlingly large (and of course, still too small!) and people knew this as early as 200 B.C. The history of the world might have well been different if people had taken these observers seriously. It was quite a while and not till the Renaissance in Europe that quantitative techniques were re-discovered for distance measurements to the stars.

The problem with the technique of using the Sun as a “standard candle” is that stars differ quite a bit in their luminosity based on their composition, their size, their age and so on. The classification of stars and the description of their life-cycle was completed with the Hertzsprung-Russell diagram in 1910. In addition, the newly discovered nebulae had been resolved into millions of stars, so it wasn’t clear there was a simple way to think of stellar “standard candles” unless someone had a better idea of the size of these stellar clusters. However, some of the nearby galaxy companions of the Milky Way could have their distances estimated approximately (the Magellanic Cloud, for instance).

Enter Henrietta Leavitt. Her story is moving and representative of her time, from her Radcliffe college education to her $0.30 / hour salary for her work studying variable stars (she was a human computer for her academic boss), as well as the parsimonious recognition for her work while she was alive. She independently discovered that a class of variable stars called Cepheids in the Magellanic clouds appeared to have a universal connection between their intrinsic luminosity and the time period of their brightness oscillation. Here’s a typical graph (Cepheids are much brighter than the Sun and can be observed separately in many galaxies)

If you inverted the graph, you simply had to observe a Cepheid variable’s period to determine the absolute luminosity. Voila! You had a standard candle.

A little blip occurred in 1940, when Walter Baade discovered that Cepheids in the wings of the Andromeda galaxy were older stars (called Population II, compared to the earlier ones that are now referred to as Population I) and were in general dimmer than Population I Cepheids. When the Luminosity vs. Period graph was drawn for those, it implied the galaxy they were in was actually even further away! The size of the universe quadrupled (as it turned out) overnight!

Henrietta Leavitt invented the first reliable light-based distance measurement method for galaxies. Edwin Hubble and Milton Humason used data collected mainly from an analysis of Cepheids to derive the equation now known as Hubble’s law.

Next post will be about something called Olbers’ paradox before we start studying the expansion of the Universe, the Cosmic Microwave background and the current belief that we constitute just 4% of the universe – the rest being invisible to us and not (as far as we can tell) interacting with us.

Cosmology: Distance Measurements – Parallax (Post #3)

This post describes the cool methods people use to figure out how far away stars and galaxies are. Figuring out how far away your friend lives is easy – you walk or drive at a constant speed in a straight line from your home to their house – then once you know how much time this took, you multiply speed times the time of travel to get the distance to your friend’s house.

This might seem like an excessively detailed description of a simple task, but don’t forget that the ancients would have difficulty with several things here – how do you travel at a constant speed and how do you measure time of travel? The first seems like a possible task, but how do you measure time ? Humans have invented many ways to measure time – water clocks (reported in Greece, China and India), sand clocks, burning knotted ropes. The Antikythera mechanism, if confirmed to be an astronomical device, would be similar to a true mechanical clock, but it took the ability to work metal and the Industrial Revolution to reliably mass-produce clocks.

This was the most effective way to measure distances for many years; just travel there and keep notes!

The heavenly object closest to us appears to be the moon. Very early, to some extent by Aristarchus, but really by Edmund Halley (whose comet is more famous than he is), it was realized that Parallax could be used to figure distance to far away objects, without actually traveling there. Parallax is illustrated below – its the perceived angular shift in an object’s position relative to far-away things when you shift your viewing position. You experience this all the time when you see nearby things shift when you look from one eye, then the other.

The diagram above is a little busy, so let me explain it. $L$ is the distance that we are trying to measure, between the Earth (where the fellow with the telescope is) and the bright blue star. $R$ is the distance to the starry background, that is ${\bf really}$ far away. Since $R$ is ${\bf much}$ bigger than $L$ , you should be able to convince yourself that the angles $\alpha$ and $\beta$ are very close to each other. From basic geometry, to a good approximation

$D = \alpha L$

which means $L = \frac {D}{\alpha}$ . We just need to compute $\alpha$ , but it is roughly equal to $\beta$ . $\beta$ is the just the angular separation of the stars $P$ and $Q$ , which you could measure with, for instance, a sextant.

We know $D$ , which is the baseline of the measurement. If you use your two eyes, it is a few inches. You could get ambitious and make measurements in summer and winter, when the baseline would be the diameter of the Earth’s orbit (OK, the orbit is very nearly a circle). The result is that you can figure out how far away the bright blue star is by computing the perceived angular shift.

The farther away something is, the smaller the perceived angular shift. For a long time, people could not measure angular shifts for really distant objects and made the assumption that the method was wrong for some reason, for they couldn’t believe stars could be that far away.

The state of the art in the parallax measurement was the Hipparcos satellite and is currently the Gaia satellite (as well as Hubble). Distances upto 30,000 light years are capable of being measured. For reference, we think Andromeda galaxy is 2.5 million light years away and the Milky Way’s dark matter halo extends out to 180,000 light years. So to measure out to these distances needs different techniques, which will be discussed in the next post.

Cosmology and the Expanding Universe ..(Post #2)

The previous post discussed what Cosmological Red Shift is (and we defined $z$ , the red-shift parameter). The saga of cosmology begins with general speculations for thousands of years about what those points of light in the sky really were. The construction of the first telescope around 1608, followed by visual explorations (by people like Galileo) of the Moon, Venus, Jupiter, Saturn and their moons led to the increasing certainty that the heavens were made of the same materials as those found on the earth. By the way, it is indeed surprising (as you will see) that to some extent, cosmology has come full circle – it seems to appear that the heavens might be composed of different “stuff” than us on Earth.

Anyway, as I alluded to in the first post, the first mystery of modern cosmology was discovered in the light from distant galaxies. If we make the entirely reasonable assumption that those galaxies were composed of stars like our sun, the light from those stars should be similar in composition (the mix of colors etc) to the light from our sun. Of course, it was entirely reasonable to expect that some of those stars might be smaller/bigger/younger/older than our sun, so if you had a good idea of how stars produced their light, you could figure out what the light should look like. Now in the 1910’s, 1920’s, 1930s, which is the era we are talking about, people didn’t really understand nuclear fusion, so there was some speculation going on about what made the stars shine. However, one thing was clear – stars contain lots of hydrogen, so we should be able to see the colors (the wavelengths) typical of emission from hot hydrogen atoms. Vesto Slipher was the first to note that the light emitted from the hydrogen (and some other light elements) in the stars in distant galaxies appeared to be red-shifted, i.e., to be redder than expected. This was puzzling, if you expected that hydrogen and other elements had the same properties as that on the Earth. The most sensible explanation was that this was an indication the galaxies were receding away from the earth. Edwin Hubble did some more work and discovered the famous correlation, now known as Hubble’s Law – the more distant a galaxy, the faster it seemed to be receding away from us. If ${\bf V_{recession}}$ is the recession speed of a far-away galaxy, $D$ is how far away it is and ${\it H_0}$ is Hubble’s constant,

${\bf V_{recession}} = {\it H_0} D$

Hubble’s constant is currently believed to be around $70 \frac {km/sec}{MegaParsec}$ . A MegaParsec is a million parsecs – a parsec is a convenient distance unit in cosmology and is roughly 3.26 light years. To interpret the formula, if a galaxy were 1 MegaParsec away, it would be rushing away from us at $70 km/sec$ . In terms of miles, $1 MegaParsec$ is $19$ million trillion miles.

The story of how Edwin Hubble and others discovered how ${\bf far}$ away the galaxies are (the right side of this equation) is interesting in its own right and features people such as Henrietta Leavitt. This will be the subject of my next post. Probably the best discussion of this is by Isaac Asimov, in a book called “The Guide to Science – Physical Sciences”.

Getting back to our discussion, we don’t think we are somehow specially located in the Universe. This, by the way, was a philosophical principle that really traces back to the Copernican idea that the Earth wasn’t the Center of the Solar System. If we aren’t in some special place in the Universe, and if we see the galaxies receding away from us, it must be that ALL galaxies are receding from each other with a relative speed proportional to their mutual distance.

Thus was born the theory of the Expanding Universe.

One way to think of the Expanding Universe is to think of a rubber sheet, that is being stretched from all sides. Think of a coordinate system drawn on this rubber sheet, with the coordinates actually marked $1,2,3 ...$ . The actual distance between points on the sheet is then, not just the coordinate difference, but a “scale factor” times the coordinate difference. This “scale factor”, which is usually referred to as $a$ in cosmological discussions, is usually assumed to be the same number for all points in space at the same point of time in the Universe’s life.

In this picture – the grid spacing is 1 as the Universe expands. However, the distance between the grid points is $a$ times the grid spacing of 1. In the picture, $a$ is initially 1, but it increases to 4 as the expansion continues.

Next post, after I talk about distance measurements in the Universe, I’ll discuss the ideas of homogeneity and isotropy – two important concepts that we use when studying the Universe.

A simple sum

This calculation was inspired, a few years ago, by trying to find a simple way to explain the sum of the first $N$ natural numbers to my (then) twelve-year-old daughter, without the use of calculus. As many people know, the sum of the first $N$ natural numbers is found very easily, using the method that Gauss (apparently) re-discovered as a two-year old, i.e.,

$S_N^1 = 1 + 2 + 3 + ... + N$

and

$S_N^1=N+(N-1)+(N-2)+(N-3)+...+1$

Adding the above two equations

$2 (S^1_N) = N(N+1)$

i.e.,

$S^l_N = \frac{N(N+1)}{2}$

Of course, this method cannot be used to sum up the series with squares or higher powers.

Let’s however, continue to use the convenient notation for the sum of squares

$S_N^2 = 1^2+2^2+3^2+...+N^2$

There’s a useful recursion relation between $S_N^2$ and $S^2_{N-1}$

$S_N^2= S_{N-1}^2+N^2$

Let’s imagine the following – say you have $1 \times 1$ (one-unit by one-unit) squares of fixed height cut out of paper. Suppose you arrange them first as below

${\bf Layer 0}$

there are $1^2$ pieces of paper here

${\bf Layer 1}$

there are $2^2$ pieces of paper here

And another layer, ${\bf Layer 2}$

there are $3^2$ pieces of paper here

Let’s place the pieces of paper so that $Layer 0$ is at the bottom, $Layer 1$ is next on top of it, $Layer 2$ is on top of that and so on.

Let’s compute the heights of the “skyscraper” that results!

The highest tower is the one on top of the square with vertices $(x=0, y=0), (x=1, y=0), (x=0,y=1)$ and $(x=1,y=1)$ . It has height $N$ and the total number of pieces of paper in it are

$N \times 1 = (N - 0) \times (1^2 - 0^2)$ square pieces of paper.

I’ve just written this in a suggestive way.

The next tower is the one just surrounding this one on two sides, there are actually three towers, of height $(N-1)$ and the total number of pieces of paper in it is

$N \times 3 = (N-1) \times (2^2 - 1^2)$ square pieces of paper

Again, this is written in a suggestive way

The next tower is the one surrounding this last tower on two sides, there are five of them, of height $(N-2)$ and the total number of pieces of paper in it is

$(N-2) \times 5 = (N-2) \times (3^2 - 2^2)$ square pieces of paper.

Yet again!

In general, the $k^{th}$ skyscraper has height $(N-k)$ and there are $((k+1)^2-k^2)$ of them, so the total number of square pieces of paper in it are

$(N-k) \times ((k+1)^2 - k^2)$

Note, for later use, that the term $((k+1)^2-k^2)$ derives from the difference in the total number of pieces of $1 \times 1$ square paper that form a $k \times k$ square vs. a $(k+1) \times (k+1)$ square.

Adding this up for the remaining, we are left with the total number of square $1 \times 1$ pieces of paper, which is, indeed, $S_N^2 = 1^2+2^2+3^2 +4^2 ...+N^2$ .

Writing this in summation notation

$S_N^2 = \sum\limits_{k=0}^{N-1} (N-k) \times (2 k+1)$

which can be expanded into

$S_N^2 = \sum\limits_{k=0}^{N-1} (2 N k + N - 2 k^2 - k)$

i.e.,

$S_N^2 = 2 N \frac {N (N-1)}{2} + N^2 - 2 S_{N-1}^2 - \frac{N(N-1)}{2}$

Using our useful result from above

$S_{N-1}^2 = S_N^2 - N^2$

We find

$S_N^2 = \frac {N(N+1)(2 N+1)}{6}$

Aha – now we can generalize this!

We can continue this for the sum of the cubes of integers and so forth. Let’s start with $1 \times 1 \times 1$ cubes that are placed, starting at the origin. Again, using the notation

$S_N^3 = 1^3+2^3+3^3+...+N^3$

Again, we note

$S_N^3 = S_{N-1}^3 + N^3$

Continuing in the same vein, alas, we cannot layer the cubes on top of each other in three dimensions! Let’s assume there is indeed a fourth dimension and count the heights in this dimension – see, physicists and mathematicians are naturally led to higher dimensions! The number of cubical pieces used are found by counting the numbers in the expanding “perimeter” of cubes, just as in the two-dimensional example.

$N \times 1 = (N-0) \times ( 1^3 - 0^3)$

$(N-1) \times 8 = (N-1) \times (2^3 -1^3)$

$(N -2) \times 19 = (N-2) \times (3^3 - 2^3)$

$(N-3) \times 27 = (N-3) \times (4^3 - 3^3)$

…

$(N-k) \times ( (k+1)^3 - k^3)$

So we are left with

$S_N^3 = \sum\limits_{k=0}^{N-1} (N-k) \times (3 k^2+3 k+1)$

Which results in the usual formula (using the auxiliary relation $S_{N-1}^3=S_N^3-N^3$ ,

$S_N^3= ((N(N+1))/2)^2$

In general, using this approach, and the auxillary relation

$S_N^L= S_{N-1}^L+ N^L$

We find

$S_N^L= \frac {1}{L+1} ( N^2 + L N^L + \frac{N+1}{L+1} [ C(L+1,1) L S_{N-1}^1$

$+ C(L+1,2) (L-1) S_{N-1}^2 + C(L+1,3) (L-2) S_{N-1}^3$

$+ ... + C(L+1,L-1) (L - [L-2]) S_{N-1}^{L-1} ] )$

where $C(n,m) = \frac{n!}{m! (n-m)!}$ is the combinatorics formula for the number of ways to select $m$ items out of $n$ .

This formula, while original (as far as I can tell) in its derivation, is consistent with Faulhaber’s formula from the 16th century.

A course correction – and let’s get started!

I have received some feedback from people that felt the posts were too technical. I am going to address this by constructing a simpler thread of posts on one topic that will start simpler and stay conceptual rather than become technical.

I want to discuss the current state of Cosmology, given that it is possibly the field in the most flux these days. And the basic concept to understand in Cosmology is that of Cosmological Red Shift. So here goes…

The Cosmological Red Shift means this – when we look at far away galaxies, the light they emit is redder than we would expect. When you look at light of various colors, the redder the light, the longer its wavelength. Why would that be? Why would we perceive the light emitted by a galaxy to be redder than it should be?

To understand Cosmological Red Shift, you need to understand two things – the Doppler Shift and Time Dilation.

Let’s start with Doppler Shift.

If you listen to an ambulance approaching you on a road, then (hopefully, if it hasn’t come for you) speeding away from you on the road, you will hear the $pitch$ , i.e., frequency, of the siren go up, then go down. Listen to this here .

Why does this happen?

Sound is a pressure wave. When the instrument producing a sound vibrates at a certain rate ( $frequency$ ), it pushes and pulls on the air surrounding it. Those pushes and pulls are felt far away, because the fluctuations in density of the air propagate (see the video). The air isn’t actually going anywhere as a whole – this is why when you have waves in the ocean, the ocean isn’t actually sending all the water towards you, its just the disturbance coming towards you. So these pressure variations hit your ears and that’s how you hear something – the eardrum vibrates the little bones in the ear, which set up little waves in the cochlear fluid that then create electrical signals that go to your auditory cortex and voila, you hear!

Now, waves are characterized by wavelength ( $\lambda$ ), frequency ( $\nu$ ) and their speed ( $\bf{v}$ ). There’s a relation between these three quantities

$\bf{v} = \lambda \nu$

Sal Khan has a nice video describing this formula in some detail. Let’s try and understand this – wavelength ( $\lambda$ ) is the distance between the successive positive crests of the wave, frequency ( $\nu$ ) is the number of crests shooting out of the emitter per second, then ( $\lambda \nu$ ) is the length of wave coming out of the emitter per second as measured by the emitter. That’s how far the first crest traveled in one second, i.e., the speed of the wave.

Now what happens if the emitter is moving away from you – think of the pressure waves like compressions of a spring, as in the video link above. If the emitter is moving away, that’s like the spring being extended while it is vibrating – ergo, the wavelength is increased in proportion to how fast the emitter is running away from you (call the emitter’s speed $v_{emitter}$ ). The formula is

$\lambda_{observed} - \lambda_{emitted} = \frac {v_{emitter}} {\bf{v}} \lambda_{emitted}$

Aha – this makes sense, so the sound that I hear when an ambulance is driving away from me has a longer wavelength – so it has a lower frequency – it has a lower pitch. If the ambulance is driving towards me, so $v_{emitter}$ is negative in the above formula, then we hear shorter wavelength sound, which has a higher frequency, i.e., a higher pitch.

As an example, if the emitter flies away as fast as the speed of sound in the air, then the observed wavelength should be $\bf {double}$ the emitted wavelength. In the simple picture of the emitter shooting out wave crests at a rate $\nu$ per second, the emitter shoots out one crest, then shoots out another crest after a time interval $\frac {1}{\nu}$ , by which time it has moved a distance $\frac {\bf {v}} {\nu}$ which is indeed one wavelength! So the distance between the crests in the eyes of the observer is twice the emitted wavelength.

Whew! So that is the Doppler effect. If something is moving away from me, I will hear the sound it emits will seem to be of lower pitch. Since light is also a wave, if a galaxy were moving away from me, I should expect to see the light looks like that of lower frequency – i.e., it looks redder.

When we specialize this to the case of light, so we replace ${\bf{v}}$ by $c$ , the speed of light. There is an additional effect that we need to think of, for light.

Onwards – let’s think about $\rightarrow$ Time Dilation.

This needs some knowledge of Einstein’s ideas about Special Relativity. I am going to give you a lightning introduction, but not much detail. I might write a post with some details later, but there are excellent popular books on the subject. Several years before Einstein, the Scottish physicist James Maxwell discovered the equations of electromagnetism. People had discovered universal laws of nature before – for instance Issac Newton discovered the Law of Gravitation, but Maxwell’s equations had a puzzling feature. They included a constant which wasn’t a mass, length or time, but was a speed! Think of that. If there was a law of nature that included the speed of your favorite runner (say how quickly that dude in “Temple Run” runs from the apes), how strange that would be. How fast does someone run, you ask. Well, it depends on how fast the observer is going! You must have seen this on the highway. When your car has a flat and you are standing, ruing your luck, on the side of the highway, you think the cars are zipping past you at 50, 60,…80 miles per hour. When you are in one of the cars, traveling at, say 50 miles per hour, the other cars are moving $\bf {relative \hspace {2 mm} to \hspace{2 mm} you}$ at 0, 10,…30 miles per hour only. That’s natural. How can a physical law, a universal law of nature, depend on a speed! The world is bizarre indeed!

Einstein discovered exactly how bizarre. It turns out if you want the idea of a universal constant that is a speed (for light) to make sense, ALL observers need to agree on the actual speed of light, regardless of how fast they are traveling, along or against or perpendicular to the ray of light. For that to happen their clocks and rulers need to get screwed up, in just the right way to allow for this. Suppose you have two observers that are moving relative to each other, at a constant speed in some direction. Einstein derived the exact equations that relate the coordinates $(x,y,z,t)$ that the first observer assigns to a moving object to the coordinates $(x',y',z',t')$ that the other observer ascribes to the same object. It’s high school algebra, as it turns out, but the relation implies, among other things that a moving clock ticks slower than a stationary clock, ${\bf when \hspace{2 mm} the \hspace{2 mm} clocks \hspace{2 mm} are \hspace{2 mm} compared \hspace{2 mm} at \hspace{2 mm} the \hspace{2 mm} same \hspace{2 mm} point \hspace{2 mm} in \hspace{2 mm} space}$ .That, by the way is how the twin paradox sorts itself out – the twins have to meet at some point in order to compare their ages, so one has to turn his or her rocket around.

When you use the formulas of relativity, if the emitter is flying away at speed $v_{emitter}$ relative to the observer, the emitter’s clock will seem to run slower than the observer’s clock (from the observer’s point of view). Since the frequency of the emitted wave essentially is a “clock” for both, we will obtain (and this needs a little algebra and some persistence!)

$\nu_{observed} = \nu_{emitted} \sqrt{1 - (\frac{v_{emitter}}{c})^2}$

Using our previous relation connecting frequency and wavelength, this means the wavelengths are related as below

$\lambda_{observed} = \lambda_{emitted} \frac{1}{\sqrt{1 - (\frac{v_{emitter}}{c})^2}}$

so when we combine the two effects – Doppler and Relativity, which operate on the same emitted light, but successively, we multiply the two effects, we get the final observed wavelength

$\lambda_{observed} = \lambda_{emitted} \sqrt{\frac{1 + \frac{v_{emitter}}{c}}{1 - \frac{v_{emitter}}{c}}}$

We see that if something is moving away from us, i.e., $v_{emitter}$ is positive, the observed wavelength is longer than the emitted wavelength, i.e., it is red-shifted. If the moving object emits light of a certain color, the stationary observer of this light sees it to be redder than the emitted color. So here’s the upshot – if you observe light from some object that is redder than you’d expect from that object, one strong possibility is that it is receding away from you. That’s how modern cosmology got started!

A note about terminology; astronomers define a quantity called “red-shift” – denoted by the letter $z$ to define this wavelength difference. It is defined as the relative change in wavelength

$z = \frac{\lambda_{observed} - \lambda_{emitted}}{\lambda_{emitted}}$

$z$ is a “dimensionless” number – it is a ratio of two lengths. $z=0$ corresponds to you and me, things that are in the vicinity of each other. The moon isn’t receding away from us (if it is it is immeasurable), neither is our sun, so they all have a $z=0$ . In fact, the entire Milky Way galaxy, our home, is at red-shift $z = 0$ . We really have to leave the vicinity of our local group of large galaxies (that includes principally Andromeda and the Large and Small Magellanic clouds) to start seeing red-shifts exceeding 0. Conversely, the largest red-shifts we have seen are for distant quasars and intense galaxies – red-shift of about 11. Think of what that means – the 21 cm emission wavelength of neutral hydrogen would be shifted by 232 cm – almost 7 feet! For people constructing prisms and other apparata for telescopes, this is a ridiculously (physically) large apparatus you need. More on this later!

A simple connection between Entropy and Information

This article follows a simple example laid out by Jaynes (1996).
Jaynes’ example is one that shows how one’s computation of the change in entropy in a physical / chemical process depends on the precise variables that one uses to label the macro state. If you use different variables (say you are insensitive to properties that someone else does have the ability to measure) you can invent situations where the entropy change might (to one observer) be contrived to violate the Second Law of Thermodynamics while the other observer sees no such violation.
Let’s consider a vessel whose volume is $V$ , with a diaphragm that separates it into two parts – volumes $V_1$ and $V_2$ with $N_1$ and $N_1$ molecules of each type, respectively. The “1” side is filled with Argon gas of type $A_1$ which is indistinguishable from the type of Argon gas filling side “2”, which we call type $A_2$ , at least for the observer named Babu. However, Alisha, with her access to superior technology is indeed able to perceive the difference between the two types of Argon. The container is in close thermal contact with a heat bath that maintains a constant temperature $T$ . The equilibrium condition (same temperature throughout and equal pressure) implies that $n_1/V_1 =n_2/V_2 =(n_1+n_2)/V$ .
Alisha, in addition to her ability to notice the difference between $A_1$ and $A_2$ also has sole access to a material called Whiffnium, which is permeable to $A_1$ but impervious to $A_2$ . During the course of her research, she has also discovered Whaffnium, a new material which is permeable to $A_2$ , but impervious to $A_1$ . Let’s suppose that Alisha constructs two (infinitesimally thin) pistons that are initially placed very close to each other, one piston made of Whiffnium and the other of Whaffnium, as in the picture below.

Let’s suppose that just enough of $A_1$ permeates through the Whiffnium so that the partial pressure of $A_1$ is the same in the left side of the container as well as the intercalated region (between the Whiffnium and Whaffnium pistons). Similarly, let’s assume that just enough of $A_2$ permeates through the Whaffnium into the intercalated region (between the pistons) so that the partial pressure of $A_2$ is the same in the intercalated region as well as on the right side of the container. Now, due to the unbalanced pressure of $A_2$ impinging upon the Whiffnium piston, it is reversibly moved to the left and the entropy change in $A_2$ is
$= n_2 k_B ln(V/V_2)$
Similarly, the Whaffnium piston is reversibly moved to the right and the entropy change in $A_1$ is
$= n_1 k_B ln(V/V_1)$
The total entropy change is hence
$n_1 k_B ln(V/V_1 )+n_2 k_B ln(V/V_2 )$
All this is pretty logical from Alisha’s point of view, since she does see the two parts of the container as having different materials, $A_1$ and $A_2$ . She understands that the entropy change in the container is a consequence of the heat flowing into the system from the heat bath.
However, Babu sees a conundrum. He sees the argon as one undifferentiated gas and so the initial and final states of the system are identical. However, the system has absorbed an amount of heat and converted all of it into work, in violation of the Second Law of Thermodynamics. In addition, he sees the entropy change as $0$ . This is, however, simply a reflection of the fact that the entropy is a function of the macrostate variables that one uses and if Babu has an insufficiently specified macrostate, then Alisha is simply able to manipulate phenomena to cause Babu to think he has observed a violation of the Second Law.
How much information would Babu need to in order to deduce the correct entropy change? In the initial state, if he knew about the sub-identities $A_1$ and $A_2$ , the macrostate where $A_1$ is on the left and $A_2$ is on the right (side of the container) has the following number of (equally probable) microstates
$=(V_1/v)^(n_1 ) (V_2/v)^(n_2 )$
Where we have assumed that each molecule can be localized to a minimum volume $v$ and we can do this for all the $n_1$ molecules in $V_1$ and the $n_2$ molecules in $V_2$ .
In the final state, all the $n_1+n_2$ molecules are strewn about in the total volume $V$ and the total number of microstates is
$= (V/v)^(n_1+n_2)$
So to specify the microstate, he needs to be communicated extra information (along the lines of traditional information theory)

$I= \log_2((\frac{V}{v})^{n_1+n_2} ) - \log_2 ( (\frac{V_1}{v})^{n_1} (\frac{V_2}{v})^{n_2} )$

$= n_1 \log_2(V/V_1)+n_2 \log_2(V/V_2 )$
Which is exactly (up to a multiplicative factor of $k_B$ and difference between $\ln$ and $\log$ , just the same as the entropy change to separate the molecules into the different varieties.
Note that if Babu didn’t actually meet Alisha and had no idea that there were two varieties of Argon, his calculation for the number of microstates before and after would be identical, equal to $(V/v)^(n_1+n_2 )$ – this is because he doesn’t even think the diaphragm separating the two sides of the container is even necessary – they are the same materials and are in thermodynamic equilibrium with each other.
However, once Babu has this information, in the form of a detailed message, he will have been supplied with enough information to deduce completely (as far as Alisha’s abilities admit) to the situation with the two varieties, where he had zero before. Ergo, the extra information he needs is the entropy difference.

Here’s an alternative history of how quantum mechanics came about…

Quantum Mechanics was the result of analysis of experiments that explored the emission and absorption spectra of various atoms and molecules. Once the electron and proton were discovered, very soon after the discovery of radioactivity, it was theorized that the atom was an electrically neutral combination of protons and electrons. Since it isn’t possible for a static arrangement of protons and electrons to be stable (a theorem in classical electromagnetism), the plum-pudding model of JJ Thomson was rejected in favor of one where the electrons orbited a central, heavy nucleus. However, it is well – known from classical electromagnetism that if an electron is accelerated, which is what happens when it revolves around the positively charged nucleus, it should radiate energy through electromagnetic radiation and quickly collapse into the nucleus.

The spectra of atoms and molecules were even more peculiar – there were observed an infinite number of specific spectral lines and no lines were observed at in-between frequencies. Clearly, the systems needed specific amounts of energy to be excited from one state to another and there wasn’t really a continuum of possible states from the ground state (or zero energy state) to high energies. In addition, the ground state of the hydrogen atom, for instance, seemed to have a specific energy, the ionization energy of the single electron in the atom that was specific to the hydrogen atom and could not be calculated from known parameters in any easy way. The relation between the lines was recognized by Rydberg – the frequency of the radiation emitted in various transitions in hydrogen was proportional to the difference of reciprocals of squares of small natural numbers.

Anyway, starting from an energy function (Hamiltonian) of the kind

$H = \frac{\vec{p}^2}{2m} + V(\vec{r}) \hspace{3 mm} V(\vec{r}) = - \frac{e^2}{r}$

For the single electron interacting with a heavy nucleus, we recover only the classical continuum of several possible solutions for the hydrogen atom, even neglecting the radiation of energy by the continuously accelerating electron.

We can state the conundrum as follows. We use the Energy function above, solve the classical problem and find that energy can take a continuum of values from some minimum negative number to infinity. In the lab, we find that Energy takes only a discrete infinity of values.

Let’s make a connection to matrices and operators. Matrices are mathematical objects that have discrete eigenvalues. Can we interpret $H$ as a matrix of some sort and have the discrete energy values of the atom be eigenvalues of the matrix? In that case, there would be eigenvectors corresponding to those eigenvalues, let’s notate them as $|E_i>$ , with eigenvalue $E_i$ for the $i^{th}$ energy level. If $H$ were a matrix, so would $x$ and $p$ , since otherwise, we wouldn’t be able to make sense of the definition of $H$ otherwise. We’d like to make the above definition of the energy in terms of the position and momentum variables since it allows us to guess at quantum theories for other systems in the future – to some extent while this approach is arbitrary, it is an example of conservative-radicalism (phrase I learned from a talk by Nima Arkani-Hamed); it’s also called the quantization prescription.

Now, if $x$ and $p$ were to be matrices, could they have the same eigenvectors, presumably the same eigenvectors as $H$ ? This could mean that they would need to be commuting matrices. Well, they can’t, otherwise, we’d be back to the same classical solution as before – if $x$ and $p$ had the same eigenvectors, and then $H$ would just have the same eigenvectors and we would be stuck the same continuum of energy levels we had in the classical problem. So we are stuck with the situation that the eigenvectors of $x$ and $p$ and indeed $H$ , label them as $|x>$ , $|p>$ and $|E_i>$ can’t be the same – they stick out in different directions in the abstract state space of state vectors. The state vectors for $H$ , i.e., the $|E_i>$ are some linear combinations of the $|x>$ ‘s or the $|p>$ ’s, assuming the $|x>$ and $|p>$ are each an orthogonal complete set of vectors that span the abstract state space.

This leads us to the second realization, i.e., if we make this assumption that the eigenvectors $|x>$ , $|p>$ and $|E_i>$ stick out in different directions in the state space and are a complete, orthogonal set, then we are only able to specify the state of the system by giving their components to $|x>$ or to $|p>$ or to $|E_i>$ , unlike in classical physics, where $x$ and $p$ are both needed to specify completely the state of the system.

What is the physical significance of dot products such as $<x|E_i>$ and $<p|E_i>$ . These might be complex numbers – does the magnitude and phase denote specific physical quantities that can be measured? When we study the meaning of a dot product such as $<x|x'>$ , which should be zero unless $x = x'$ and should yield 1 when integrated over the entire set of states, and given that $x$ is a continuous variable,

$<x|x'> = \delta(x - x')$

This is akin to the probability density that a particle in state can be found in the state . The implication is that the magnitude of the dot product has physical meaning. Later, in an inspired leap of imagination, Max Born realized that we need to interpret the square of the magnitude as the quantity with physical meaning – the probability density.

What is the dot product of $|x>$ and $|p>$

Let’s start with some definitions, based on our simple minded notion that these variables need to be represented as matrices with eigenvectors.

$x |x'> = x' |x'>$

$p|p'> = p'|p'>$

The dot product is represented by $<x|p>$

Now this must be a function purely of $x$ and $p$ . Hence

$<x|p> = f(x,p>$

We expect translational invariance in physics in our physically relevant quantities and $|<x|p>|$ is (by the argument in the last paragraph) a physically relevant quantity – related to the probability density that a particle in state $|p>$ is in the state $|x>$ .

Let’s take the dot product $|p>$ of with the vector $|x=0>$ . This must be, from the above

$<x=0|p> = f(0,p>$

Now, if the origin of coordinates were moved by $A$ , i.e.,

$x \rightarrow x+A$

We don’t expect there to be a physical change in the dot product, it should not care about where the origin of coordinates is, up to a factor of magnitude unity. This means

$f(x+A,p) = f(x,p) e^{i \Phi(x,A,p)}$

In addition,

$f(A,p) = f(0,p) e^{i \Phi(0,A,p)}$

The simplest choice of function that has this property is (up to some units)

$f(x,p) =e^{i \alpha p x + iC}$

Where is an arbitrary constant, which we can choose to be $0$ and $\alpha$ is a quantity that makes the dimensions come out right in the exponent (need to have all the dimensions cancelled out).

Since you also have

$<x'| p |p'> = p' e^{i \alpha p' x'}$

The above expression allows us to make the identification

$<x'| p |p'> = - \frac {i}{\alpha} \frac{\partial}{\partial x'} <x'|p'>$

So, the matrix $p$ can be identified, in the space spanned by the eigenvectors of $x$ , as

$p \equiv - \frac {i}{\alpha} \frac{\partial}{\partial x}$

Now, suppose the eigenvectors of the $H$ matrix are the $|E_i>$ , so we have

$<x'|H|E_i> = <x'| \frac{\vec{p}^2}{2m} + V(\vec{r}) |E_i>$

$= \left( - \frac {1}{2 m \alpha^2} \frac {\partial^2}{\partial x^{'2}} + V(x') \right) <x'|E_i> = E_i |E_i>$

This is Schrodinger’s equation, if we make the interpretation $\alpha \equiv \frac {1}{\hbar}$

Apart from the mental leap to make from treating $x, p$ as a continuous set of variables to treating them as matrices (apparently that was considered higher mathematics in the early 1920s), the flow seems pretty straightforward.

To see Nima Arkani-Hamed talk about the phrase “conservative-radicalism” and other interesting topics, see the YouTube video here.

Another physics blog? Why?

I graduated in 1993 with a physics Ph.D and after a short post-doc, went off to work as an options trader and “quant”. After 22 years in that area, I realized that physics is actually back to being interesting again – 22 years ago, people were saying that fundamental physics was all done, with the invention of string theory and that other people would be shortly out with a numerical computation of the mass of the electron from fundamental principles (some combination of π,γ (Euler’s constant) and some simple integral of a dimensionless variety). None of this has come to pass. The discovery of accelerating expansion of the universe, dark matter, dark energy, the realization that gravity might be the key to many of these puzzles – have left us (possibly!) at square one. We might be at the dawn of a new paradigm shift, which might happen tomorrow with some unexpected discovery either by a satellite or at a particle collider, or might happen two hundred years from now. Either way, we are all at sea, maybe not knowing what happened in the intervening years is better.

Anyway, with the ability to pursue interesting projects, I decided last year to get back to physics. Twelve months later, having attended three physics schools aimed at graduate students and post-docs, as well as working on some courses offered by one of the physics stars at Rutgers University, I feel that I am close to finding something to work on.

As I learn new things, I will post interesting ideas that I am playing with here. I don’t have the all-round expertise of a Matthew Strassler (https://profmattstrassler.com/), the sheer genius of a Lubos Motl (http://motls.blogspot.com/), the current up-to-date-ness of Sabine Hossenfelder (http://backreaction.blogspot.com/) or the point of view of Peter Woit (http://www.math.columbia.edu/~woit/wordpress/). There is still room for the Simply Curious.

If you want to discuss stuff in a peaceable, civilised way, feel free to post. If you are angry at something, look elsewhere. And if you want to inform me about aliens in pre-history, I am simply not interested.