Measurement problem in the orthodox interpretation

Question

Let's look at the measurement problem in the orthodox interpretation of quantum mechanics as an inconsistency between inner and outer treatment of the measurement apparatus. You can always push your boundaries of treating the evolution of your system as unitary further and further. You can say OK, the universe as a whole is evolving unitarily (let's not worry about information loss in a blackhole). So it's up to me to consider the boundary to see the evolution of my system and apparatus together or just my system. And I should be able to work out the reduced density matrix of my system equally in every treatment unambiguously! However, If you treat the apparatus externally, the evolution of the system would be:

$$a|\uparrow\rangle + b|\downarrow\rangle \to |\uparrow\rangle$$

with probability $|a|^2$ or

$$a|\uparrow\rangle + b|\downarrow\rangle \to |\downarrow\rangle$$

with probability $|b|^2$.

Whereas, an internal treatment of the apparatus would give

$$|\uparrow\rangle\otimes|\text{ready}\rangle\to U\bigl(|\uparrow\rangle\otimes|\text{ready}\rangle\bigr) = |\uparrow\rangle\otimes|\text{up}\rangle$$

and

$$|\downarrow\rangle\otimes|\text{ready}\rangle\to U\bigl(|\downarrow\rangle\otimes|\text{ready}\rangle\bigr) = |\uparrow\rangle\otimes|\text{down}\rangle$$

with $U$ a linear operator, $U(a|\psi\rangle + b|\phi\rangle) = aU|\psi\rangle + bU|\phi\rangle$, which evolves

$$\bigl(a|\uparrow\rangle + b|\downarrow\rangle\bigr)\otimes|\text{ready}\rangle$$

to

$$U\bigl[a|\uparrow\rangle\otimes|\text{ready}\rangle + b|\downarrow\rangle\otimes|\text{ready}\rangle\bigr] =a|\uparrow\rangle\otimes|\text{up}\rangle + b|\downarrow\rangle\otimes|\text{down}\rangle$$

However, pushing the boundary after the measuring apparatus gives a difference physics. This could be viewed as a problem with measurement in orthodox quantum mechanics (as opposed to realist or operational strategies to solve the measurement problem) But I was thinking it's not really an inconsistency within a theory. It's just an inconsistency between two different choices of the internal-external boundaries! I'm not asking about the role of decoherence theory. It sounds to me like the measurement problem wasn't really a problem in the first place! Am I right about that?

update: It has been pointed out that the question is not clear enough yet. Here is my last attempt: It's believed that for an adequate postulates for quantum mechanics, the inner and outer treatment of measuring apparatus shouldn't affect the physics of the system. Which for the orthodox interpretation of quantum mechanics does. For instance in the Bohm's model this has been resolved by denial of representational completeness. And in Operational interpretation it's bypassed by avoiding talking about physical state of the system. Here the question is Are we really allowed to change the boundaries? Because if you don't believe you can, the problem will never appear in the first place. I hope that explains what I'm asking. Because I don't think I can make it more clear :-)

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

Comments

@ Marek: I guess a little bit of misinterpretation is happening here! You can add decoherence theory to your interpretation and say look, now I know what the cause is. However, it doesn't really solve the problem of inconsistency I raised above. Because having the environment involved the reduced density of your apparatus is still \rho=a^2 \ket{up} \bra{up} + b^2 \ket{down} \bra{down}, and you still have the inconsistency of the internal external treatment! What I'm asking is "is this inconsistency a problem at all?"

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

---

Oh! I see were is the confusion coming from! Give me a sec I'll make the question more clear!

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

---

@Sina: decoherence is useful in explaining the role of the environment on the way system gets correlated with the measuring apparatus. But it still doesn't explain the collapse and problem of measuring itself. For that you need some more complete interpretation (like Everett's Many worlds or Coherent histories).

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Marek

---

@Sina, thanks for the update, I guess I have some idea what you are talking about now. It all boils down to this (right?): "the inner and outer treatment of measuring apparatus shouldn't affect the physics" -> but really? This is the first time I hear about this. Actually, it has to affect physics because you can explain more by treating the system more completely. As the measuring apparatus will get smaller and smaller you will definitely observe genuine quantum effects of apparatus coupling to the system. These will be different for different apparatuses; or boundary conditions, if you will.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Marek

---

Yeah, I could imagine this should change the physics for different reasons. However, usually people believe it shouldn't, and that's what I don't understand why! I've linked to a talk by Rob Spekkens in my comment on @space_cadet's answer. I understand It's not a good practice to believe in something because big names say that! But I really think it shouldn't be that simple!

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

---

Sorry for not being clear enough. I'm asking whether or not measurement problem is really a problem since it just arises from the difference in the boundaries of treating the system as internal or external and nothing that fundamentally challenges the theory!

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

---

@Sina: measurement problem is the question of what causes the collapse which is built-in in Copenhagen interpretation (I assume this is what you mean by orthodox). You can't really get rid of collapse and implicit notion of some measuring apparatus (with which you have to measure your original apparatus) so that the problem will always remain in this interpretation.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Marek

Answer 1

We're not allowed to change the boundary, especially not in the direction of making a bigger piece of the world "classical" than what is allowed.

In particular, the whole world - not just electrons but also the apparatus - obeys the laws of quantum physics. At some moment, however, the quantum phases, coherence, and interference become de facto impossible because they're lost in the noise of the environmental degrees of freedom. This process is called "decoherence" and once it happens, it is legitimate to consider the quantum-calculated probabilities to be ordinary classical probabilities.

Decoherence depends on the Hamiltonian and exactly determines where the boundary is. The important point is that if one assumed that the world is classical even at some "more microscopic level" than where it becomes classical - i.e. if one assumed that certain objects can't interfere and exhibit entanglement etc. even though they can - he would end up with incorrect results.

See e.g. this introduction to decoherence:

http://www.karlin.mff.cuni.cz/~motl/entan-interpret.pdf

Niels Bohr was implicitly aware of decoherence but unfortunately, his explanations of his intuition weren't too coherent, either. That's why this insight had to wait for an explicit description until the 1980s.

Instead, the Copenhagen school adopted a pragmatic attitude. It didn't explain or calculate where the classical-quantum boundary was located. However, it placed it safely in the "macroscopic realm" so that no interference, entanglement, or other predictions of quantum mechanics were ever lost.

It's important to realize that one can use the full quantum description even with macroscopic objects - they satisfy quantum mechanics, too. I can treat all other observers and physicists as quantum systems who evolve into linear superpositions etc. and only calculate the probability that I see $A$ or $B$ at the very end - because I know that I won't "perceive" any bizarre linear superposition. It never hurts when you treat all things in the quantum mechanical framework. See Sidney Coleman's talk, Quantum Mechanics In Your Face,

http://motls.blogspot.com/2010/11/sidney-coleman-quantum-mechanics-in.html

where this quantum treatment of the whole world is used in several pedagogical examples. On the other hand, when one deals with macroscopic enough objects, and traces over environmental degrees of freedom that are really impossible to keep track of, the density matrix becomes almost immediately and almost exactly diagonal in the "preferred classical basis vectors". That allows us to treat the diagonal elements of the density matrix as classical probabilities. Quantum mechanics will still predict probabilities only and the results of individual events will be random. However, if the density matrix is kept diagonal, it allows us to assume - just like in classical physics - that the macroscopic degrees of freedom were in a particular state even before we measured (or saw) what they were. We won't reach any contradictions.

However, once again, if we did make this assumption for any system that can still interfere and evolve quantum mechanically - i.e. if we imagined that any aspect of the wave function "collapsed" before we actually make the measurements - we would reach incorrect and contradictory predictions. So if you don't know where the boundary is, you should better assume that everything is quantum - because everything is quantum. Classical physics is just an approximation and one must appreciate that it is often or usually invalid.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Luboš Motl

Comments

this is a nice pedagogical overview of decoherence but it doesn't touch the very specific example quoted by @Sina. In fact, his question could be said to start off at the point where you state that "everything is quantum". Keeping in mind that there is no quarrel with that statement the question becomes: How do we provide a proper understanding of the "nested observers" gedankenexperiment? This question is covered in Rob Spekkens' talk and in books such as "Conceptual foundations of QM" by d'Espagnat.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user user346

---

As I mentioned in the question, I don't think the decoherence theory is ganna solve my problem. The detail is explained at time 25:00 in Rob Spekken's talk @ the 10th Canadian Summer School on Quantum Information: circle.ubc.ca/flashstreamview/bitstream/handle/2429/29961/…

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

Answer 2

I think you've just rediscovered the Many-Worlds interpretation. All that Many-Worlds really says is that when a system in a superposition state is measured, the state of the measurement apparatus (and associated observers, etc.) becomes entangled with the state of the system . The system continues to be in a superposition of all possible states, it's just a somewhat more complicated superposition, including the measurement apparatus and all that.

Contrary to what a lot of popular treatments lead people to believe, Many-Worlds does not involve the creation of an entire separate universe worth of matter for each of the possible measurement outcomes. There is just a single wavefunction describing the single universe worth of matter that we have, which becomes more and more complicated as time goes on. We only see a single branch because decoherence in the form of unmeasured interactions with a larger environment destroys our ability to detect any influence of these different branches on one another. This makes the different branches effectively separate "universes," because the piece of an observer in one branch is entangled with the state of the system in that branch, and cannot detect any influence of the other branches.

Your internal/ external phrasing is different than I'm used to hearing, but the math you've written down looks exactly like the way you would formulate a Many-Worlds type description of the measurement process. If that's not what you're doing, the distinction isn't clear to me.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Chad Orzel

Comments

Thanks for your answer. As you mentioned one resolution to this inconsistency is the Many-Worlds interpretation. However, alongside with MW, there are a whole list of responses from different interpretations, which to me they look more or less equivalent considering this specific problem. Nevertheless, here my question is whether we are really allowed to treat the apparatus internally (the 1st treatment) if we want our postulates to be universal. Because if you don't allow the first treatment, which to me sounds acceptable, then you'll never face the problem at all.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

---

Do you mean "externally" rather than "internally?" Your first option above is described as "external" in the post, and that seems to be the one you find problematic.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Chad Orzel

---

Assuming you do mean "externally," I'm not sure how you would go about implementing a rule to exclude that possibility, short of an ad hoc Copenhagen-ish assertion that it's forbidden. After all, what you're choosing to do in that instance is just focussing on a single subsystem, and ignoring the many other states that are in a direct product with it. If you want to forbid neglecting pieces of a direct product, though, things quickly become unmanageable-- every quantum system in the universe exists in a direct product combination with every other quantum system in the universe.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Chad Orzel

---

After all, even your "internal" formulation neglects lots of other things that by this standard ought to be included. There's an experimenter looking at the apparatus, for example, whose state also becomes entangled with that of the apparatus and the system. And there's the PI in the office across the hall, whose state becomes entangled with everything else once the student tells her the result. And so on.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Chad Orzel

---

The projection postulate formulation of measurement, which is what you're really objecting to, is best thought of as a necessary calculational shortcut, to avoid having to deal with all the other systems that make up the universe surrounding the system you care about. Whether that shortcut is covering a real physical collapse of the wavefunction or merely an entanglement with a bazillion other systems followed is a matter of philosophy. Trying to forbid that shortcut, though, puts you on a path to madness.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Chad Orzel

---

"puts you on a path to madness" ... a slight exaggeration perhaps :-) @Chad I think there is more to this question than "many-worlds" otherwise I doubt people like Rob Spekkens would be giving long talks on it. You should check out this talk for a better statement of the problem.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user user346

Answer 3

The orthodox Copenhagen interpretation is entirely unproblematic as long as your self is placed outside of the box. We can always choose to draw the box placing us outside. This is why it works in practice for practically all experiments and engineering work. Madness comes in when your try placing yourself inside the box. You either have to restrict the box, or contrive to place yourself outside the box one way or other. Many worlders try to describe the universe by an uncollapsed wave function, but only at the price of imaginatively abstracting themselves away from the universe, pretending that they're not really inside the universe, or that they don't exist.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Rob

Comments

Thanks for your answer. Just to make any possible discussion easier let me bring the link from which I got my question: circle.ubc.ca/flashstreamview/bitstream/handle/2429/29961/… If by the madness caused by placing the measurer inside the box you mean what Robert Spekkens said at 17:55 in the video, i.e in the Schrodinger's cat terminology the cat can't be dead and alive in a same time, then my question is why not? I mean what is unscientific about it (as opposed to uncommonsensical).

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

---

But if, by that, you mean the inconsistency of the result when you treat it externally vs internally and saying it should be the choice of physicist to chose the boundary (again as he says at 15:00 and could be found in Von Neumann's text) then why is this the case? What is the logical necessity of being able to make such a choice?

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

Answer 4

The answer to Sina's question is that there is a problem, but one does need to be precise about what you mean by 'the same physics'. In the conceptual framework of QM you are always allowed to push the boundary outwards...to include more and more of the universe. This change in boundary never affects the 'experimental results' or 'measurements' in the following sense: we must assume there is a second measurement apparatus which measures the dial or read-out of the first one.

micro-System ----> | 1st boundary ---> 1st apparatus -----> | 2nd boundary > final apparatus.

The probabilities which will be measured by the second, final apparatus do not depend on whether we use the first boundary or use the second boundary.

In this sense, it is not possible to experimentally detect any difference in the system no matter where we draw the boundary.

But, is this what Sina means about 'the physics of the first apparatus' (If I may be allowed to paraphrase his question). Wigner posed this same question very clearly more than once, and I recommend reading his papers on this. If we choose the first boundary, then 'the physics' of the first apparatus is a stochastic process, a non-unitary evolution. If we choose the second boundary, the 'physics' of the first apparatus entangled with the micro system is now deterministic and unitary. For Wigner and many others, this is a physical difference and is a serious problem. For Bayesians and many others, it doesn't count as truly 'physical' because it does not lead to any differences in predictions of experimental results. So the answer to Sina's question, which is the same as Wigner's question, is, it depends on what you mean by 'physical' and what you mean by 'is a problem'.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user joseph f. johnson

Answer 5

@Sina is making a perfectly good point with this question.

The statement is this:

The measurement problem is not really a problem, because the result of a measurement is not only dependent on the system being "measured", but also on the observer doing the "measuring".

To actually realize this dichotomy between an "internal" and "external" observer, the size of the observer's Hilbert space, given by its dimension $\dim(H_O)$, must be comparable to $\dim(H_S)$ - the dimension of the Hilbert space corresponding to the system under observation. Instead, what we generally encounter is $\dim(H_O) \gg \dim(H_S)$ as is the case for, say, an apparatus with a vacuum chamber and other paraphernalia which is being used to study an atomic scale sample.

In this case the apparatus is not described by the three states $\{|\text{ready}\rangle, |\text{up}\rangle, |\text{down}\rangle\}$, but by the large (infinite?) family of states $\{|\text{ready};\alpha\rangle, |\text{up};\alpha\rangle, |\text{down};\alpha\rangle\}$ where $\alpha$ parametrizes the "helper" degrees of freedom of the apparatus which are not directly involved in generating the final output, but are nevertheless present in any interaction. Examples of these d.o.f are the states of the electrons in the wiring which transmits data between the apparatus and the system.

So if we consider the apparatus to be "internal" then the Hilbert space of the total "system+apparatus" is:

$$H_{S+O} = H_S \otimes H_O$$

which has as its basis vectors

$$\{ \left|\uparrow\right\rangle|\text{ready};\alpha\rangle, \left|\uparrow\right\rangle|\text{up};\alpha\rangle, \left|\uparrow\right\rangle|\text{down}; \alpha\rangle; \left|\downarrow\right\rangle|\text{ready};\alpha\rangle, \left|\downarrow\right\rangle|\text{up};\alpha\rangle, \left|\downarrow\right\rangle|\text{down};\alpha\rangle \}$$

It is the states of the form $\left|\uparrow\right\rangle|\text{down};\alpha\rangle$ and $\left|\downarrow\right\rangle|\text{up};\alpha\rangle$ which are "counterfactual" (and you neglected to mention in the question).

At this point I wave my hands and say when an external super-observer looks at the states of the system described by $H_{S+O}$, the conterfactual states of the type mentioned above will interfere destructively due to the presence of the numerous $\alpha$ d.o.f; leaving only the "consistent" states of the type $\left|\uparrow\right\rangle|\text{up};\alpha\rangle$ and $\left|\downarrow\right\rangle|\text{down};\alpha\rangle$ as the ones with non-negligible amplitudes. So in such cases, their is no contradiction between what the super-observer sees and whatever output the apparatus yields.

It is when the observer and observed systems become comparable in size that we run into all kinds of problems. As far as I know no apparatus has yet been constructed which is described by the same number of d.o.f as the system it is supposed to measure. But we are rapidly approaching that limit with nanotechnology and then this measurement dichotomy will have to dealt with head on.

---

I hope this answer makes sense. However, such questions always lie in treacherous territory. So if I've made some tautological error which invalidates everything I have said, please point it out !

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user user346

Comments

@Sina: so could you, please, try to put that into a formal statement and also provide a concrete question we should focus on? Also, try to be explicit about where the inconsistency is. I don't see it. It's possible that space_cadet understood you but lots of other people haven't so the current state of affairs is definitely bad.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Marek

---

I'd have to see Spekkens' talk before I can say anything useful.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user user346

---

It's a rather lengthy talk. I hope you enjoy. circle.ubc.ca/flashstreamview/bitstream/handle/2429/29961/…

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

---

Please guys, discuss on chat!

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user mbq

---

@mbq, @Sina, @space_cadet, @Chad: agreed. This length of discussion is a good indicator that you should move here (for your own sake): chat.stackexchange.com/rooms/71/physics

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Marek

---

@space_cadet: Thanks for your answer.I have two question for you.Could please let me know how the conterfactual states are generated in the first place and what is the role of \alpha s in getting rid of them?Because I've always just been taught that measurement gives each possible state with probability Tr(\Pi_\alpha \rho) for different possible projections and we never talked about inconsistent states! And the second question is in a talk by Rob Spekkens (from PI) he said he believes an adequate set of postulates for quantum mechanics shouldn't have this inner-outer problem!What do you think?

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

---

@Marek: I'm not claiming that the second treatment solves the measurement paradox. What I'm saying is this inconsistency in the inner-outer treatment of the measuring apparatus is a problem which shouldn't be there in a theory! And my question is whether it's really a problem or it arises just from our lack of understanding of the problem due to the complexity of the system (something like the point space_cadet made out)

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user iii

Answer 6

There is an infinite nested system of boxes like matryoshka dolls with infinitely many levels. Label each level by i. Is each box an open system, or a closed system? It's actually possible to have both. At the i^th level, there is a time period $T_i$ — starting from the big bang which was the beginning of everything at all levels — when either exactly, or to a very good approximation, the i^th box is decoupled from the rest of the i+1^th box outside the i^th box taken as its environment. The box is effectively a closed system, and we have a factorized unentangled state between the environment and the system. After $T_i$, significant coupling occurs and the system and environment gets entangled, and the system evolves to an open system. It now appears the i+1^th box is a closed system, but after some time $T_{i+1} > T_i$, it couples to the rest of the next higher box, etc. .

Copenhagen or many worlds? Both! Suppose you identify yourself inside the i+1^th box but outside the i^th box at a given moment. Then, before $T_i$, you impose the many worlds interpretation for the i^th box taken as a closed system. Then, coupling happens. Information about the i^th box which reaches you is considered "collapsed" as in Copenhagen. You become an idealist and think only those things you know about the i^th box exists and owe their existence to you, that in fact, the i^th box is in you. Then, you start thinking about the i+1^th box as a whole which you identify as your universe. After a while, you start to apply systems thinking to yourself, and start identifying less with yourself, and more with the entire box you are in. There comes a conversion moment when you suddenly "jump" up to the next higher level and identify yourself outside the i+1^th box but inside the i+2^th box, although it would take some time for you to discover the boundaries of the i+2^th box. Then, you realize you were really outside the i+1^th box all along, but were only falsely identified with it because you were accessing records and memories from that box, but confusing that for the real thing. This is the moment of transcendence! The new box transcends, yet includes all the earlier boxes. Information about the i+1^th box which never reaches the i+2^th box reverts back to the many worlds interpretation, including those which were falsely identified as "collapsed" at an earlier level.

All the levels above you are temporarily interpreted as classical.

This is the new and improved version of the von Neumann chain and the Heisenberg cut.

Is Being timeless, or Becoming in time? Both! When you identified yourself with the i+1^th level, as more and more information reaches you, you think time passes in a process of Becoming with more and more collapses as your knowledge keeps growing. When you transcend the system, you realize these were all timeless memories after all. Becoming has become Being.

God is the nested chain of all the higher levels than the one you currently identify with. God isn't a specific entity at any given level, but transcends yet includes all levels. Any collapse of the wavefunction can only come from God by passing through all the levels above. The nested system of boxes goes on without end, which is why the kabbalists call God Ein Sof. You always falsely identify yourself with a given level, but you are really God all along.

After a while, you start noticing an algorithmic pattern for the transcendent jumps up each level, and try to contain God within this algorithmic pattern. But you realize this is only a transfinite induction ordinal jump after all in a larger transfinite box. God can't be contained because God is always transcendent.

See Ken Wilber for more details.

This post imported from StackExchange Physics at 2014-04-01 16:20 (UCT), posted by SE-user Evolutionary panentheist