What is the prevailing theory on the mechanism behind the observer effect in quantum mechanics? To put it another way, what is the critical component of 'observation', itself a vague and wide-reaching concept, that is necessary/sufficient to collapse the wave function in e.g. a double slit experiment?
I know it doesn't have to be a human observer, as a detector will do the same thing (or will it just appear to when a human later checks the results of the detector?).
Does it have anything to do with the fact that particles can't be observed without either absorbing them or obstructing their path somehow?
What, in short, is the operational definition of an 'observer' for the purposes of QM?
Coincidentally I was just watching a video on TV from the "Closer to Truth" series by Robert Lawrence Kuhn entitled "Observing Quanta, Observing Nature" about the 2016 meeting of the Foundational Questions Institute (FQXi) in Banff, Canada. It's members include scientists as well as philosophers including Paul Davies and David Chalmers, both of whom he interviewed for the episode. His talk with Davies was interesting to me. As Kuhn said, Davies "makes consciousness fundamental." To paraphrase Davies: Acts of observation not only effect what happens in the future, but in some sense,
constrains what happens in the past. He attributes this idea to John Wheeler and his delayed-choice experiment. It looks like retro-causation, but we're constraining the nature of the past that was. When we do our observation we reduce the number of pathways that exist. The emergence of conscious beings today is fundamental to the actual workings of the universe.
I myself am still very skeptical of consciousness per se as having any effect on anything outside of the direct influence of the brain's neurons. To me it seems more likely that the conscious choice to do an experiment in one particular way is the deterministic result of the past chain of events. And while the fact that we make that choice doesn't identify any particular pathway, it could be thought of in the quantum world as limiting the number of paths, i.e.; making the image less fuzzy. Let's not forget the experimental results always need to be interpreted as the average of many events.
But I like the idea of an event in the present reflecting a probability of something having happened in the past. It's really similar to what normally goes for cause and effect. Since the laws of physics are considered to be equally valid for either direction of time why shouldn't we think of an observation as influencing the past? It might reflect a kind of inverse MWI(?).
So that's my long and really naive answer.