Hacker News new | past | comments | ask | show | jobs | submit login
What did Mary know? A thought experiment about consciousness (2013) (philosophynow.org)
78 points by yamrzou on Oct 21, 2022 | hide | past | favorite | 167 comments



"Jackson’s thought-experiment about Mary challenges physicalism in the following way. Physicalists claim that physical science can fully explain consciousness. However, when Mary sees the red of the apple, says Jackson, she learns something new, despite having previously learnt all the physical facts about colour vision. Thus, argues Jackson, Mary has come to know a non-physical fact; so proving that not all knowledge is physical."

I can't see how this result proves anything. Consider the analogous experiment of "Mary learns to cycle by reading books". Surely she can learn all the physics behind cycling without truly knowing how to cycle, and one could similarly conclude that there is something beyond the physical mind behind this skill. Nevertheless, we can use reinforcement learning to teach an ANN to cycle, and that doesn't mean our robot has acquired a metaphysical consciousness.

You can still interpret both results from a physicalists perspective as in "some learnings require specific physical stimuli".


If she knows everything about colors then she could remove her retina and stimulate her visual nerve with the identical signal as color red would produce.

I'm 100% confident that she would experience red without actually seeing red.

Consider a separate thought experiment. A Bob lives in a bubble that does not allow liquids to exists outside his body. If he puts his hand in a completely dry glove sticking outside the bubble and surrounded by water he will experience wetness despite having no contact with water.

We know that our body does not have direct sensors of wetness. We experience pressure and heat loss as wetness. So you 100% can experience wetness without getting wet.


I would argue, in the first case, stimulating your visual nerve with the identical signal as the color red would produce would be seeing red. Your argument is akin to saying that someone born profoundly deaf with a cochlear implant has never heard anything! Additionally, the phenomenon of "red" would seem to be more complex than just a single channel, any human will agree that (256,0,0) is not to the only RGB value that maps to red, but would Mary be able to identify which clouds in a sunset were orange, which red, which pink or purple?

For your second thought experiment, I would argue that wearing a wet glove is not a complete representation of wetness, because of the specific interactions that wetness has on the skin; apart from the sensations of pressure and heat loss, there is also the way that water moves/interacts with the skin making it more grippy, the texture of water and it's surface tension forming drips, and the movement of those drips, and the way wet skin feels different are all part of the overall qualia of wetness, hence why we differentiate between e.g. drenched and misted. There are 6 different mechanoreceptor systems in the skin, and the complete phenomenal concept of wetness likely involves all of them. I also think this is a poor thought experiment, because it necessarily involves water, image Bob exists in a plane of reality without liquid water entirely, would it be feasible for him to experience wetness?


> I would argue, in the first case, stimulating your visual nerve with the identical signal as the color red would produce would be seeing red. Your argument is akin to saying that someone born profoundly deaf with a cochlear implant has never heard anything!

I don't really object to that. My conclusion is that you can know what red is on the level of qualia without getting in contact with approximately red wavelength light. You can know what sound is without getting in contact with pressure waves. You can know what wetness is without getting in direct contact with water.

> I also think this is a poor thought experiment, because it necessarily involves water, image Bob exists in a plane of reality without liquid water entirely, would it be feasible for him to experience wetness?

I don't know. In that plane of reality we would not have evolved a mechanism for sensing wetness.

I don't know if it's possible to experience being in a spacial 2 dimensional reality or spacial 4 dimensional reality. My guess would be yes, but it would require significant alternations to our bodies, mostly brain structures.

Our experience of reality is almost certainly very limited vs. what's possible. There exist distinct human personalities who can see trough each other eyes and communicate with their minds - I'm talking about craniopagus twins.

I'm looking forward to high-bandwidth computer-brain interfaces. Some people may actually get to experience how it is to be a computer or whether it feel like anything at all.


It honestly sounds like a lot of conflating "learning/recognizing X" for "experiences X" (even going so far as to invent a new word, qualia, for that)... which just seems like a bizarre distinction to me.


> So you 100% can experience wetness without getting wet.

Which leads us to the interesting conclusion "you can experience everything without actually experiencing it" which is a bit Buddhist.


What is “wet” then? Liquid clinging to your skin through surface tension and other forces? If your hand is submerged in a liquid that will not cling to your skin at all, is your hand “wet” while it is still submerged? You’d feel “wetness” according to your definition but your hand would be “dry” when you remove it. I don’t think wetness is defined by future state, but by present state.

If Bob is experiencing wetness, then he is “wet”, at least while he experiences it, even if his hand will be dry when he removes it from the glove.


> What is “wet” then? Liquid clinging to your skin through surface tension and other forces?

Yes.

> If your hand is submerged in a liquid that will not cling to your skin at all, is your hand “wet” while it is still submerged?

No. If you submerge your hand in mercury you will not get wet. The same if you coat you hand in aerogel. It is empirical fact that people do not describe this situations as being wet.

E.g.: https://youtu.be/GcdB5bFwio4?t=225


> If you submerge your hand in mercury you will not get wet.

Tangent: To what extent is that evolutionary? Wetness being a unique feeling could be, that we have evolved a greater sensory capacity to experience water, due to its abundance and importance.

Thus other words for touch (in English) generalise across a variety of sensory experiences (sticky, slimy, hard, etc.) where as wetness is specific to fluids that behave like water.

If I had a point, I guess it would be that maybe wetness is a especially unique experience. I don’t know whether this makes it a better or worse example to use.


Yes, exactly.

Then, having worn a nitrile glove while putting my hand in water before, I doubt that Bob would experience wetness.

Easily tested at home.


I distinctly remember a situation where I was being confused whether my hand was wet or not when wearing gloves. My hand was in fact not wet back then. I went to test it again to refresh my memory and the experience in glove is not identical, but it is certainly sufficiently close to have a potential to confuse. Especially when submerging a hand with glove and without glove the experience is very similar, the biggest difference is when you get the hand out of the water.

The glove provides quite a good approximation.


It’s similar, but it’s not the same. I’m not yet ready to accept that the sensation of “wet” is only the result of pressure and heat transfer. Which is why, though similar, you can still tell the difference.


Exactly, or maybe she simply saw a red apple in her dream. You can think if people as robots and the eyes are sensors that tickle the brain with the red signal. It can happen without actually seeing red. We know this because we have dreams and they are all sorts of sensory experiences that are completely made up by our computer brains.


I don't think people who have never seen red can dream of red. Color vision is acquired as far as I know. Newborns don't have it in the sense that they have to train to distinguish colors.

As such, I find it entirely plausible that Mary would be too old to learn color vision. Much like people born blind cannot acquire full vision later. She might just be unable to experience red. That would include her dreams.

Yes stimulatimg her optical nerves could prepare her to see red. Meaning she'd jave the brain hooked up the right way to see it.


> I can't see how this result proves anything. Consider the analogous experiment of "Mary learns to cycle by reading books". Surely she can learn all the physics behind cycling without truly knowing how to cycle, and one could similarly conclude that there is something beyond the physical mind behind this skill.

This is indeed one of the standard responses to Mary's Room, where experiences like "redness" are not actually knowledge but are an "ability". So Mary doesn't actually "learn" anything new technically, but she acquires a new ability to experience redness when exposed to it for the first time.


> I can't see how this result proves anything.

It doesn't. When you dig into the details, Jackson's argument is circular: he can only infer that Mary learns something new by implicitly assuming it.


The easiest way I see to parse this is by doing a thought experiment: what if the human brain was indeed a hardware/software device, how would this work?

Eg, can you take a webcam image analysis software and teach it that apples are red without ever showing it something red through the camera?

I'd say the answer is obviously dependent on the design.

Yes if you have enough control over the software. You can introduce the shape of an apple into its dataset, and tell it that an apple shape is such and that it rates highly on the R channel. Then the program will upon seeing an apple for the first time say "Yup, this is indeed a red apple" and be entirely "unsurprised".

No if the system is isolated enough. Eg, if the recognition system is locked in a black box and your only controls are a query of "what is this?" and a command of "remember that the thing you're looking at now is X", then you don't have the access to introduce the information above by any other means than presenting an object to the camera.

Both systems are still 100% physical though.

The question is what humans are most similar to and I think the second option is most likely. Think of that for instance I can't mentally measure my blood pressure, or heart beat, or make myself vomit. There are some things my body does that are outside of my direct control. Given that, there's no reason to assume then that by just reading or listening to information that I would necessarily have any pathway from there to the depths of my visual system.


My understanding of the thought experiment is that it is not about being able to detect red, but about experiencing the feeling that it is to see red. So in a hardware/software device, could we make the hardware experience seeing red the way you or I experience the color red.

My strong intuitive hunch is that we'll never build something electronic that can experience things (that it feels like something to be that device).

Compare this to how our immune systems works, it reacts on inputs and does very complex things but without experience. There could be beings or machines that could have this exact discussion like that, learning things, agreeing, disagreeing but without experiencing anything.


> My strong intuitive hunch is that we'll never build something electronic that can experience things (that it feels like something to be that device).

The Bekenstein Bound tells that us that any finite volume has finite information. That means our brain is describable by finite information, including our feelings. So why can't that information be translated into an electronic form?

The only way out of this conclusion is to assert that "experience" cannot be captured by physics. Is that your position?


Yes. I used to be a hardcore materialist, I studied applied physics at university as a young know-it-all, and never reflected on how absolutely weird "experience"/quale is until years later and changed my mind. But if anyone can explain how to get from matter to experience I would be relieved :)

What do you think?


I suggest reading the following paper for how neuroscience is starting to tackle this:

A conceptual framework for consciousness, https://www.pnas.org/doi/10.1073/pnas.2116933119#fig01


Thanks for the link. It seems to me though, that it's no easier to explain having the illusion of experience than to explain actual experience (and vice versa).

I've heard Joshua Bach talk in similar terms and I frankly do not get it.


> It seems to me though, that it's no easier to explain having the illusion of experience than to explain actual experience (and vice versa).

The paper goes over that too: 1. The brain uses information to build models, 2. all brain models are necessarily inaccurate.

Therefore quale are inaccurate models of perceptions and/or models of perceptual memory, where some information has been thrown away, as we do with all models. The redness of an apple is a distorted sense memory of the apple, just with all the "appleness" thrown away leaving only the "redness", which is why they seem so vague and ephemeral.


I don't see how we're one step closer to qualia.

I'm pretty sure I'm missing the main point of the paper and I'll read it again tomorrow.

If I and some other people would follow a certain algorithm, the one in the paper, but refined and perfected for a thousand years... Calculating with pen and paper the progression of states from a suitable initial state... Would an illusion of experience/qualia appear somewhere just from our calculations? Would it feel like something to be the state represented in the numbers?

Anyway, thanks for the discussion.


> Calculating with pen and paper the progression of states from a suitable initial state... Would an illusion of experience/qualia appear somewhere just from our calculations? Would it feel like something to be the state represented in the numbers?

No, why would some data scribbled on paper describing qualia in a model of a brain reproduce that qualia in your brain?

If you write code on a piece of paper, does your laptop suddenly execute that code? If your laptop takes a picture of that scribbled code, does it then execute that code? If you take a picture of it and then OCR it, does it execute that code? If you take a picture of it, OCR it, and then feed it to the right compiler/runtime does it execute the code?

As you can see, there are numerous layers of translation to get the information in the right form and in the right place. "The right form" for our qualia is the form we evolved to perceive. I'm not sure why one would expect information in any other form to produce quale.


Not in my brain, in some context within the numbers. It seems that it's purely about measurement, modeling, errors, and other things that can be expressed as a computer program. I only chose pen and paper for the whole process to seem less magical. Suitable inputs from the programs "environment" would be incorporated in the updates of the state.


> Not in my brain, in some context within the numbers.

Then yes. As I said, quale are sort of information stripped models of our perceptions, but divorced from direct perception, and this lack of a direct link is why they seem ephemeral and mysterious. If you believe perceptions have a formal model then quale are a projection of those.


> "The right form" for our qualia is the form we evolved to perceive.

And this is the hard problem of consciousness, how it is even possible to evolve that. The rest is the easy problem of consciousness.


> And this is the hard problem of consciousness, how it is even possible to evolve that.

How was it possible for the eye to evolve? The paper I linked goes over this too: systems that have attention schema models are more efficient and more effective than those that don't.


I'm quite sure that my immune system provides me with experiences.

For example, I certainly can feel swollen lymph nodes.

My memory of swollen lymph nodes is about as vivid or detailed as that of headache.


Right. The thing is there are multiple different ways to represent a piece of information like 'red' that each have different advantages and disadvantages. Pixel data in an image file, weightings in a neural net, a flag in a database and many many variations on each of these.

An image classifying neural net doesn't just store 'red apple' as a colour value like an image file, but as relationships between all sorts of other aspects of images it has been trained on. It probably doesn't even store 'red' distinctly at all, the weightings that represent red in the classification of a red car may well be completely different from the weightings that identify red in images of apples. Likewise with human brains. So when Mary sees a red apple, that will evoke different responses than she would have to a red square or a red car. It's the relationships between attributes that matter at least as much, if not vastly more than the attribute itself in isolation.


Only some apples are red.

And, most apples don't even look like apples. Every apple you've ever eaten has its origins from a single tree, found by chance in the past by people who are now wealthy from selling delicious apples plucked from a forest of clones.

Most people (I've asked) will visualize a red apple if you ask them to visualize an apple.

Additionally, some people don't visualize apples. They may, for example, only visualize people.

Finally, some people don't visualize anything. Some of those people still know what an apple looks like, even if it's the size of a grape, purple when ripe, and has never been seen before.


> Most people (I've asked) will visualize a red apple if you ask them to visualize an apple.

That's fun! To me apples are green by default. How many people have you asked? (Just curious)


I think for a lot of people, at least in the US, the idea of an apple being red is presented by cartoons, for example Snow White. That along with the tyranny of the Red Delicious being foist on kids that didn't know any better.

If you said imagine a good tasting apple I would envision something colored like a honeycrisp. Or an apple pie apple being green.


I've asked at least a hundred people. Sometimes they are reported as green!


It's pretty clear Mary learns something new upon viewing the red apple and it's easy to create an experiment for this. We'll continue using Mary's monochrome example as a basis.

Consider the following experimental setup: Mary is prepared with all the knowledge about colors and apples and every other odd thing just as before. Mary is then instructed to view an apple and then subsequently asked to follow the instruction printed in red in the next room.

In the next room there are two sets of instructions. The instructions in red say "Exit through the left door" and the instructions in blue read "Exit through the right door". Behind the left door is a million bucks and behind the right door is nothing.

Does Mary get the million bucks? Would Mary get the million bucks had she skipped looking at the apple? It's probably helpful to do this with several Marys and ask, is there evidence that our Marys choose the left door greater than the expected probability attributed to random chance? If we can answer yes, no, and yes, then we can infer that choosing the view the apple changed Mary's mental state and that yes, she did learn something new that helped her to identify the correct text.


I'm not sure about that. If Mary knows all the physics of light, she can design and set up a sensor to detect the color of the apple and the instructions, just like we have sensors that detect ultraviolet and infrared light. Just as we will never know how it feels to "see" ultraviolet light, this thought experiment is about Mary's subjective experience perceiving color, not her ability to determine the color of the world around her.


Mary is using sensors either way: they either come pre-installed or after market.

On a more serious note, I'm taking the question in the article at face value, "Has Mary learnt anything new about the colour red upon seeing the colour for the first time?" If the author really meant it to be a question about the subjective experience of seeing, they should have simply written a better question.


Your confusion is not the author's fault. You ignored the parameters of the thought experiment, which clearly state that she can discern colors without "seeing" them. The question is whether the subjective experience of "experiencing" color adds new information.


I'm familiar with the thought experiment and have been for decades. I still think the author could write more clearly.

Besides, we can clearly perform a proxy experiment today by way of enchroma glasses and colorblind people. Simply devise a way to test for information predicated on trichromacy using bichromatic metamers. Did the subject experience a functional difference? If so, it's a pretty easy question to answer. If there's no functional difference then why does it matter?


"Simply devise a way to test for information predicated on trichromacy using bichromatic metamers." lol... "Simply..." this is literally the 'the explanatory gap' described in the article. We don't currently have a way to measure if the brain "acquired new information" when it knows about something but then sees it for the first time... which is the whole point. "experience a functional difference" -- what does that even mean?


Let me get this straight. What you're saying is that we categorically don't have an examination which tests if someone has acquired new information?


AFAIK, we have no way of assessing whether “someone” has acquired new information other than that someone demonstrating their knowledge. We can’t MRI “acquisition of information”. So, as per this thought experiment, we have no way of telling if Mary gained new information by “seeing” red when she already “knew” what red was and could interpret it as such. That’s the whole point of the the thought experiment, which clearly went over your head.


You can set up the analogous experiment with an AI-controlled robot. You feed the AI all available knowledge about the color red. Still it will be as able or unable as Mary to recognize red, until you tell it which bits of the incoming video stream correspond to the red color channel.

That is, the AI has also to understand how the robot’s visual hardware and video signal processing works, including the data formats involved. Then it can deduce how to recognize the color red.

With Mary, it’s basically the same, she needs to map her internal experience to what she knows about colors.


Not clear at all and addressed by the parameters of the thought experiment. Remember that Mary has near omnipotent knowledge of light and vision. She would clearly be able to interpret the color of the door with her expertise of light refraction, density, etc. She would "know" the door is red without having "seen" red.


What I find interesting is that this seems to be an obscure philosophical thought experiment, but it's actually highly political and turns up all the time on, say, Twitter. Specifically, how do you compare "factual knowledge" and "lived experience", and which is more important, and who is the "expert" on things.

To make this concrete, consider expertise on England. Suppose Prof. Smith has never been to England, but has studied it in detail for decades. And suppose Mr. Chav has grown up in England, but is uneducated and isn't even sure who is the Prime Minister. Who is "allowed" to talk about England? Smith, who knows all the facts, or Chav who lives there and knows what it's like? Can Smith tell Chav that he's wrong about England, or does Chav's lived experience matter? (I'm using England as a less controversial example, but this usually happens in discussions of race or gender.)


I think what you're suggesting here might be both more and less complicated than you're making it, owing precisely to the presumption of the "identity" of the thing called "England" (very similar to race and gender of course).

As a black person, I just find that there's probably something along the lines of the philopsohical idea of "things are what they do," which also means occasionally getting comfy with contradictions and paradoxes.

E.g. concretely, I can (well, must, really) accept the idea of "blackness" being a very flimsy concept from a scientific view but a very strong one from a social/political one.


> Who is "allowed" to talk about England?

I don't see any issue - both can talk about England and provide different perspectives.


> And suppose Mr. Chav has grown up in England, but is uneducated and isn't even sure who is the Prime Minister.

Easy: The head of lettuce.

More seriously, this stuff comes up with historical events, which is only to be expected given that the human mind is a tale-spinner of ill repute that has a habit of creating and re-creating stories and convincing itself that this new version was the way it really happened. Records might be incomplete, or even wrong, but they don't flip things around quite as avidly as the human mind. Of course, I don't know how much known facts about cognitive science are allowed to inform philosophy...


Isn’t that question easily answered if we know if it’s a “factual” or “lived” subject that is being discussed?


are lived subjects not also factual subjects?


Only in the same sense that anecdotes are data.


You mean as one data point?


How is dualism supposed to resolve this question, any ideas? I don't really see what it brings to the table on this. The article doesn't seem to address that.

What frustrates me with dualism generally is that it doesn't actually explain anything, it just seems to say "we don't understand how this works physically, therefore woo". It's the god of the gaps argument all over again. I may be seriously mischaracterising it, and that's not my intention. I've just never come across any positive arguments for dualism having any explanatory power on it's own terms, and I'll be very happy if I'm wrong on that. What characteristics or attributes might this non-physical quantity or influence or 'stuff' have that answers any of these questions?


To me it seems a word game, as happens so many time with philosophers. What is meant by the words 'knowledge' and 'consciousness', exactly? Define them strict enough, and the paradox will evaporate.

E.g. in this case, let's define 'scientific knowledge' the ability to predict the future, and to choose scenarios where a specific future happens. Science is then the process for generating scientific knowledge. Newton's theory, for example, allows us to predict the future of an object with mass, and choose ways to put such objects together in such a way that they end up in a specific place at a specific time in the future.

In this case, Mary knows everything about 'Red'. This means she can predict what happens when something red interacts with something else. If she also knows everything about 'Mary', she can predict her own surprise at seeing something red. She can choose actions that make her come in contact with something red in the future. She can then still feel surprised at experiencing red.


The thought experiment simply contradicts itself.

The premise is that Mary knows everything there is to know about colour vision. If this is true, then she knows what it is like to see colour.

If she doesn't know that, then the premise is false.

It's just nonsense.


While I generally think Mary's room doesn't prove anything, it's not strictly nonsense as a thought experiment, it only seems like nonsense if you already assume that everything can be described by a physical theory. Then of course vision and feelings and all of our experiences must be physical. The point of Mary's room is to test the plausibility of this assertion.

It seems very implausible to many people that anyone studying physics, biology and anatomy for any length of time in a black and white room would ever truly understand the experience of colour. Or as another example, do you think studying physics for any length of time will yield an understanding of what it's like to ride a thrilling rollercoaster or sky dive? Doesn't it seem somewhat plausible that such descriptions wouldn't be able to capture something about those experiences?

There are a number of possible responses to such challenges. One is to say that experiencing redness is not actually knowledge but an ability, so no amount of factual study will yield competency, only exposure will (like riding a bike).

Another is as you sort of implicitly assert, is that the very question assumes a kind of infinite knowledge, which humans are terrible at reasoning about. Mary would be able to describe what she'd say in response to any question about colour, but she wouldn't actually understand her answers? This is the kind of paradox that hints at a poorly formed question.

There are plenty more, but the point is that there's something interesting being discussed here, and we're not yet sure what it is, so the thought experiment currently only serves to identify what camp you belong to, ie. strict physicalists, or dualists, or epiphenomenalists, etc.


That's literally the point of the thought experiment. Thought experiments are mostly nonsense, the point is to help differentiate different phenomenon through extreme, contrived examples. The point here is that despite knowing the entirety of the corpus of knowledge about colour vision, she still doesn't know everything that there is to know about it if she hasn't actually experienced seeing the colour red.


> The point here is that despite knowing the entirety of the corpus of knowledge about colour vision, she still doesn't know everything that there is to know about it if she hasn't actually experienced seeing the colour red.

But that isn't the point being made in the article. The point being made is that this is somehow non-physical, which is obviously wrong:

Thus, argues Jackson, Mary has come to know a non-physical fact; so proving that not all knowledge is physical.


This contradiction is literally being discussed in the article!


Jackson's thought experiment is exactly like the proof that x = y leads to 1 = 0[1], in that the conclusion doesn't follow from the premise.

So how is it a useful basis for any arguments? If the argument is flawed, how can there be any contradiction?

[1]: https://math.hmc.edu/funfacts/one-equals-zero/


I have a take that I'm torn on about whether it misses the point/is covered by one of the arguments presented in the article, or makes sense -

It seems to me that one can know about all the physical properties of color before having experienced it, and still not have any expectations of knowing what their perception of seeing a given color would be like. Those are two different knowledge domains which are relevant to us, but which have no real importance in a "universal truth" sense.

Imagine we were talking about red with an individual of an alien species which doesn't have eyes or other light sensing organs, but is technologically advanced enough to know about photons and the physical properties of light and use them in their navigation systems (maybe not unlike we understand something about radiation without being able to feel it). We'd agree on the existence of the "red" wavelength, and we'd agree that certain surfaces reflect it and certain bodies emit it. But it'd be rather futile to try to explain seeing the color red to the alien even if we could, because it's irrelevant to them; it's just some being's perception of a physical quantity, a delta in the chemical balance of our brain soup. To them it's no more special than the feeling of hunger, a crude reflex which evolved so our bodies could tell us we need sustenance. Importantly, there's nothing of practical value about color itself that they could learn from the discussion. In that sense, does Mary really learn something new about color, or does she just learn about her own perception of it? Are those two things really related?


> Those are two different knowledge domains

This is a circular argument: you are arguing that physicalism is not true by assuming that physicalism (which asserts that there is only one knowledge domain) is not true.

According to a physicalist, perception is a physical process. So are knowing and experiencing and "what it is like". So to a physicalist, someone who, like Mary in the thought experiment, is stipulated to have complete knowledge of all of the physical facts will know "what it is like" to have any perception, because that is part of the physical facts. The only difference is that Mary, before she is released from the room, knows what it is like to see red by a process of deduction--by looking at what physical facts, among those she knows, correspond to her seeing red--instead of by the more usual process of having her retina and optic nerve stimulated in a particular way.

To put it another way, Mary, unlike you and me, knows what it is like to see red by imagining it, based on her complete knowledge of all the physical facts. That complete knowledge allows her to put her brain into any state she likes, even in the absence of the external stimuli that would normally be present. Sure, this is farfetched, but so is the premise that Mary has complete knowledge of all the physical facts. But if you grant the premise, you are granting Mary the powers she needs to do the thing that Jackson incorrectly claims she cannot do.

> But it'd be rather futile to try to explain seeing the color red to the alien even if we could, because it's irrelevant to them

First, seeing red is obviously not irrelevant to Mary, so this argument says nothing about Mary.

But second, if the alien has complete knowledge of all the physical facts about human brains, bodies, etc., then seeing the color red is not irrelevant to the alien, because seeing the color red is part of the physical facts that the alien knows. In other words, this hypothetical alien knows things that any "normal" alien would not know, and that changes what is "relevant" to this alien.


I think you are absolutely right, but the reasoning behind these thought experiments are such that we can understand consciousness, and what it means “to perceive” something.

So in your example, we may recognize these aliens as conscious beings, but how do we know that? They do not experience the world in the same way we do, and yet they clearly must have something in common with us to produce a conscious being.

The argument proposed by physicalists says that there must be some new state inherent to the apple that registers in our brain as “red apple”. But what is the likelihood that all humans even produce the exact same state in the brain for the same item? Or in your aliens, that can’t even see the color? The non-physicalist argument is that the experience of seeing that apple is unique to each one of us, and emerges uniquely for every brain. That state of the brain that we “learn” upon seeing a red apple for the first time is unknowable to others, yet is a core part of the conscious experience… thus, non-physicalists believe we may never truly understand how consciousness works. In other words, even if we may recognize these aliens as conscious, we may never be able to explain how we know… since we can’t define how it arises.

(This is my interpretation of the argument—not guaranteed to be correct)


> The argument proposed by physicalists says that there must be some new state inherent to the apple that registers in our brain as “red apple”.

No, it doesn't. Physicalism does not require that the exact same brain state must accompany a particular perception, either in different humans, or in the same human at different times. All it requires is that perception is a physical process.

> The non-physicalist argument is that the experience of seeing that apple is unique to each one of us, and emerges uniquely for every brain.

And the physicalist's response is that even if this is true, it does not refute physicalism. Perception can be a physical process and still satisfy these statements.


Thanks for the clarification! I find this topic fascinating, but am definitely still learning it.

My impression was that the underlying assumption (or at least, the end goal) of the physicalist interpretation is that this physical process can ultimately be used to predict how consciousness arises. But if there is no expectation of similar patterns across individuals, I would imagine the usefulness in that sense is limited. So, perhaps this isn't an end goal of physicalism.

In which case, perhaps neither party expects there to be a solution to the origins of consciousness, maybe!


> My impression was that the underlying assumption (or at least, the end goal) of the physicalist interpretation is that this physical process can ultimately be used to predict how consciousness arises.

This is the hope of many physicalists, but it is not required for physicalism to be true.


The experiment is flawed in that “Mary knows something new” is very loosely defined. We know new things constantly, to begin with. Our neurons change continuously.

As an example- She’ll immediately have a new memory: “I saw the color red for the first time”. Does that count? What about the emotions she might have felt? Elated. Disappointed. Does that count?

You are “knowing new things” just by reading these words.

There’s also the fact we don’t need a thought experiment for this one. There are rare cases where people have been able to gain sight or hearing via operations or devices. Ask them directly! All of them will say that they had many new thoughts when this happened.

That doesn’t imply that qualia exists at all though:

> she has gained a non-physical fact

She now knows how it feels to see the color red. I don’t think that disqualifies this as a “physical fact”. It could be that the subjective experience can be explained in physical terms, but we humans just not have figured it out. In that case Mary would not have that on her notes, would her? After all, this is a complex problem, I don’t expect conscience to be easily explainable in 2 or 3 lines, the same way that “how does the Linux kernel work?” can’t.


It seems that people who were born blind dream in visual images[1]. So certainly Mary had experienced colors in her dreams.

[1] https://www.wtamu.edu/~cbaird/sq/2020/02/11/do-blind-people-...


I've had a handful of arguments w/ smart people about Mary's room lately.

The conclusion I've come to is that the disagreement typically rests on how you define "knowledge." To many, "what the color blue looks like" does not constitute knowledge, because it doesn't enable you to make any additional quantitative statements beyond what you would know from an objective study of color/light. But in common usage, we say things like "I know what that feels like," meaning "I've felt that before." In the end, this is just a semantic disagreement.

But there are still philosophers like Dennett who take an even harder position, saying that functional knowledge is identical to experiential knowledge. I still can't quite wrap my head around this idea.


To me, the knowledge about the qualia of some color is just knowledge about (some distilled form of) how you process the perception of that color internally, which may be slightly different for different people, and which is not directly observable (with today’s technology). There’s nothing particularly surprising about it, nor does it contradict a naturalist/physicalist view.

Those who claim that functional knowledge is identical to experiential knowledge probably classify the internal processing of the brain as functional, and therefore classify knowledge derived from it as, fundamentally, functional knowledge.


>But there are still philosophers like Dennett who take an even harder position, saying that functional knowledge is identical to experiential knowledge.

If you deny the existence of consciousness or qualia then you are making that claim. Strict physicalists all are committed to that claim.


Is this another ill-conceived argument for the existence of classical Christian metaphysics? They'd have a much easier time concealing the bias if they didn't construct it exclusively from the themes of genesis... Woman... Knowledge... Apples... Who forgot to bring the snake?


I suspect this is entirely in jest, but one can never be sure.


Well, seeing some new color for the first time will cause some sensory input signals to become active which have never been active before, and that will cause some neurons patterns to emerge which have not been there yet, and this will surely have influence, e.g. synaptic plasticity, i.e. in other words the brain has learned.

But then, the brain also learns basically all the time. It's constantly changing. It is not something static.

But is that really the question?


what happens between neuron patterns emerging and me experiencing red, well, being red, instead of let's say blue for the same sensory input? where is the mapping, or are we all seeing totally different colors? even so, where does this information about the quality of this color come from.


The 'color' you experience is meaningless in itself. The feeling behind it is what's important and we see that it is often shared between social groups, but can vary between different social groups.

Why?

To keep you alive. If we associate red with danger, it doesn't matter if we experience the same color in our minds as long as our group associates the same physical wavelength.

The same goes for color experiences with much longer payouts. If you need to collect the yellow berries to survive the winter then having a qualia of enjoyment may increase our ability to survive.


Thanks for answering, but it seems like a utilitarian cop out, hand waving the problem aside. To keep me alive I just need to react to the physical wavelength, the internal experience isn't really necessary, sort of like reflexes. A robot can just as well be trained to react to red wavelengths detected by some sensor, but it doesn't have an internal experience of that color. I don't think it's meaningless.


So again, we're asking the wrong question. If you want your robot to 'experience' the color red, you must first train your robot to not want to die more than anything else while also putting limitations/imperatives on it that it must keep doing things to survive in the meantime.


This "thought experiment" is pointless. We might as well debate the mechanics of Harry Potter's magic spells.

> she grew up entirely in a black and white room, she has never actually seen any colours.

White is all colors, or in other words, there is no colour "white", the subjective experience of it is an illusion caused by perceiving multiple frequencies of light simultaneously.

This human guinea pig raised in a black and white room will have been seeing red, and green and blue, all her life. In fact the "whiter" the room the more frequencies of light she must be experiencing.

When she finally sees an apple there is no new information at all, in fact, she is seeing a kind of shadow. It's the absence of other colours that makes the red noticeable.


What if it was a green, yellow, or pink apple, or an apple painted violet? She would also need someone to tell her the common name of the new visual sensation she experienced. In any case, it is just another phenomenon in the bucket of 'being Mary'.


> She would also need someone to tell her the common name of the new visual sensation she experienced.

No, she doesn't. She has complete knowledge of all the physical facts. That includes complete knowledge of what patterns of sound waves are used by humans to name visual sensations, since those are physical facts.


I understand the experiment could be reframed to fix this "bug", but it's flawed: when Mary sees a red apple for the first time, some optical/neural pathways get excited that weren't before. She knew everything there was to know about the color red, but a specific physical experience was missing (physical, with observable physical changes that can be physically measured).

So this isn't about metaphysics or anything. Had Mary stimulated her optic nerve with an electric current to simulate a red apple, we'd be closer to the intended message of this thought experiment (and I'd argue in that case that a physical apple and a simulated one are indistinguishable).


> when Mary sees a red apple for the first time, some optical/neural pathways get excited that weren't before

Not necessarily. By hypothesis, Mary has complete knowledge of all the physical facts. That includes the knowledge of how to cause her optical/neural pathways to be excited in the particular way that corresponds to "seeing red" even without the corresponding external stimuli being present. So she could have caused herself to see red. (We might describe this in more conventional language as Mary imagining seeing red, and her complete knowledge of all physical facts giving her powers of imagination far in excess of those of ordinary humans.)


> That includes the knowledge of how to cause her optical/neural pathways to be excited in the particular way that corresponds to "seeing red" even without the corresponding external stimuli being present.

Yes, Mary would have the knowledge of how to perform surgery on herself to stimulate her brain or optic nerves in the right way to generate the necessary experience. I don't think that's within bounds of the thought experiment though.

The thought experiment is testing our intuition about whether third-party objective facts, as found in science, can suffice to describe even subjective experiences like redness. If you need to actually stimulate the experience to gain that understanding, then that either proves that third-party objective facts are not sufficient, or it proves that such experiences are not knowledge.

That's one standard response: knowledge and ability are not equivalent. Someone who had their legs amputated ostensibly knows how to walk but lacks the ability to do so. In principle, no amount of knowledge by itself will make you walk, but knowledge can give you back the ability to walk, ie. a gene therapy with stem cells to grow back limbs, prosthetics, etc.

So the idea is that experiencing redness is not knowledge but an ability you acquire by exposure to colours: https://en.wikipedia.org/wiki/Knowledge_argument#Ability_hyp...


> I don't think that's within bounds of the thought experiment though.

Why not? The point of the thought experiment is supposed to be to prove that Mary learns something she didn't know before when she sees the apple. But if the premises of the thought experiment give her the ability to give herself that knowledge beforehand, that undermines the conclusion.

> The thought experiment is testing our intuition about whether third-party objective facts, as found in science, can suffice to describe even subjective experiences like redness.

No, it's not. It's claiming to prove that subjective experience cannot be physical, i.e., that physicalism is false. It is making use of a common intuition that subjective experiences are fundamentally different from "third-party objective facts" (Dennett calls it an "intuition pump" for this reason), but that is not a proof of anything, it's just a circular argument, assuming what it purports to prove.

> If you need to actually stimulate the experience to gain that understanding, then that either proves that third-party objective facts are not sufficient, or it proves that such experiences are not knowledge.

Neither one of these refutes physicalism, however, since the process of giving yourself the required stimulus based on your knowledge is a physical process--at least, there is nothing in the premises of the thought experiment that rules that out.


> But if the premises of the thought experiment give her the ability to give herself that knowledge beforehand, that undermines the conclusion.

No it doesn't, it's called the Knowledge Argument because the knowledge of redness purportedly does not deductively follow from the knowledge of any amount of physical facts. It requires non-deductive steps, like surgery and brain stimulation in this case.

You might as well say that Mary could construct a red LED and gain the knowledge of redness that way, because that too is a physical process. That's obviously out of bounds, and surgery is the same type of invalid move.

Edit:

> Neither one of these refutes physicalism, however, since the process of giving yourself the required stimulus based on your knowledge is a physical process--at least, there is nothing in the premises of the thought experiment that rules that out.

Under dualism, physical processes are correlated with non-physical qualia, so triggering the physical process in a roundabout way is not a valid move here. The question being tested is whether knowledge of redness follows from knowledge of all other physical facts, not whether knowledge of redness follows from triggering a physical process because we already know that does.


> the knowledge of redness purportedly does not deductively follow from the knowledge of any amount of physical facts.

Which is just a bare assertion, not an argument. Nothing in the premises of Jackson's thought experiment entails this or requires it. To a physicalist, knowledge of redness is knowledge of a physical fact, so this statement is simply false.

> surgery is the same type of invalid move

If you're hung up on the word "surgery", then eliminate it: it's just as possible that Mary could simply imagine, based on her complete knowledge of all physical facts, what it would be like for her to see red, without having to do any surgery at all. You might say this is implausible, but so is the premise that Mary has complete knowledge of all physical facts. But that's the premise of the thought experiment.

> Under dualism

Jackson's thought experiment does not prove that dualism must be true. Nor can you assume that dualism is true as a premise, since that is just a circular argument. A physicalist, like me, simply does not think dualism is true, and it is no argument against that to show what would be the case if dualism were true. You need to argue, from premises that don't already contain dualism, that dualism must be true. Jackson didn't do that. Nor do any of the other arguments described in the article, including the Knowledge Argument.


You're not telling me anything I don't already know about physicalism or Mary's room. What's in dispute here is whether any physical action is a legitimate answer to the Knowledge Argument, so I'm going to ignore the rest and focus on this disagreement:

"Imagining" is not the same as surgery. Do you agree or disagree that Mary constructing a red LED to experience redness is not a legitimate response to the Knowledge Argument?


> Do you agree or disagree that Mary constructing a red LED to experience redness is not a legitimate response to the Knowledge Argument?

It depends on what you think the Knowledge Argument is supposed to prove.

If you think the Knowledge Argument is supposed to prove that physicalism is false, then I disagree. To refute physicalism, it is pointless to say that some physical processes are not "knowledge". Even if the physicalist agrees, that in no way refutes physicalism. The physicalist simply says that the processes that Mary induces in her brain by constructing a red LED (or doing surgery on her optic nerve, or just imagining what seeing red would be like), even if they are not "knowledge", are still physical processes, and that those physical processes are Mary's experience of seeing red. Nothing in the Knowledge Argument refutes that.

If you think the Knowledge Argument is supposed to prove that there are physical things that aren't "knowledge" (whether or not there are also non physical things is then a separate question), then I neither agree nor disagree as a matter of physics, since what we use the word "knowledge" to refer to is a matter of definitions of words, not physics. I have no problem with accepting your definition of the word "knowledge" for purposes of this discussion. I just don't think accepting that definition says anything about whether or not physicalism is true.


> The physicalist simply says that the processes that Mary induces in her brain by constructing a red LED (or doing surgery on her optic nerve, or just imagining what seeing red would be like), even if they are not "knowledge", are still physical processes

This isn't relevant. Nobody is really disputing that physical processes cause qualia. You don't see the redness of an apple until the apple actually enters your visual field. Cause=physical event, result=qualia. Even dualists agree with this.

Therefore the Knowledge Argument is not about whether any physical process is causally linked to qualia, it's specifically about whether qualia can be deduced only from factual knowledge, because under physicalism, all facts are physical facts.

If physicalism is true, then all facts are third-party objective physical facts. Therefore quale are physical facts. If given an understanding of all physical facts, then Mary should be able to deduce her quale. If she cannot deduce her quale (or it seems very implausible), then either some mistake has been made or physicalism is false. Where is the mistake?

You cannot answer this question by saying her knowledge gives her the ability to trigger the usual physical process to cause qualia, because the question is about the deduction. The only outcomes of this thought experiment are one of: 1. denying that physicalism is true, or 2. denying that quale are facts, 3. accepting that Mary would be able to deduce her quale, 4. concluding that the thought experiment contains some inherent contradiction.


If Mary had (and had the capacity to conpletely analyze) all data on all physical processes in the universe, she could deduce her, and all other, qualia.


Sure, that's one opinion, but that's not a proof.


> that's one opinion

No, it's not, it's part of the explicit premise of the thought experiment.


That Mary has all factual knowledge is a premise, the conclusion that she could deduce her qualia does not necessarily follow, and you have provided no proof demonstrating that it follows


> That Mary has all factual knowledge is a premise, the conclusion that she could deduce her qualia does not necessarily follow

It's not a conclusion; to a physicalist, it's part of the premise, since knowledge of her qualia is "factual knowledge". You can't just declare by fiat that this is false; that's a circular argument, as I have already said multiple times.

> you have provided no proof

The burden of proof is on you, not me; if you want to make an argument based on the claim that knowledge of qualia is not "factual knowledge", then you have to prove that it isn't. You can't just declare it by fiat.

I understand that non-physicalists, like you and Jackson, believe that knowledge of qualia is not "factual knowledge". But physicalists, like me and Dennett, disagree. Given that disagreement, you can't make your belief a premise of an argument and expect me to accept it. All you're doing is restating your position. Fine, I understand that's your position. But it's not the same as giving an actual argument for it based on premises that I must accept.


> The only outcomes of this thought experiment are one of: 1. denying that physicalism is true, or 2. denying that quale are facts, 3. accepting that Mary would be able to deduce her quale, 4. concluding that the thought experiment contains some inherent contradiction.

No, you left out one:

5. Denying that there is any difference, from the standpoint of testing whether physicalism is true or false, between Mary "deducing" her quale and Mary "triggering" her quale with a red LED or surgery or by imagining.

Basically you are trying to make an argument by redefining words to make arbitrary distinctions that don't have any bearing on whether physicalism is true or false. First you want to limit what Mary has to "knowledge", but nothing in physicalism requires all physical things to be "knowledge" or requires that all physical things must be reachable from "knowledge". Then you want to limit Mary to only having "factual knowledge", but nothing in physicalism requires all physical things to be "factual knowledge" or to be reachable from "factual knowledge". Then you want to limit Mary to only having "third-party objective physical facts", but nothing in physicalism requires that all physical things are "third-party objective physical facts". Then you want to limit Mary to only be able to "deduce" her quale instead of triggering it or imagining it, but nothing in physicalism requires someone to have to "deduce" their quale in order to know what it is like without having been subjected to the normal external stimulus (in this case the image of a red apple on Mary's retina) that would trigger it. Physicalism simply does not make or require any of these distinctions you keep making.

The claim of physicalism is simple: Mary's quale "seeing red" is a physical thing. (Or "process", or "fact", or whatever you want to call it; the substance of the claim remains the same.) The only way to disprove that would be to show that her quale being a physical thing somehow leads to a contradiction. The Knowledge Argument does not do that. It does not even claim to do that. It simply constructs a straw man version of "physicalism" that is vulnerable to refutation by this particular argument even though actual physicalism is not.

When you look at what physicalism actually says, the so-called Knowledge Argument boils down to a bare assertion. The premise is that Mary has all the physical information. The claim is that she learns something when she sees the red apple, implying that she did not have the information about what it would be like to see the apple beforehand, when she had all the physical information. But the claim simply does not follow from the premise; it is a non sequitur. The only way to get to the claim from the premise is to add an additional premise that having all the physical information does not include having the information about what it is like to see the red apple. But of course that is just arguing in a circle; it is simply assuming that physicalism is false in order to "prove" that physicalism is false.

The whole point of physicalism is that having all the physical information is having all the information, so it includes knowing what it is like to see red, to taste wine, to feel the sun shining on you, etc., etc., etc.. So any thought experiment that claims that Mary, who has all the physical information, will learn something when she sees the red apple is simply based on a false premise according to physicalism. Which makes it obvious that no such argument can refute physicalism.


> Basically you are trying to make an argument by redefining words to make arbitrary distinctions that don't have any bearing on whether physicalism is true or false.

No, this is a well studied problem by thousands of philosophers over 40 years. Maybe reconsider your position that you understand this argument better than they do. I don't see any benefit in continuing this discussion at this point.


> No, this is a well studied problem by thousands of philosophers over 40 years. Maybe reconsider your position that you understand this argument better than they do.

Ah, the old argument from authority. Sorry, not buying it.

> I don't see any benefit in continuing this discussion at this point.

Neither do I.


> That includes the knowledge of how to cause her optical/neural pathways to be excited in the particular way that corresponds to "seeing red" even without the corresponding external stimuli being present.

Having knowledge and actually doing it are trivially different things (try sex: knowledge of sex and doing the deed are vastly different things).

Now, if she exercises her knowledge by stimulating her optic nerves, that's the same as seeing the apple. But that's not just "reading about it", it's a physical act of doing!


> Having knowledge and actually doing it are trivially different things

This is a circular argument. You are arguing that Mary does not know what it is like to see red by assuming that she does not know what it is like to see red.

> if she exercises her knowledge by stimulating her optic nerves

Which, since she has complete knowledge of all physical facts, she can do. The thought experiment does not say she "reads about" color vision. It says she has complete knowledge of all physical facts. The article referenced here does not do a good job of describing Jackson's actual thought experiment, but Jackson's actual thought experiment is based on the (extremely strong and unrealistic) premise I have just stated. It has to be, because any weaker premise cannot possibly ground a conclusion that Mary learns something non-physical when she sees the apple. Just saying that Mary knows everything that can be learned by reading about things is not enough; there are many physical facts that cannot be learned by reading.


It's not circular reasoning: it's a rejection of the premise which I can easily dispute: knowing everything there is to know about sex without actually practicing it is not the same as having sex. If someone subjected a brain in a vat with electrical stimulation to make it believe it's having sex (with phantom body parts it doesn't actually possess), then that is indistinguishable from actual sex -- but note how the postulation of the actual Mary experiment steers clear of actually asserting this, and instead claims she "learns the physical properties" of seeing colors.

I realize Jackson is a professor and I'm not, and that this is a well known thought experiment, but I deem it so obviously invalid -- or rather, based on false premises -- that it's not worth considering.

Of course I'm basing my opinion on TFA, but reading Wikipedia's summary I see other philosophers have poked holes on this experiment and even agree with me the premises are false.

P.S. defining "knowing everything there is to know" the same as "physically experiencing" is circular reasoning, and I definitely disagree with this premise.


> knowing everything there is to know about sex without actually practicing it is not the same as having sex.

Your premise only seems plausible as you state it because you are not actually considering the implications of knowing everything there is to know about sex. But knowing everything there is to know about sex includes knowing what it is like to have sex. So the real premise you should be stating is that it is not possible to know everything there is to know about sex if you have not actually had sex.

And, as you appear to realize, making the appropriate adjustment in how the premise of Jackson's Mary thought experiment is interpreted makes it obvious that the argument is invalid--and I agree that it is.


Ah, thanks for the explanation. Yes, reading this answer and also your more elaborate reply to another commenter, I think I agree.


I absolutely have a problem with considering "imagining" (especially something you've never experienced before) the same as "experiencing". I'm sorry, but giving Mary such superpowers completely invalidates the experiment for me.

It sounds too much of the old Maths joke: "let's consider a spherical cow."


> giving Mary such superpowers completely invalidates the experiment for me

This complaint should be addressed, not to me, but to Jackson, whose premise for the thought experiment gives Mary such "superpowers". I agree that such a premise is completely unrealistic and invalidates the thought experiment. Unfortunately many philosophers do not appear to have gotten the memo.


What is your point? The article puts forward this point too among many other counterpoints.


I think I explained my point, why do you ask?

But to summarize for you: it's not true that Mary "knew all" just by reading about the color red. The premise is false. She lacked one bit of information: to have her optic nerve stimulated by a red apple. Note this isn't metaphysical, it's physical; such stimulation can be physically measured and she lacked this experience, which -- to emphasize the point -- is entirely physical.

Again, I think the thought experiment can be probably reframed in order to fix this flaw, but Mary and her red apple as currently stated are not convincing of any duality.


I am trying to understand what point you are trying to express that is not already very well expressed in the article. Or are you repeating one of the several counterpoints mentioned in the article? If so why is this one counterpoint more important than the other counterpoints made in the article?


The point here is that the argument is not internally consistent.

If Mary knows everything there is to know about colour vision, that includes knowing the experience of seeing the colour red.

If she doesn't know that, it simply contradicts the premise.


Once again, all of this, including what you just said in this comment is already discussed in the article!


I find your comment puzzling. So your objection is that we cannot restate or emphasize the opinion that this thought experiment is flawed?

If so, duly noted.


Right. It's very similar to Bishop Berkeley's argument for idealism, in that the thought experiment doesn't make sense unless you assume a priori that physicalism is false.


"consciousness is all about the brain; or more specifically, it is identical to the brain"

That's easy to disprove with the computer analogy. If transistors are simplified neurons and CPU chips are brains, then software is consciousness. Just like software is an immaterial something that uses magnetic medium to run on CPU, human consciousness is immaterial something that uses magnetic medium to run on neurons. Mind is parricularly fast type of hardware, an equivalent of GPU, that runs imaginary experiments. One thing that's certain is that software doesn't emerge from transistors and barely can it be understood by inspecting those transistors.

When Mary sees a red apple for the first time, her mind records the relationship between "red" and "apple", while her consciousness registers the new waveform produces by red receptors in her eyes. The richness of this waveform is limited by her eyes, whether they capture basic redness or the entire spectrum, and by her conscioussness that may or may not be able to register waveform of such complexity. She gets to experience a surprise because she hasn't seen such waveform before, and her mind will put the red color into its proper place by recording relationships between observed objects.

Mary can know what it's like to be a bat because bat's consciousness is much simpler: any waveform that can exist in the bat's consciousness can also exist in Mary's consciousness. The reverse isn't true.


You can learn all the biochemistry about a strawberry, but actually _tasting_ one is going to be a new experience. I don't see any need to bring in metaphysics to explain this (in fact, doing so indicates a confusion of ideas to me).

When we describe sensory experiences to one another, we usually do so in comparisons. "It tastes like chicken." "They look like little blue bananas." "It smells like almonds and paint thinner."

Of course there will be a gap in understanding if Mary has never tasted chicken, seen the color blue, or smelled paint thinner.

> ...despite having previously learnt all the physical facts about colour vision...

Well, we _could_ simply include scratch-and-sniff in our physics books...

If Mary never actually had examples of the different colors, then she wouldn't know how to recognize a color when she eventually saw one. But that's because she (and pretty much everyone else) can't synthesize accurate sensory simulations given information like frequencies or wavelengths.

One could imagine a machine that could take the physical description of a color, taste, smell, and stimulate Mary's brain to simulate a sensory experience. No metaphysics necessary.


Seeing color(qualia) does not provide any additional information. They are just a tool your brain uses to speed up processing. Treat is as quick tagging system. It's done inside your head, we don't even know if all people tag colors in the same was(is your red, my red?). Qualia are derived information. Your senses get information, and you get some processed result. There is nothing added(beyond what your mind may add, but that's not part of the original information). You could swap red for green, green for blue and nothing changes. Imagine a wall of text, a very big one. To read it you have to carefully go line by line, focused on the content. It takes a lot of time to do. But now imagine you evolved to read such text walls. Now it's not hard, because nature developed special structures to process them, and now you have dedicated, and optimized region in the brain to handle them. You just glance at that massive text and "see" all the content, it sings to you, you understand it instantly, maybe even feel parts of it. And seeing is the same. The mass of color information hitting our eye, that for someone without innate ability to process it would look like a bunch of hard to plow through data, for us is just instant. We process multiple frames per second, detect objects, project movements. All of it without even thinking about it. Incredible. All thanks to specialised machinery in our brains. The specialized part does the heavy lifting so we can see our qualia. But it's just a tool, it does not provide additional objective information, as it's only your subjective view of the information that other parts of the brain push to you. It's processed information, enriched, but because of that, it's subjective now.


Is derived information not distinct from the input? I mean, tagged information tells you about the tagging system in addition to the tagged information.

Specifically, it tells you how the tagging system interacts with the tagged information.

In this case, from a physicalist perspective, seeing red tells Mary how her specific brain (or whatever physical system explains color sight experiences) interacts with the experienceable subject "red", be it red light or whatever choice you make for the "true" subject for the sake of the thought experiment.

The ordinary discussion of the thought experiment simply assumes she can somehow already know this without experiencing it, and hand-waves away concerns about whether she could obtain that knowledge without having the experience (she is a brilliant neuroscientist, after all).

My position is that this is precisely the new information she obtains from seeing the apple.

The minimum value from a finite list of integers is derived from the list, but until you compute it (the analog of "seeing the apple"), you don't know the minimum. Even if you "know all the integers in the list" otherwise.

Edit: typo


Can words and word structure capture all ideas?

(I'm using 'words' in a very broad sense as packets of information that can be communicated sequentially).

It's a broader and easier to answer question that covers this specific case.

Another interesting question is, are there disjoint sets of words and word structure (meaning that they cannot be 'transpiled' 1:1 into one another) that can describe and predict physical phenomena just as accurately as another? Particularly the set of words and word structure that we've come up with so far as a species?

Some recent experiments seem to suggest, yes, there are combinations of variables that can fully characterize certain physical phenomena that cannot be translated into our current understanding. This means there can be parallel and equally valid and precise models of reality.

https://www.nature.com/articles/s43588-022-00281-6.epdf?shar...


What is a color image? An RGB image of pixels. Put another way, three images with red, blue and green filters.

If Mary could only see black and white, reading every book about color would not give her the experience of red. Like a child could read every book on cycling, but not know how to ride a bicycle.

However if Mary could interface a color camera to her visual cortex, she would experience red over time. She could add a bigger spectrum of infra red and ultraviolet and be able to experience more than a normal human being.

Similarly for cycling, if someone had VR goggles, and could simulate forces on their body, they would learn how to ride a bicycle.

Words and writing are a highly compressed version of shared experiences. When we read "red apple fell from the tree", our minds are creating simulations of apple, tree, falling symbols from the raw experiences we've perceived.

To understand an "apple" we have to see many different kinds of apples, taste them, touch them, feel their texture and weight, smell them, the sound when we bite them. All of that is compounded into the symbol "Apple". But we also disambiguate the internal symbol {apple} from the fruit Apple and company Apple.


This thought experiment is a wonderful demonstration of the limitations of thought experiments in philosophy.

The premise of a thought experiment used in this way is that the truth of the matter is ultimately to be found in your intuition. One just needs to properly ingest the experimental setup, and the right conclusion will lay itself bare.

This experiment is as absurd as the Chinese room experiment. You will be told that you have only properly understood the experiment's setup if you accept that Mary can somehow have learned all physical facts about a chosen color without experiencing seeing the color. It begs the question, because it explicitly claims that knowledge obtainable only through experience is "not physical" (Mary somehow "knows" all physical information about the color before experiencing it). "But wait, if experiencing red added new information, then experiencing red must not be physical, because... we assumed experiencing red is not physical."

edit: left out a space


The Chinese room experiment is less absurd than the existence of consciousness though.


No it isn't.


I have been very interested in Buddhist non-dualism recently. Although the philosophical implications are very profound assuming that is true, but I don't.

For me consciousness clearly emerges from our physical body and not the other way around. However, I admit that is fascinating and learning about how self-identification can lead to suffering is eye (mind?) opening.


I’m fully in the physicalist camp. I think this is a flawed thought experiment because humans are incapable of knowing everything about seeing red until they actually experience it. Here’s what it’d like be if we actually could without experience:

Suppose you take a perfect snapshot and learn the exact position of all atoms in a persons brain after they see a red apple. Now imagine that humans have the ability to move all the atoms in our brain to be in those exact same positions, at will. So without the red photo receptors in your eye actually detecting anything red, you can make yourself see red apples at anytime. Mary could do this even before ever actually seeing red or even when seeing something that’s reflecting a completely different color to her eyes.

Since we don’t have this magical ability, having an understanding of all the underlying physics and biochemistry of color perception does not really provide everything there is to know about seeing red.


My current understanding of recognition (I think it was pulled from a Kurzweil book I read recently, so grain of salt etc) is that humans have on average 150k recognizer circuits[1], which are long columns that permeate a few layers of our brain. Signals come in from various sensory inputs, and it lights up some subset of recognizer circuits, and that data is then passed on to other parts of the brain to analyze the context. Every letter of the alphabet, and every word you use regularly, and every object you see, has a handful of associated recognizer circuits which will trigger given the shape, smell, or the sound, etc. When one of these circuits goes unused for a while, it can be repurposed.

Personally, it kind of blows me away that we can function as well as we do while only being able to immediately recognize 150 thousand total concepts. It's such an easily comprehensible number, yet completely defines our perception of reality.

If Mary had never seen the color red, so no matter how hard she studies, her brain will not have the circuit capable of recognizing the color red, simply because that particular signal has never entered her brain. She might be able to acquire it later though. Colorblind people get the protein injection that allows them to see the third color, my understanding is that it takes a few months[2] for it to take effect, which lines up well with my understanding that it would need to rewire a bunch of recognizer circuits through repeated exposures.

[1] https://numenta.com/neuroscience-research/cortical-columns/

[2] https://www.npr.org/2009/09/17/112897277/thanks-to-gene-ther...


>The ignorant are cocksure, while the wise are full of doubt.

If we assume our abilities are limited and finite, we can never be 100% sure of anything. However, we can be 90% confident of things based on: (a) Shared wisdom and learning (b) Scientific research and experiments. Philosophy of knowledge is a tool to get knowledge; it is not knowledge itself. Going back full circle, we believe our abilities are finite and limited. We believe we cannot know everything. We can only be confident based on our limited shared knowledge and scientific discoveries. We expect future knowledge to contradict old knowledge. Philosophy underpins or guides this quest for knowledge. Philosophy are fundamental assumptions or beliefs. e.g. Truth cannot contradict itself. If truth contradicts itself, it is our limited abilities that deceives us.


"Many black and white books and TV programmes have taught her all there is to know about colour vision. Mary knows facts like the structure of our eyes and the exact wavelengths of light that stimulate our retinas when we look at a light blue sky."

This is a serious hole in the argument. "All there is to know about color vision" is an abstraction---it's "about" color vision; it's not vision. The experience of color vision is a different set of data than wavelengths and eye structure.


A thought experiment seems to be exactly the opposite of an experiment: no experience there.

I understand the concept, but every time I see one of these, the most compelling points are for me the ones that show how the setup makes no sense at all because, for starters, there's no way to make a real experiment that's truly equivalent.

Edit-> please, think about this: can the "result" of any thought experiment be surprising, not what you expected?


> can the "result" of any thought experiment be surprising, not what you expected?

Isn't all of mathematics just thought experiments? No shortage of surprising results there.


That's not what thought experiment means.


Here's a thought experiment for you: consider the hypothesis that you're wrong.


> can the "result" of any thought experiment be surprising, not what you expected?

Isn't Schrödinger's cat the classic example of this? Physicists at the time typically thought of quantum effects (like superposition) as being confined to the microscopic realm. Schrödinger pointed out that if you take the principles of quantum theory as serious and objectively ontological, then you end up with macroscopic superpositions.


Why is the cat never assumed to be able to be an observer? Or the flask with poison?

I always assumed everybody understood "observer" to be shorthand for "some entity that irrevocably changes state because of the quantum events", but I'm starting to realize that lots of people, even the famous physicists responsible for the theories and experiments, may understand "observer" as "Human being, with a conciousness".

I'm just a layman with a layman's understanding of quantum shenannigans, but.... am I too far off here?


> some entity that irrevocably changes state because of the quantum events

Yes, "observer" is ambiguous at best.

One query with your proposed definition is: what do you mean by "irrevocable"? If you believe that the quantum state (wavefunction) is objective and independent - and does not collapse but evolves reversibly according to the Schrodinger equation - then nothing is irrevocable, it's just a technical challenge of "can we reverse the evolution of this patch of the universe". Yes, there is this decoherence process, but even that is reversible if you expand your "patch of the universe" sufficiently.

Not many famous physicists believe human consciousness is required for a physical quantum collapse process to occur. John Bell put it nicely:

> Was the wave function waiting to jump for thousands of millions of years until a single-celled living creature appeared? Or did it have to wait a little longer for some highly qualified measurer—with a PhD?

You might be interested to know that people have wondered about what happens if you replace the cat by something that is definitely an "observer": https://en.wikipedia.org/wiki/Wigner%27s_friend . Until the friend (F) tells Wigner (W) the outcome that he experienced when measuring a photon (P), then Wigner supposes that F is quantum entangled with P, i.e. they are in a joint superposition of states. However, the friend supposes that P is in a definite state.


And thanks for engaging with the question. Another problem I have with this is I never see this problems spelled out.

It's hard to tell, with such difficult subjects, the difference between "I don't know" and "Nobody knows".

On top of that, people like to pretend they know. And some other people do really believe they know even if they don't, just because they know a dictionary definition, or something.


> what do you mean by "irrevocable"?

Very good point, who knows! I guess whatever the universe can't pretend didn't happen, like a photon being absorbed and re-emited by an electron.

Which, what does that even mean? I don't know! Does anyone? I don't know!


The problem is that you can't know if the cat is dead or alive unless you open the box.

Schrödinger conceived the experiment to "show" that the premises lead to an absurd result: that the cat is dead and alive at the same time.

But now people either consider it plausible (in multiple universes or depending on observer) or try to explain how superposition is lost before it reaches macroscopic objects.


Right, I agree with everything you say. To me that means the thought experiment was extremely valuable, because it generated a great refinement of our ontological ideas.


It's funny because the author's idea was to discredit the notion altogether, so it's relevant because it failed to do that.

The core of Mary's adventures is a false dicotomy: that matter is the only component of physical reality. But processes, structure and energy flow are as real as matter. Actually, at a very small scale, matter seems to be exactly that.

So as usual with all these dualism "enigmas", the only problem is starting from an old perspective that doesn't play well with current knowledge.

Consciousness seems to be a complex physical process seen from inside itself. There's no mistery or toughness in that, except that we can't compare it with anything else.

We can't use the inside and ouside outlooks at the same time. But Wittgenstein already stated that more than a century ago.


But... none of this makes thought experiments any less helpful or valid. If anything, the fact that Schrodinger's cat achieved the opposite goal implies that it touched on hidden fundamentals in quantum theory.


> Edit-> please, think about this: can the "result" of any thought experiment be surprising, not what you expected?

The thought experiment is not to produce a new artefact that you would traditionally call "a result", like a table of subjects responses, or a histogram of responses, etc.

It's to make the researcher consider stuff that cannot be tested, but might be feasible.

> how the setup makes no sense at all because, for starters, there's no way to make a real experiment that's truly equivalent.

That's the whole point. If you can make a real experiment, then it's not a real thought-experiment, is it? The article actually addresses this:

> But this issue need not concern us, because philosophical thought experiments depend on logical coherence rather than practical feasibility.

IOW, it depends on the argument being logically sound, not practically proven.


I do know what a thought experiment is. What I'm trying to point is that they never are really useful because the very reason that makes them unpractical is the reason that make them invalid. That reason is often shadowed by other reasons, but it's the fundamental flaw.

You can turn that around: the differences between the reality and the alternate reality in which the "experiment" is possible are the key to the question.


> I do know what a thought experiment is. What I'm trying to point is that they never are really useful because the very reason that makes them unpractical is the reason that make them invalid. That reason is often shadowed by other reasons, but it's the fundamental flaw.

I understand, but ... you don't judge whether something is useful (or not) according to some arbitrary goal, you judge based on the specific goal intended.

In this case, the goal is "Does the process result in further lines of thought to exhaust, or further discussion?".

I mean, you wouldn't call a brain-storming session useless if it resulted in a conclusion of "no practical implementation is feasible at this time", would you?


All conclusions drawn from “imagine shining a flashlight on a train riding close to the speed of light” revolutionized physics, so the answer is a very clear YES.


That's absolutely not correct. There are real experiments to prove Special Relativity and it has been corroborated multiple times.

The train is only a way to explain it, not a thought experiment. Actually, some equivalent experiments to that are not just possible, but has been executed.


I don’t think you understand what a thought experiment is and that explains your confusion in this thread.


>please, think about this: can the "result" of any thought experiment be surprising, not what you expected?

Not necessarily for the framer of the experiment, but that's not the point - it's to get other people to think about a problem in a different way.


That's exactly the point: to frame the "experiment" in a way that only admits the viewpoint of the framer. The only value is to analize why it's impossible to make it a real experiment.


Mary would probably not be able to see that the apple was red.

Just like I can’t hear the difference between sounds in many Indian words Mary would not be able to differentiate colorized things from non colorized things. Her brain would have learnt to ignore the color signal that the eye provides. Just like my brain has learnt that the different sounds in Indian words is not worth processing.


I wonder if this experiment could be ran in real life today with EnChroma Color Blind Glasses and a cohort of color blind subjects.


It would be akin to a color blind person being able to pass the Ishihara test (color vision tests with the splotches and numbers), which the EnChroma glasses don't do.


A lot of these thought experiments are just semantic arguments in disguise.

We think we disagree about physicality of consciousness, but we're actually disagreeing about meaning of the word "all". She knows all there is to know about colors.

This might be a good linguistic discussion, but it's unlikely to move us anywhere on physicality of consciousness.


This does not seem a complicated question. No amount of words or verbal explanation can convey the full sense of qualia. You cannot describe the phenomenon of sight fully to a blind person. This seems more a limitation of language than consciousness. I mean... surely a pig sees just fine, but you cannot explain the physics of color to them.


> If we were to show Mary a blue banana instead, she would not be fooled; she would know that it had the wrong colour, argues Daniel Dennett, in what he coined the ‘blue banana trick’.

Why won't she be fooled? Is it because she already knows that a banana has a different color than the sky and she knows the sky is light blue?


> Why won't she be fooled?

Because she has complete knowledge of all physical facts. Dennett is a physicalist, and to a physicalist, perception and experience are physical processes. So Mary has complete knowledge of them. That includes complete knowledge of what she will experience in response to any physical stimulus.

> Is it because she already knows that a banana has a different color than the sky and she knows the sky is light blue?

That's one tiny piece of the physical facts that she knows, yes.


This paradox only shows that the definition of knowledge used to produce it was wrong.


Mary learns nothing and the physicalists are correct.

Since Mary knows everything about human physiology and physics, she is able to simulate a neural vision system within her own brain.


The experiment ask "Has Mary learnt anything new about the colour red upon seeing the colour for the first time?"

Yes, she has learned to detect red colour using her eyes.


I'm not sure if this experiment means anything. Consider a much more mundane(?) example: echolocation. Bats can "see" the world around them via ultrasound. Humans can research everything about how it works, including acoustics, physics, neurology, bat anatomy, you name it, but we will never experience it the way a bat does.

So... does that prove that human consciousness is non-physical?

...I'm sorry, what? That sounds like a complete non sequitur to me.

Which is exactly how I feel about the original argument.


It's sad to see so many people focusing on the color aspect of the experiment, completely ignoring the argument in the process.

Look at it this way - switch out "red" for "parental love" and then re-evaluate the argument.

Mary has read and currently knows everything there is to know about the bond a parent forms with their child[1].

And then Mary raises a child ...

[1] An adopted child would do - then there's no claim of biological hormones affecting the knowledge.


"Consciousness is what keeps philosophers awake at night."

Unless they're dyslexic, right?


Loved this. Thank you for sharing.


Another way to rephrase this is: Does the person who has read absolutely everything about love, know what it feels like to love? This thought experiment relies mostly on how fuzzy our understanding of consciousness is, and how vague our definitions of it are.

It confuses conscious 'knowing' and conscious 'seeing' (or 'feeling' in the love example), which are two different things. How can I state this confidently? Because we do have a wonderfully detailed computational model for consciousness, which explains a ton of data!

It's a real shame that it's largely ignored or unknown even in the field of neuroscience. I've written about this here: https://saigaddam.medium.com/understanding-consciousness-is-... As I mentioned there, I also co-authored a book (https://www.goodreads.com/book/show/58085266-journey-of-the-...) where we go into this theory in greater detail. Stephen Grossberg and his work really do deserve greater attention.

Most discussions of consciousness are frustratingly incomplete because they leave out a crucial aspect. Who is the “experiencer”, that is consciously “experiencing”? How is that "I" put together? Only a clear answer/theory that attempts to define and construct both the experience and experiencer will allow us to see through these cutesy philosophical constructs like Mary the color vision expert, philosophical zombies and more.

Here's a definition, based on the computational model I mentioned above, that makes a lot of sense.

Consciousness is the constellation of past experiences experiencing the present, assimilating it to act and prepare for future opportunities.*

So you are nothing but a bundle of experiences.

Each new experience, after it is had, is added to this bundle, and changes you. With that in mind, here's how Mary's experiences make sense. Mary could read everything there is about color vision, but all of these are just semantic experiences. They become a part of her. When the first visual experience happens -- when she actually sees red -- she has absolutely no visual experience to fall back on that explains this. Reading about it, does not in any way reconstruct the unique neural patterns going all the way from her retina to her inferotemporal cortex. The experience is utterly new, and as with all new experiences, it is memorable and retained and becomes part of her. That sadly, also means that all subsequent experiences of red are not as vivid, because they are now matched against what came before. (This invokes the idea of predictive inference; there are reasons to do this -- it is metabolically cheap to just classify and forget, rather than retain the full pattern.)

*-this definition of consciousness leaves out how an experience is constructed. To answer that very briefly, it is when the sensory data streaming in is matched locally and globally against past experiences and a broad agreement (a “resonance”) is achieved. This is obviously a very lossy summary. You can read this for article for a complete picture: https://www.sciencedirect.com/science/article/pii/S089360801...


> Does the person who has read absolutely everything about love, know what it feels like to love?

No, but Mary knows much more than that. By hypothesis, Mary has complete knowledge of all physical facts. That is vastly more knowledge than a person can gain by reading "absolutely everything" about anything.

One big problem with the thought experiment is that the premise is so outlandish that almost nobody is willing to use it as given in their reasoning, including Jackson himself. Instead they substitute some vastly weaker premise and ignore the vast difference in implications.


That's all true, but that's not what the thought experiment is about. The thought experiment states that not only has Mary read everything there is about colour vision, but that she knows everything there is to know.


Yes, it hinges on the definition of "to know everything about something" as if there are neatly defined epistemic boundaries. Not all knowledge can be captured in words. Also, this assumes that all knowledge can exist independent of perspectives. No. There are qualia that are necessarily unique (because our constellation of experiences that generate these is unique) that we do not have shared definitions -- which is what words are. To then say that one can "know everything" is meaningless. It's generally the case with these seeming conundrums. The fault lies in the most basic of assumptions that are almost invisible to us because they rely on our intuition.


TL;DR: Plato's Cave meets The Giver.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: