You have discovered lexical ambiguity, aka homonymy. An "object" can refer to a physical thing. It can also refer to something that a feeling is directed at. I hope that you do not
object to my pointing this out to you.
I am not debating whether perceptions are real, so I sympathize with your point. Nor am I claiming that a "state" of the brain is external reality. What we are discussing is the nature of so-called "external reality". It seems clear to me that the mind can only ever conceive of an external reality in terms of an idealized model of some sort--one built up out of subjective experiences. Some models are superior to others as predictors of future outcomes.
...
If we want to gleefully skim the surface then yes, that rainbow is in the sky, not the mind.
So, you believe that the "sky" is something that is not "in the mind", right?