You have things like grapheme-color synesthesia where people really do experience things different. They might see 2s as blue and 5s as green. So if they ever saw a 2 it would be blue. Like 5 5 5 5 2 5 5. Even though the numbers are all the same color to us someone with the synesthesia would see those numbers there in the color their mind associates them with automatically.

Here’s the standard color wheel set to Red, Blue, Yellow as primary colors.

You’ll notice that magenta is represented as almost a whole different color. It’s light red in the CMYK, light purple in RGB.

And

Cyan, baby blue, sky blue, etc. isn’t represented. Instead you get a blue-purple they call violet.

Light Red - Magenta

Light Blue - Cyan

Blue-Purple - Indigo

Light Purple - Red-Purple - Fushsia

We as a whole can’t decide what constitutes purple/violet in RGB model

Even if someone doesn’t know what a true “Indigo” looks like they are still experiencing that color for what it is. They will just call it Bluish-Purple or Purplish-Blue. And unless it really was the exact mix of 50/50 blue and purple it wouldn’t be indigo. It would be a equivalent to a Redish-Orange. A Bluish-Indigo or Purplish-Indigo.

Sorry for the walls of text I was learning and thought I might as well share.

Your language doesn’t change your perception of color.

The primary colors being Red, Yellow, Blue. Is made up. There’s no reason those should be the three primary colors.

Magenta, Yellow, and Cyan could be the primary colors if you were taught that.

In that color wheel orange is an intermediate color. The intermediate color between green and yellow can be called chartreuse.

Did you know chartreuse as a color or did you just know it as yellow-green?

Do you not preceve the color chartreuse the same as someone that just knows that name?

You can perceve all the difference colors on this wheel without needing an official word.

As you can see “Brown” is just a darker orange.

Your phone screen only uses three colors to represent all colors.

If you printed out the photo of the dress the “illusion” wouldn’t work.

The 3 colors used to make the blue dress in warm “gold” light is what allows your brain to interpret it as yellow.

If anything it helps prove that people basically see in the same way. Just if your brain adjusts for the backlight tone. You either saw blue or yellow. No one was saying purple or orange.

If you took mushrooms and saw purple you’d be hallucinating. Your brain is giving you false information.

Seeing it as yellow isn’t false information but a different interpretation of the given material