It shouldn’t. But unfortunately, it does.
Those of color usually can’t afford a good education. People of color are usually looked down upon as being inferior. People of color are usually not given the “breaks” that those who are not of color do.
Having these (for lack of a better word) “disadvantages” affects what a person becomes. They may have the most brilliant mind known to man, but simply because of the color of their skin they will be ignored or mocked. Or they won’t receive the education to help hone that mind. They may have a great invention or know how to treat a disease. Yet, they will be rejected, or another will steel their idea (and any wealth that may have gone along with it), simply because of the color of their skin. Things like this have an effect on the human psyche. Why bother to try if you’re only going to get knocked down or killed? How can you help if no one will listen? And all just because your skin happens to be a different color.
It’s not so much beauty as it is who won the war, arrogance, and economics. Throughout human history, each “color” has had their turn dominating (wars). It just so happens that the fair-skinned (European) people were the last to do so. Human arrogance has always stated that, ‘if something is different from you, then it must be inferior’. One isn’t going to waste their time or money trying to “educate” something they consider inferior.
As much as we want to end all prejudice, it will never happen. Whichever “color” is in power will always seek to dominate those who are not like them – whether they be black, white, red, yellow, green, purple or whatever. That’s just how humans are. Human history proves this true.