Today colours are used throughout all industries on the basis of formalised standards like the US NBS and the UK BSI and they are used very specifically because it is now known that colours and the way they interact, have a major impact on people's thoughts and actions. In getting to understand this, artists found a way to 'do' colour measurement and it is the principles that underpin this that are used widely in the fashion industry to make things and us look good!
It turns out that colours have amongst other things, an undertone. For example they could be yellow based or blue based. As it happens we can also have tones associated with our hair, eyes and skin colours. You might find that you are using blue based tones when your natural colours are yellow based.
They would be 'wrong' because they appear not to work for you; they don't appear to compliment and uplift you; they conflict in some way with each other and your natural colours. That's how some colours can be wrong - a bit like the Edie O'hara Designs Silkie selection below! Luvly individually but perhaps not so together.