"Neutral colors" are white, black, and gray. Sometimes colors like brown are considered "neutral" as well if they're not bright.

You talk about "neutral colors" when choosing things like clothes, accessories, curtains, furniture, and so on.