Precisely. A free market cares about one thing and one thing only: efficient use of resources to satisfy demands. It doesn't care about who is making the demand - only in how much their market is willing to pay for a specific good/service and the overall size of the market. Racists by their very nature limit their potential customer based and inflict on that customer base higher prices as a result.
I think the market pushes people not to discriminate.
Walter Williams is one of todays heros.