In fact, in my home we have taken this design concept one step further. Not only do our chairs not match, but some are now broken (due to their vintage state) and subsequently have been removed from the dining area for safety reasons. So currently we have two mismatched chairs plus one ottoman which adorn our custom-built dining table. For a party of five no less.
Don't get me wrong. This works too.
(Photos via .v photo's photostream except last one via weheartit)