How to use and link colored product images

Hello,

I'm looking at how I can have various colors, lets say, red, white black and grey for a product but use real colored images instead of a mask with a background.  And can I still display the colors choice and link the appropriate image to each color choice. 

So when the client changes the product color, it changes the whole image of the product instead of changing the "background" color.

The reason being that each product color comes with stripes and handles that are of different color not matching the main product color. Thus I cant just swap one color, I have to change the product image itself.

How can I accomplish that?

Thank you.