Make certain elements in a color group uneditable

I have a product using a text link group and color link group so when the text and color for the groups are edited all of the elements on the product change together.  The problem I have is that on the front end there is the option to change the color for each text element where I only that option on one of the elements.  Hopefully attachment explains this.

Thanks