Color correction on green screen actor changing depending on background

I'm encountering a weird issue where my color correction on a green screened actor is changing depending on the background behind the actor.  I have verified that there are no holes in my key that are bleeding through.  I even tried pre-rendering my keyed and color corrected actor, and reimporting it as a clip with an alpha channel.  No change.  Whenever a bright background appears behind the actor, he washes out.  Attached are two images illustrating the problem.  Anyone have any ideas?

The color on both looks the same to me. Your perception of the color might change with the background but the actor is the same. It also might be an issue with your monitor trying to compensate? But to me here they are both identical, especially if you isolate the actor.