How about instead of a subicon as suggested, the hammer sits on it rather than the accents it has now (or the other way around). So like a hammer on the laurels or laurels on the hammer, dropping the green/yellow/blue accents in favor of the specifics?
I'd also find a way to incorporate whatever type things are chosen into the social progress window so it ties them together nicely.
I think this is a pretty good idea, yeah.
We wouldn't want it to get to cluttered.
If you wanted to keep colors associated in a small way, you could try changing the whites of the gavel to keep the color connections.
