This is intriguing, and I agree that I had never noticed this before either. It is clearly intentional because it is true for all three badge levels, though the other two seem to balance better (as mention in @Blip's answer )
I used "Inspect Element" to look at the css governing the colors. Here are the six colors used:

and in table format:
======= ====== =======
Element Level Color
======= ====== =======
Badge Gold #FFCC01
Text Gold #cda400
Badge Silver #B4B8BC
Text Silver #8c9298
Badge Bronze #D1A684
Text Bronze #c38b5f
======= ====== =======
It is interesting to note that even the style of the hex colors differs (with uppercase for the badges and lower case for the text). Given that the other (Silver and Bronze) badges don't stand out as distinct, it is just the Gold pair that needs to be tweeked (either badge darker or text lighter, or both).
#f48024
, tab tops and page number backgrounds are#f69c55
, the review badge count is#da670b
, badge progress bar backgrounds are#ffcc00
, chat room link colors are#dd6205
... there are probably more. /OCD rant