It might have something to do with what colors are more present in the light that your eyes are seen in.
Let's see if Wikipedia has anything to say.
Yep!
Hazel eyes often change color depending on what the person is wearing (i.e. if the person is wearing green or purple, the eyes appear mostly green).
http://en.wikipedia.org/wiki/Hazel_eye#Hazel