'the Gods' refers to a specific set of gods, so the capitalization is proper. 'my Boss' refers to a specific person, so, what's wrong with capitalizing the B?
Intuition in my mind realizes that 'my boss' just -seems- proper, but, the more I think about it, the more I can't shake the feeling...