Argh. Time to find some new headwear, then.
So much for the idea of trying out the Lucky Set, too - I already used up the charges on the Dice (there's no way to "reload" them, is there?) and I assume the Jolly Roger mainly gives some bonuses to pirates/sea dogs, which I don't need?