The problem as I see it is; as the handbrake is only applied when the wheel is stationary there is no surface abrasion, so once rust starts to form on the drum surface there is nothing to get rid of it. Consequently the brake shoes start to grip on rust, which,when compressed by normal use, is a lot less grippy than cast iron. Just a thought.