In order to refurbish my doors, I would like to remove the hardware to clean and paint. Most is straightforward, but in getting the outside door handles off, I pulled the small screw out on the side that looks like it would hold the handle on, I would think that it would then wiggle off, but it...