If the cast iron meat is there, have them turned so that you start out with the optimum surface.
If you do not yet have a copy of the '32 service bulletins in reprint form, I recommend that you purchase one and follow the brake adjustment procedure on pages 2 through 5 of the June, 1932 service bulletin. The relationships of the pedal, cross shaft, and levers on the backing plates to one another are critical to good brake performance (as you likely already know from your Model A).