I do not know if you can walk that shaft out without taking the column loose. I had mine apart years ago, and I can tell you that you are gonna want to replace those bushings. Make sure your vendor sends you the steering box bushings, not the water pump bushings. They are different, and they are directional. Then when you slip your shaft back in skim coat it with axle grease before sliding it in, then wipe out any excess (although it should be minimal).
This does assume that you are going to end up pulling the column...