You'll have to loosen the clamp on the column inside the cabin also.
This adjustment is pretty critical. The arm on the advance plate needs to to travel fully (stop to stop) in the notch in the distributor body when hooked to the linkage and using the lever on the column.
If you paid someone to install the steering column I'd have them finish the job, and/or be on the lookout for other things they did wrong.