We aren't talking big bucks here, so stakes are not high. Try some things...
To start with, at Bratton's, shaft sleeve and pin at bottom are only $1.50. If yours are newish, you won't even damage anything because you can push out a roll pin and remove the sleeve with zero problem, at very worst you'd need to grind head off of an original pin (roll pin replacement a crushing 25 cents!) or possibly even grind a gap in a frozen sleeve and go for the whole $1.50.
Now you can check the bottom of shaft for any burrs that would damage bushings and push the whole shaft out. Now you can rest the bottom of cam against vise jaws and gently tap downward on center of shaft...I think, I'm at work and have no actual distributor parts to look at!
At very worst shaft and cam too are a hair over $20.00 if nothing you touch is salvagable, at best you have a roll pin and can R&R everything with no casualties.
And replace bushings if they are at all dubious.