I concur with Tom , be careful with this as you have a good shot or two but can do more harm than good if not careful
I assume the levers are off if not remove the bolt and use a small cold chisel to spread the lever split to pull the lever off easy remove the key
Soak the levers and bushings liberally with kroil penetrating oil
You are best trying to do these on the bench vise. I use bronze jaws in my vise and brass hammers and drifts , so not to mushroom the shaft ends
Make sure it's not already mushroomed. If so fix first
I would put the e-brake carrier in the vice so the flat is down on the jaws slight clamping around the shaft tube but not too tight that it clamps it to the shaft
Soak with penetrant more and attempt to tap out
If the bushing shaft comes loose from the carrier it can be repaired carefully , just know it has to fit in the backing plate cleanly after repair so trial fit is recommended
Good luck!
Larry Shepard