The cap should be able to swivel on the arm so that it can stay lined up with the push rod when the arm is pivoting. The cap should not be so loose that it appears to want to fall off. I have carefully crimped caps to be better attached to arms while still allowing swiveling, but not been impressed with pump quality when I had to do so.