Also, be aware that many of the better drill presses have a female Morse Taper in the spindle, and the chuck has a matching male Morse Taper shank-it is held in place by friction only.
This works well for axial drilling loads, as these tend to push the tapers together and make the connection...