Not that normal. This probably has to do with new packing - one hopes eventually everything will "settle down" and reach an optimal state of compression of the packing.
ALTHOUGH it may have to do with the shaft tearing up the packing (and it being washed out) and disappearing that way.
You might "mark" the nut somehow and keep track if it's "undoing" as the engine stops, reaches a compression limit on one cylinder, and then "rebounds" slightly.
Best is a rebuild using the modern seal incorporated inner shaft bearing. I think these now have not one but TWO modern seals which sort of do away with any need to mess with the nut packing - although you can do this too if you wish. (and maybe as a back-up?)
Joe K