In the MK2 golf, usually does it when it's working extra hard like if the engines cold. I replaced the shaft bushing but it didn't fix it.
FWIW this is a gear reduction starter with all the little planetaries. It seems weak too, especially when it starts groaning.