Depends on how you change gears. If you change slow enough it won't grind. If you want / need to change the gears fast, it will most likely grind.
I've come to use specific points for up- and downshifting that work best for my car, for example ~ 18 to 20 mph from 3rd to 2nd. 9 out of 10 times...