I'm a D-76 guy. When I first started out I tried a lot of different developers ... but D-76 worked well enough. HC110 for pushed stuff. I would only agitate once or twice during development. A simple flip and twist of the tank, mmmh ... maybe two or three seconds. If you're willing to try less agitation, start by having what you're doing now, then halve that et cetera, until you find a methodology which gives you the best results for how you expose. Less agitation will make the grain just a bit finer.
Good Luck and Good Shooting,
Gary