In my experience, athleticism helps more when operating at the peak end, but if you're taking the measured approach to your swings, then it's probably not as critical a skill to you.