Double Tapping punch buttons

Double tapping kick buttons feels natural and fairly easy but doing them on the punch buttons is awkward. You’re supposed to tap close to the bottom of the button because it’s faster but since the punch buttons are so close to kicks, I have to move up a little bit to the center of the button. Have you guys run into the same problem?