You definitely hit the nail on the head. Panic is a form of anxiety. If you address the anxiety, your panic may decrease. What is your greatest fear when you see the ball coming? That you may miss? That it will hit you? Allow yourself to make the mistakes that are causing you to freeze up; let it pass so you can move forward and approach your game with increased confidence. Apply this thinking to the rest of your life.