Although the specific details vary from skill to skill, the overall pattern is consistent: Regular training leads to changes in the parts of the brain that are challenged by the training. The brain adapts to these challenges by rewiring itself in ways that increase its ability to carry out the functions required by the challenges.
Fix it. Break the skill down into components that you can do repeatedly and analyze effectively, determine your weaknesses, and figure out ways to address them.