I don't shoot springer's anymore, and you have described why I don't.
Some people love the great challenge of shooting them accurately but they are "hold sensitive"
Try holding the gun less tightly.
Atb, and welcome to STB.
Anschutz 2013 MEC1 .22LR
Miroku 3800 12bore