It does sound like your natural hold is canting the gun slightly.
What gun is it? Do you have a butt plate or hook that you can adjust the lateral angle?
Do you lean your head over onto the cheekpiece to see through the scope? This can confuse your brain into thinking things are not level when it's you that isn't level.
Many shooters do this with no problems but I find it doesn't right to me.