I personally have had no zero problems in all 4 of my guns when removing the action from the stock for cleaning purposes even on my springer which are very sensitive to such movements.
But as Peter said, best if you do some testing a few times just to make sure there is no POI shift.
HW97 V-Glided with LP Eliminator Stock Big Nikko 10-50x60
TX200HC V-Mached with LP Eliminator Stock Tasco Custom Shop 8-40x56
CZ S200 FT Stock Big BSA 10-50x60
AA Shamal Big BSA 10-50x60
Steyr LG110HP HFT Modded EB Sniper