The shroud is held in place by a glue-like substance, possibly of the Loctite family. As I understand it, heat has to be applied to remove it. I used to own the same model as you, but left the figure 8 bracket in place. I never experienced the kind of shift described. Personally, I'd leave it alone and shoot it as Walther intended.
However, many will disagree