I experienced a similar problem with the cheapy SMK Biathlon target.
The target paddles could bounce so quickly that you weren't sure you'd hit the target.
I fitted a keeper bar with neodymium magnets which captures the target when hit but still allows the normal reset procedure to be used.
I've done a couple now and it works well. I'll take a photo if you think it might work for your silhouette racks?