Depends whether you use a 100% RTV or what is known as an Extended Sealant. In other words, a quality sealant adhesive, or a cheaper silicone that is mixed with certain oils, therefore reducing its adhesive, shrinkage, and weathering properties.
I have only used the red high temp RTV on exhaust joints, instead of crap exhaust cement.
The adhesive / sealant I have used on any retainer was used very sparingly, and only sufficiently to hold it onto the screen where it had partially lost its hold. Whether it is classed as RTV, I dont know, but there was no mention of RTV on the tube. But it is a top quality product and ideal for the use I required it for.
I have never mentioned a 'poorly' fitted screen, or refitting broken retainers, and certainly not 'filling' the retainer. The retainers I have refitted were always intact, but possibly not quite as tight fit onto the edge of the screen as when new, hence the sparing use of Adiseal - a bit pointless refitting retainers if they were broken or damaged
When we get old in life, we may need the help of a walking stick; the same as 20 + year old retainers that may little help to stay in place if needed. I can't actually see the problem to be honest....