As always, its a compromise between comfort and accuracy. No rubber bushing, would mean very accurate steering, but transmit every single bump through the chassis rail and steering wheel.
Some shock absorption will be needed.
Considering how thin the bush is, 'some' is all you're currently getting. Removing compliance like this is a good way of breaking something else which isn't designed to take such loads. I've done this sort of thing with Capris: using poly bushes in the TCAs(wishbones on an Omega) and rack clamps means you wear out the internal bushes of the steering rack much quicker, and they're already a weak point. So you replace those with bronze, and find that the rubber coupling between the rack and the column starts to tear,. Hopefully, you notice this early because the column bush fails before you lose all steering! Replacing the coupling with a poly one makes for a nasty drive, and it's not unusual for the rack tube to split. I've even heard of one car with a cracked crossmember as a result of all this.
As we're talking about at least 10 year-old cars, with mileages around the 150k mark, having to replace an idler is just a normal wear and tear item, and should be good for the life of the car.
I think it would be more productive to replace the vertical rear bush with another front one, both acting in the same plane and axis. But that would require extensive re-engineering of the wishbone and subframe, neither of which are particularly practical, especially as it all works OK when fresh, it's just lacking in durability.