It really depends how good your current broadband connection is. That depends on the provider and your line.
I have a decent ISP and a relatively short ADSL2+ line. Typically get 16-18mb/s down. It really isn't worth me changing, since the nearest FTTC box from me is not much closer than the exchange! My neighbour has gone to Infinity and gets a marginally faster connection than me - when it's working, but reliability is MUCH worse with his modem regularly dropping the link.
If you're one of the poor souls who can only get a couple of megabits or worse on ADSL, or are currently on an poor ISP, then it's a different picture, and it will always be worth the move to FTTC/FTTP provided you go with an ISP who can do it justice.
As to whether the WLAN is the weakest link, as said, it depends on the flavour of wireless LAN your devices support and what throughput it's actually achieving now given the radio environment - number of signals in the area and level of interferences, etc.
Try attaching one machine with a cable for a while and see if you notice any difference. Do a speed test in this configuration to get a better picture of where you are now.