depends on the kind of music and mood..
long years ago when I was young (around 20) I had hand built amplifiers and speakers (I built them and their crossovers-they were huge)..
the bass sound was shaking the apartment , and obviously neighbours didnt like metallica and the likes..
when I moved (married-first time )I was forced not to use them. the new home had walls which were too tiny and even a fart can pass 2 blocks

and I was fed up police knocking the door frequently (20 years ago)
anyway, my ex wife take the whole set (was really an expensive one) and it took years for me to bring it together.. and its all gone..

looking on the bright side one problem solved with neighbours
now generally I use my sony earphones .. the miniset kenwood (which I bought later) is just a fraction of what I had in the past.. but I dont bother buying stronger ones..
now rarely I open the volume (only in day time) and even this can be heard from the end of street
also age changes your music preferences.. and some styles really not suitable for high volumes..
other than that , I dont like high volumes in car also as I cant hear the engine noise..