Is there actually any problem with it fraying at the sides? Can anyone see it, or does it affect your attachment?

My last piece was pretty badly frayed at the sides from 5 months of wear. It still looked fine from "the outside"