Every person who carries any type of self-defense weapon must have a clearly defined purpose for doing so. It also helps to know how to use it properly. Additionally, there are state restrictions on some “deadly weapons” and not others, so it’s important to know the law.
There is no perfect solution. It is a game of priorities and compromise. In short, decide what is your highest priority and find the best solution for that. Belly Bands address many problems, but the gun is at risk of rust from sweat. Smaller guns and tighter holsters will solve the saggy pants and abrasion issues, but draw speed will probably be slower.