The 40 strength gave you about 20 extra damage, which isn't really going to matter. Sage robe is going the hide the hollow waistcloth and it has a very high bleed resist. At 76 poise you can take a hit from a 2-handed greatsword without flinching.
I put on the rapier mostly because I like it and it makes a good combination with the scythe. Take it out if you want. If you do take out the stats in endurance and put it into dex as well.