throw away?

At home this Thursday evening. Sorting out my wardrobe. It was actually my boyfriends idea. He keeps asking me...
- Do you REALLY need all those shoes?
- Sweetheart, you should throw some of those jumpers away, give a few of them to your sister!
- Seriously...when was the last time you wore that dress...
I keep hearing these things, and I know I should get rid of stuff because of our minimalistic wardrobe space at home, but I can't help it. I'm attached to almost all my clothes!!! They all have memories!! Aahhhhhhh.....what to do.