If you want to make a simple website, or have a simple product, you need to become well-versed in letting the good in and keeping the bad out. You can’t do everything and you can’t have every feature someone could possibly want.
You are a curator, and Jason Fried has a great talk (15 minute video) about what a curator does:
“Think of yourself as a curator. You want to be a curator. You have to decide what comes in and what goes out. Curator’s job is to say no. Curator takes an entire universe of options to decide whether or not something makes it into a museum.”
The hard part, I think, is how to decide what is essential and what is not. When I need help with that, I turn to a couple of the concepts from Designing the Obvious:
How do you decide what belongs in your museum?