I have been interested in quiet computers for a few years now, and the usual answer to these sorts of questions is to point people in the direction of the great website silent PC review.
One general truism is that it's a hell of alot easier to start buying with quiet in mind when making a new PC, than it is to quiet a current machine. Still, that's the current situation.
One thing that surprised me was, once i began to change fans for Zalmans and Arctic Coolers (both of which i highly recommend), was how loud some hard drives are. This really isn't a negligable point, my Maxtor actually makes quite a whine, as did my older 80 Gig Western Digital.
Samsung spinpoints and Seagates, apart from being fast anyway, are really nice and quiet. I hear (no pun) that WD have improved alot more recently too.