My PC was running with 4GB, and it was amazingly quick, but I managed to delete the BIOS of my Asus mobo, and my temporary replacement mobo makes my system BSOD with anything more than 2GB, so I am stuck with just 2GB for a few more weeks :(
4GB is definitely the way to go.