The only downside I find is having to set the affinity..
I was working from home yesterday on my rig and while it was crunching data I was sorting thru some old avi's and they were stuttery, set QV to use 3 cores and free'd one up for wmp and the rest of the system stuff and it was fine, would be nice if the system did that for you tho instead of having to do it manually...