Apple Software Update --> Tools --> Ignore Selected Updates.
Works exactly like Windows Updates which lets face it asks you to download lots of crap which you don't want.
FYI
It's 66.06MB for iTunes + Quicktime.
Download + install took less than a minute so I aren't complaining