Famous people are just normal people with different jobs. Saying you like their work and leaving them alone is spot on, a bit like if a random came up to me and said "hey, nice shoes!"

Now if that person then followed me saying "no, i reaally like you shoes, your shoes are lovely. You have the best shoes. Can i come with you and look at your shoerack" well, that would become annoying.