Depends how stongly you feel though, when I met my wife she told me she didn't want kids, to which I concurred, she also told me that if I change my mind she walks, it's a deal-breaker.
The most annoying thing we have faced (her more than me) is irritating people saying "Oh, but you're only young, you'll change your mind", my wife found an interesting response that shut people up, but not something I could post on a public message board.