No doubt he will go on to produce other shows, but Top Gear is, or was, a plum job. It's one of the most high profile shows the BBC has, and if that degrades or disappears, as I think it will without the current team, then he has a less high profile show to produce. And if he moves away from Top Gear, he cannot expect to just waltz in to another top ten show, not least because someone else already has the job producing those.
I can't see how he can avoid either a less popular show in Top Gear, or a less popular show somewhere else. In other words, his career profile drops a bit.