Brian Sutton said those who did not vote should not expect him to be "at their beck and call".