Councils say locations earmarked for new homes may no longer be suitable.