A call has been made to abandon plans for a new railway station for Norwich - because the £20m project is unlikely to ever be built.