Residents say the council ignored objections against the development, and is pressing on despite a pending final heritage impact assessment