Answer: It is surrounded by water on three sides. The royal navy was nothing to be messed with back then ( Still should not be taken lightly today) This leaves the city to bombardment by cannons. If the citizens withdrew they would pretty much let the british in, if they stayed they risk being crushed or injured by cannon.