What do the colonies of New York, New Jersey, Delaware, and Pennsylvania have in common? The colonies have the same founder. All were founded for the purpose of religious freedom. The colonies were created from the New Netherlands territory.