Yes, the vast majority of an atom is indeed empty space. Most of it's mass is centered in the nucleus. Flying around the nucleus are the electrons, but they're very very far away (on an atomic level anyway). Most of the atom is the space between the nucleus and the electrons.