The speaker enjoys spending time by the "deep sea" because he enjoys the way it connects with him.
It was common for protagonists in Romantic works of literature to spend a lot of time in nature and many exotic places on our planet, so as to run away from the society and their problems. They feel the pain of the world, and want to be free, and thus they go to nature to get rid of their issues.
