A constant theme in "The Lady of Shalott" is the one that we cannot realize our fantasies because they can never match reality. That's why the Lady dies before meeting Sir Lancelot and that's why her love is presented as impossible.
The answer is: It is impossible.
