Just one issue- if someone has an ongoing deal with the orb? We could have it in our possession, and it wouldn't matter- we need to end whatever bargain someone's made with it before we're able to teleport out.

[Although if they're able to find it, they'll have an easier time sorting out who's made a bargain with it. Hopefully.]