So the gold could have been from him. Or anything else that led to that point, especially if they were related bargains.

If they orbs are sentient, they probably are influenced by their host, or owner, whatever we're calling them. You're probably onto something with the willingness to hand it over.