Nobody can.

He did not control the doors or the timings or whether somebody would need him to be somewhere else.

And I asked anyway, because I was about to be made unconscious and cut open and I wanted something to hold, and the thing I wanted was not really a promise about geography.

What I was actually asking was: you will not go anywhere in your mind while I am not there to keep you.

And he heard it correctly.