If I were a member of the jury and returned to the courtroom to an empty gallery, I would know something was odd with the witness. I could see the jury members weighing that into the credibility of the witness. I wonder if the judge would address the gallery being empty or just leave it the big huge elephant in the room.
I think I'd be nervous if I returned to completely clear courtroom without explanation. I'd wonder what the hell was happening.