It was probably not the best course of action considering Q would probably have an easier time putting all these people back where they belong than even multiple Doctors and TARDISes would.

"Quite a bit, and not just from us. I doubt the captain of the ship is happy with him either, since all these extra people keep popping into his lounge."

He was trying to diffuse the temper, just a little.