He's about to comment on the breaking and entering. Isn't that just what they did every time they landed the TARDIS somewhere? But then the younger man (in more ways than one) goes on to mention fish custard and he blanches.

"I've grown out of that and please don't mention it ever again."