On the group of almost periodic diffeomorphisms