Is this boss being a perve or does he have other intentions?

How are we to know? It could be anything- from not wanting to show favoritism to perhaps being attracted to you- to having changed his mind about bringing you to the new office. Who knows? Ask him.