I played around a bit and managed to get it working by going into Utiity -> Autolock and switch that to "ON" now I can load a track into either deck using the rotary.
Under no circumstances can I load a track from Rekordbox using the rotary while autolock is set to "OFF". Even when no tracks are loaded into the Aero. This seems like a bug to me