Official comment
Sorry, the rating metadata is not read from an MP4:

Comment actions
When I add a rating tag to a video MP4 file, it is not read by Rekordbox. Because of this, I have to go through imported files again to get my rating information in.
Sorry, the rating metadata is not read from an MP4:

Post is closed for comments.
But what is the reason for not reading that tag from a video file versus an mp3 file?
My aim is to keep as much information as I can recorded in the metadata of the actual file as possible.
Sorry, I'm not sure why, but I expect there's a technical reason for it.