I have the same problem. when vinyl mode is turned off and I hit pause it just keeps skipping/looping.
Everything else seems fine.. I'm really disappointed though coz I just got the unit and upgrading from firmware 1.09 to 1.10 didn't solve the issue.