The "looping" is normal when you have vinyl mode disabled; that's the stutter-frame cueing to find the accurate cue point. Instead of pressing the play/pause button, press CUE (although that will return it to the pre-set cue point). If you want it to PAUSE and not "loop," enable vinyl mode.
Are you sure the white one isn't the Auto Cue for Hot Cue?