After further searching, I found the answer to my question in another post:
"Have you pressed the headphone cue button on the channel or master? Do you have the cue mix knob set to a position where the audio source you've selected will be sent to the headphones? Is the volume up for the headphones?"
It's too bad that this instruction isn't included in the starter tutorial in Rekordbox dj.