Slight delay when I release cue and press play

Here is the scenario:

A track is playing on deck 1.

I load a track with the same BPM on deck 2 and hold the CUE button to match it with deck 1

While I am holding the CUE button on deck 2, it matches perfectly with deck 1, but as soon as I press the PLAY button, there is a slight delay which leads to messing up the beat and not being in sync with deck 1.

Anyone has any idea what to do? It's strange because it's just ONE SPECIFIC track that causes a delay on deck 2. In other words, while this specific track is playing on deck 1, ANY track with the same BPM that I load on deck 2 just wont sync with that specific track.

I hope that made sense lol