Recording mixes - DJM 600

So I am having problems getting a good quality recording. My setup:

Djm 600
Cdj 900 nxs
Presonus audiobox 22vsl DAC

I have connected the Mixer to the DAC via the XLR main output (according to the djm manual this is +4db) The presonus only has XLR inputs so have not been able to try RCA main out on the mixer. Also tried the REC and BOOT outputs to the line in on a zoom h2 recorder but this sounded horrible.

Yet when I tried to record through Audacity the sound never comes out really good, either too low or just "muddy".

I tried fiddeling around with the master AT knob on the back of the DJM and it is now set somewhere in between max and min.

The peak meters on the djm are hitting 0 on the channels and -5 on the master.

Audacity recording sample rate is set to 44100 and 16 bit. Had it set to 24 and 32 before but it improved when I lowered it to 16 bit.

So any tips on how to improve the quality of the recoring?