I've found something on the apple discussions forum. It's seems to ben an OS and Fusion Drive Problem
Look at the "Barracus" Answer at the end of the discussion:
https://discussions.apple.com/message/23967372#23967372
I will try the solution tonight and tell If it works:
** Re: USB Audio Problems Late 2013 iMac - Clicking / Popping / Dropouts**
Dec 13, 2013 3:03 PM ( in response to Barraccus)
Today I split my fusion drive according to this article:
http://www.macworld.com/article/2015664/how-to-split-up-a-fusion-drive.html
Then I reinstalled Mavericks 10.9 on the standard HDD partition.
Result: No more clicks and pops through the 18i20 with some basic tests with Garage Band recording/playback, Youtube playback, and iTunes playback!! (I installed the Focusrite class compliant driver again.)
I will be testing further before purchasing Logic - I have not tried to bump up the sample rate and I'd like to give it more time. So far so good though...