Error while opening Pioneer DDJ SB2 ASIO

I have a fix for this which is to go into Device Manager and uninstall the DDJ from the Sound controllers but I then have to restart my computer every time I want to DJ. After the restart it works fine, but after disconnecting and closing rekordbox the problem happens again and I need another restart

Is there anyway to fix it without having to shut down all my programs?