Rekordbox export duplicates tracks on USB stick

To those who experienced the same problem, read the news here http://www.pioneerdj.com/en/news/2016/support-notice-for-rekordbox-420/ and rollback to 4.1.2 (download link in the news). After I rolled back to 4.1.2 the problem has gone.

Files that were duplicated with 4.2.0 stay duplicated with 4.2.0b. No way to fix this the easy way. The duplicate removing algorithm requested in 2015, 2014, 2013 and ever since rkrdbx was born would have payed off now, wouldn't it? Time to put this on the agenda again and fix hundreds of overloaded sticks and harddrives out there.

Please Pioneer, start doing your homework. One does not only fix bugs, but one fixes the problems it caused as well.

Pulse please kick some of those lazy a**

lol - the drives aren't getting overloaded with duplicates, it's just duplicate entries in the collection.

@Julian > Please file a support inquiry here and our rekordbox team will be happy to assist you in cleaning up the mess.

No, its hardcopies on the export media. As I already helped myself I cannot provide screenshots. And thank you for the link to the support inquiry. The mess has already been cleaned. ;)

But still I am thinking of all those who suffer from the bug without knowing that there is space on their media wasted. In my case, 80GB on the export media with 4.1.2 and 4.2.0b. With 4.2.0 the duplicates added another 33GB.

Ah, there were some users who only had duplicate entries, the files themselves were just a single reference.

We're directing users to downgrade to 4.1.2 or wait for the full update (although the beta is available).

Just noticed this happening on Rekordbox 5.4.1  never noticed it before even when i had 1 track in multiple playlists, is a rollback the best option?

Cheers Liam

@Liam > Can you explain what is being duplicated, and how you know it's multiples?

on my actual usb the mp3 track is being duplicated when i sync my playlists with the device.. This also shows up in rekordbox on my laptop as an unimported track underneath the same tack which is already imported in to my rekordbox collection. 

I tried deleting the duplicates from the USB only leaving the orginal mp3s.  but when I did this and then inserted the usb in to an RX2 controller the tracks show in my playlist but the file is missing when I tried to load a track.  The same thing shows in Rekordbox on my laptop, if you open up the "device" menu the tracks are there but you get the exclamation  mark next to them if you try to play them. 

I then need to delete the track from the rekordbox collection, import it again which means i lose all my cue points,  then add it to my playlists. I then sync it and it works, but again the track is duplicated on my usb and shows an unimported version of the track underneath the imported track in rekordbox

Here is an example of the duplication in one of my folders,after importing Move your feet and syncing with my device. The mp3 title has also repeated itself and you get an error if you try to play the file.  However if you remove this duplication,  the file shows up in the device menu but is missing when you try to load up the track to play it

Okay, it seems there's some information that is omitted... have you recently moved files around, or switched computers? What you're describing would only occur under certain conditions, but you haven't mentioned anything thus far to indicate anything out of the ordinary. Can you provide any additional detail?

Let's start with the basics -- where are your music files located? Where is the database stored?

I see in the screenshot you posted it's showing as drive F; have you ever considered assigning a fixed drive letter? As that may be the issue (Windows assigns the next available letter to the drive, and in this case, the songs may appear as missing if the assigned drive letter doesn't match what rekordbox has in the database as the source drive letter.)

The music files are located on a 16gb USB with around 2gb left available. Rekordbox recognises the device as F, but I understand what you mean about it not finding files if the USB is ever assigned a different drive letter in windows, I've included a screenshot of my device menu in Rekordbox which shows as F LIAMRKDBX. 

I haven't altered the names of any folders on the USB. This issue only started in the last few  days. There was one weird thing that did happen about a week ago when some songs disappeared from my playlist but they were still available and working if I used the search option on the RX2 to find them.  When I checked my usb stick a collections folder had appeared which contained these missing tracks. I deleted the collections folder and the files appeared in my rekordbox playlist again and everything worked normally. But since then I have started getting these duplicates when I import tracks to rekordbox. Prior to this there have been no issues which was why I wondered if It might be worth reinstalling an older version of Rekordbox

I have the same problem.
My USB Drive (F:) ist the source location of my tracks.

In my collection it looks like this:

After exporting track (or sync) to device F: it ends up with an second file:

Version Windows 5.4.1

Downgrading to 5.4.0 fixed my issue.

@Forian: how do you downgrade to 5.4.0 ? Cant find install file anywhere////:

https://rekordbox.com/_app/files/Install_rekordbox_x64_5_4_0.zip in my case.

If found it by performing the following steps:

- Start regular rekordbox download

- Cancel it

- got to "All downloads" of your Browser

- Copy the URL from the download location

- Paste it to the adress field of your browser

- Edit it to get the version you want.

- Press enter, download starts

Sorry guys, turns out there is indeed a bug in 5.4.1 causing this - our engineers have a fix ready to roll out in the next version. In the meantime, you can downgrade to 5.4.0 as others have posted above.

I'm having this same issue on MACOS with version 5.60

Is this a problem again? What's the workaround? 

@Benjamin > What exactly is the problem? There are a few things discussed in this topic, which is why we often lock topics and encourage a new post with as much information as possible, rather than "me too" posts.

Appologies for not making a new post.
The issue I'm experiencing is when I sync to a USB drive, rekordbox is creating so many duplicates that it's taking 20GB of music and filling a 32GB usb drive.
I'm only syncing from RB, not iTunes.

If the USB drive is also the original source location for those files in your rekordbox collection, it won't duplicate them. Since an earlier v5 update, they've been able to link them rather than create a duplicate export file. Songs that are in multiple playlists are only exported once.

The USB drive is not the original source, my internal SDD is. I am trying to make an external source so I can play on CDJ's w/o a computer. 

@Benjamin > So where exactly are there duplicates then? If the export USB drive is not the source...

Okay here's the scenerio:

I have an empty 32GB USB drive. I have 20GB of music on my computer. I use Sync Manager to sync all RB playlists. It maxes out my USB drive and when I look in the folder structures, I see the original tracks along with copies that have "1" amended to the file name.

Hi there,

I am still having this issue on Windows 10. Every time I make multiple playlists and add the same song to each one it then creates a duplicate on my USB. 

Is there a solution with the latest version of Reckordbox?

Cheers :)

It shouldn't... are you somehow copying the songs out to the USB (dragging and dropping from rekordbox to the explorer) or are you exporting from within rekordbox?

No, I don't think so. I am using sync manager. For Example if make a playlist called house and one called disco, then a third called house+disco then it duplicates all songs that are in all playlist respectively. 

I am a noob so chances are I am doing something wrong.

Thank you for the rapid response.

The physical file would only appear once -- what makes you think it's on the drive 3 times?

I also have the problem of duplicating files with 5.8.6 rev 21122-18624-18591

So I wanted to update my collection  so i copied my music map again
And normally he doesn't do anything with duplicates already there. but now he started imprting everything again with duplicates.
Can you explain this?