Have a feature request or suggestion? Post your idea here!

Post

2 followers

rekordbox

Rekordbox has duplicated 3500 entries in database without cue points beatgrids (same file) please help best way to sort it

Hi forum,

I had a macbook crash last year and moved over to pc. Got my collection moved over and the 3500 beatgrids and cue points were showing as far as i can remember. I organise my music in itunes with 4 folders and a sub folder of lots of smart playlists so tracks are in multiple playlists.

Have added lots of music since them, and not set beatgrids or cue points for many but just had a mix, and noticed no cue points or beatgrids are showing in the playlists in 3 of the folders. Sorting collection by track title and seems there are duplicate entries leading to the same file (clicking show in explorer for both) - one has the cue and beatgrids set and one is blank.

Looking further it shows the versions with cues are in just one folder of playlists where music is split by genre, but they arent showing in any of the main playlists.

How can I best approach sorting this out, so i can import the playlists as they are updated and Rekordbox will only show the beatgridded and cue pointed version. Took me months to do and need to get setup asap for gigs. I've selected all the tracks that have been set and set the analysis lock to avoid losing them (i hope).

If i manually go through each one and delete the ones without beatgrids / cue points then they will be removed from all the main playlists, and would take ages. If i delete the collection and then reimport everything im thinking it might delete all the cue points and beatgrids

Only other info i can see is - if i browse the date of the imported rekordbox.xml in file explorer is set to july 2018 - which would be the last time i used it before the macbook crashed. There have lots of tracks added since then, so im assuming there is another .xml file which is the collection somewhere?

Hope you can help. Cheers

UPDATE - just tried deleting one of the duplicates file (w/out cue points) and then creating a new itunes playlist with it, closing it down, reopening rekordbox to import the playlist - and the track shows as NOT in rekordbox - checked by searching in collection and track shows (with cue points / anlalysis lock) - tried importing playlist then have duplicate again.

Any ideas? Pulse?

Dj Narrative January 23, 2019 13:13

Post is closed for comments.

Date Votes

10 comments

SPAGHETTI!

That's a mess... and the duplicates probably exist because of the migration over from the old database into the new after the crash. With the songs existing at a different location, they could be imported a second time.

Have you determined if the duplicate songs are, in fact, at valid locations and able to be loaded?

Certainly, trying to do the swap for all the playlists would be a nightmare; you're saying the ones in the playlists don't have the beat grids / cue points?

Pulse January 23, 2019 18:14 0 votes

Thanks Pulse - Yeah the songs link to the track all in my itunes folder, and both the duplicate the cue pointed one link to that same track. Cant work it out.

And yes - all playlists dont have the beat grid / cue point versions of the tracks. For some reason only the playlists in genre folder do. Have no idea why.

Keeping my fingers crossed for a solution if you can think of anything to try. Losing all that work would be a nightmare.

Dj Narrative January 23, 2019 19:56 0 votes

The rekordbox.xml is at the C:\Users\yourusername\AppData\Roaming\Pioneer\rekordbox but the date modified is before the crash - could this indicate the issue? Is there another place that the collection is saving and maybe its updating this instead of the one above?

Dj Narrative January 23, 2019 21:07 0 votes

1000's more duplicates as well it seems (not only beatgridded / cue pointed tracks)

Any help or suggestions that i can try Pulse? I followed the reimport guidelines to the letter, so im hoping this is solveable? Happy to delete the collection and reimport the old .xml if that will work & we can work out how to import tracks without them getting duplicated. Really do not want to lose all the previously beatgridded and cue pointed tracks so i need to be sure before doing it.

Thanks

Dj Narrative January 24, 2019 18:10 0 votes

Wait, why did you import an XML file?

Pulse February 04, 2019 20:20 0 votes

xml was the database file... I did speak to support since ticket who confirmed it was happening because the user name of the computer and the file paths to the music would have been different for the mac, than on this new pc. After lots of trial and error i solved it by trying something in a youtube video by Dexxter Clark ...https://www.youtube.com/watch?reload=9&v=1vTMTQHMlsg - which will write below - for anyone else who might run into the same situation.

Please note - obviously backup your collection, and the xml file you are editing, before doing any of this...and it is not pioneer supported as far as i know - but did solve my issue, and they are passing on to engineers so maybe it will be in the future.

I basically just used a text editor, and the find/replace function, to replace the path of the music files with the new computer name and updated path. That was the issue of the duplicates, so even though 'show in finder' was going to the same physical file for each duplicate, the imported xml database file in prefs, had the music paths in the old computer, so needed changing. That's why one was showing the beatgrids and the duplicates weren't

Here are the steps i copied / pasted & slightly updated from the vid that worked for me...

1) make sure rekordbox collection is empty. Otherwise in the /library/pioneer/ folder, delete the ‘rekordbox’ folder.

2) Open the Rekordbox XML file in a text editor and 3) find / replace the path of the music files the xml file to the new one on your computer.

e.g my music was all at

Location="file://localhost/D:/DJ/iTunes/iTunes%20Media/
Music/Tipper/Broken%20Soul%20Jamboree/03%20Class%205%20
Roaming%20Vapour.mp3"

so i just copied that portion of the location for the old location in the find box, and pasted file://localhost/D:/DJ/iTunes/iTunes%20Media/Music/ into the replace box. and saved.

Make sure that the text you are searching for is unique, otherwise other text or settings will be accidentally replaced too.

The %20 is the code for a space.

4) in the Rekordbox settings, point to the xml file in prefs & 5) now import the playlists by dragging them from the xml file in the folder tree to your library

There are a couple more steps in the video, but that was all i needed to do, and could then import my itunes playlists, and it would ask me when it found duplicates instead of reimporting them, and it kept all my beatgrids and cue points. .

One unexpected thing that happened after editing xml, was that rekordbox was changing capital 'I' in Itunes, to a little 'i' so i changed the path to from ITunes/ITunes%20Media (which is what it was on the hard drive) to ITunes/iTunes%20Media which worked...for some unknown reason!

Anyway back up and running and hope that helps someone.

Dj Narrative February 11, 2019 16:30 0 votes

For the record, no - the XML file is not the database file, but you can create an XML output copy. Reading / loading the XML file as a "regular use" location is slower and less efficient than having them in the main database.

Pulse February 11, 2019 18:38 0 votes

Sure - good point - i meant to / should have said - collection, instead of database. Figured you'd know what i meant in context of the question, and my previous reply, but I'm just glad to have not lost months of cue points, and seems this is a way of achieving it.

Had hoped that importing the playlist from the xml would then update the main database / collection part of it though?.... If importing / dragging the playlists into the collection from the xml and reading from them is slower / less efficient, would adding another step of backing up collection and then reimporting that into a blank collection help address that?

Dj Narrative February 11, 2019 19:12 0 votes

The way I have used XML in any of my testing was as the bridge-point; load it up in rekordbox, then import those items into the collection, then ditch the XML file.

Pulse February 11, 2019 19:19 0 votes

Great stuff - so we on same page - no extra step needed - writing a blog about it for someone so glad to get clarification

Dj Narrative February 11, 2019 19:30 0 votes