MarkLogic Content PumpAuthor: Dave Cassel | Category: Software Development
This morning, MarkLogic announced version 6 of the MarkLogic database. Lots of great stuff in this release (plenty of post material!). Let’s start with something simple, but very useful: copying data from one MarkLogic database to another with mlcp (MarkLogic Content Pump).
In previous releases, there were a number of ways that you could choose to migrate data from one database to another. I typically used XQSync, which pulls data from one database into a bunch of zip files, and then in a second command, pushes that data in those zip files to another database. That’s a good tool, but it does require storing the archived version of the data on the machine where you run the command.
Migrating with MLCP
The new mlcp has a COPY command, which pulls from one database and pushes it directly to another, using XCC servers:
$ bin/mlcp.sh COPY -mode local \ -input_host host1 -input_port 8020 -input_username admin -input_password admin \ -output_host host2 -output_port 8006 -output_username admin -output_password admin \ -thread_count 8
As someone who has had to migrate a number of applications (and their data), I like the simplicity of this.
MLCP is a descendant of recordloader, xqsync, and other tools to shift content. One big difference is that mlcp is a supported MarkLogic product (while still being open source). Do you have suggestions to product management as to what should be added to it?