Issue2013

Title Incremental hg convert of GCC svn repository is very slow
Priority bug Status chatting
Superseder Nosy List djc, pmezard, ro
Assigned To Topics convert, svn

Created on 2010-02-02.19:37:05 by ro, last changed 2010-02-03.17:09:03 by djc.

Messages
msg11584 (view) Author: djc Date: 2010-02-03.17:09:03
It's been working pretty well for a while, though there are still some edge
cases. Anyway, if hg convert works well for you, not much need to switch!
msg11582 (view) Author: ro Date: 2010-02-03.16:44:33
> Dirkjan Ochtman <dirkjan@ochtman.nl> added the comment:
>
> You may want to try with hgsubversion.

I'll give it a try at some point, though I don't have an idea how
stable/usable it is right now.

Thanks.
        Rainer
msg11581 (view) Author: ro Date: 2010-02-03.16:43:49
> Patrick Mézard <pmezard@gmail.com> added the comment:
>
> Tags conversion may be really slow. It can be disabled with something like:
>
> --config convert.svn.tags=

Excellent tip: that brought the conversion time down from 12+ hours to 7
minutes :-)  Perhaps a corresponding warning could be added to hg
convert -h output?

Thanks.
        Rainer
msg11569 (view) Author: pmezard Date: 2010-02-02.20:03:00
Tags conversion may be really slow. It can be disabled with something like:

--config convert.svn.tags=
msg11566 (view) Author: djc Date: 2010-02-02.19:41:57
You may want to try with hgsubversion.
msg11564 (view) Author: ro Date: 2010-02-02.19:37:05
I'm currently using hg 1.4.1 with python 2.6.4 and subversion 1.6.6 to
regularly convert a local copy of the GCC svn repository (available via
rsync, cf. http://gcc.gnu.org/rsync.html) to a hg repository.  This is
running on a Sun Fire V880 with 6 1050 MHz CPUs, 12 GB RAM and local disks.
While the initial conversion took several days and a couple of restarts
(VM exhausted; I've been using 32-bit binaries), it finally completed.
I'm currently running regular incremental conversions after updating the
local copy of the svn repository.  Unfortunately, they are extremely slow:
although only about 30-60 revisions are added per day, the conversion takes
on the order of 12 to 13 hours.  I'm simply running

$ hg convert svn/repo hg/repo

I can hardly believe that this must be this slow.
History
Date User Action Args
2010-02-03 17:09:03djcsetnosy: pmezard, djc, ro
messages: + msg11584
2010-02-03 16:44:33rosetnosy: pmezard, djc, ro
messages: + msg11582
2010-02-03 16:43:49rosetnosy: pmezard, djc, ro
messages: + msg11581
2010-02-02 20:03:00pmezardsettopic: + convert, svn
nosy: + pmezard
messages: + msg11569
2010-02-02 19:41:58djcsetstatus: unread -> chatting
nosy: + djc
messages: + msg11566
2010-02-02 19:37:05rocreate