Mailing-List: contact dev-help@subversion.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
From: Paul Hammant <paul@hammant.org>
Date: Sat, 8 Jul 2017 09:36:20 -0400
Message-ID: <CA+298Ugv-iQWQaPM2P4JvZbvWxiYrPSzRTQV5ikXu6E_+8jrPw@mail.gmail.com>
Subject: Big files PUT into Subversion - encountering
To: Subversion Development <dev@subversion.apache.org>
Content-Type: multipart/alternative; boundary="001a113cd1126746500553ce6f00"
archived-at: Sat, 08 Jul 2017 13:36:28 -0000

--001a113cd1126746500553ce6f00
Content-Type: text/plain; charset="UTF-8"

Same system as before - 4GB RAM Intel Atom Linux box
<https://www.reddit.com/r/chinapcs/comments/6ksrsi/chuwi_hibox_smart_mini_pc_4g_64g_quad_core_intel/>,
with attached 4TB USB3 driver (yes in a USB3 port) where the svn repo's
root is.

AutoIncrement is turned on (or whatever it's called), and I'm using curl to
PUT a resource.  Like so:

#!/bin/bash

while :
do
    time dd if=/dev/zero bs=1M count=15000 2>/dev/null | openssl enc
-rc4-40 -pass pass:weak > /path/to/abc
    time curl -u paul:myPassword http://192.168.1.178/svn/svnRepo1/abc
--upload-file /path/to/abc
    du -s -h --block-size=1G /media/thatLittle4TBdrive/svnParent/
done

 Fifth iteration of that loop barfed in about 1/4 of the time the transfer
would have taken :(

<?xml version="1.0" encoding="utf-8"?>
<D:error xmlns:D="DAV:" xmlns:m="http://apache.org/dav/xmlns"
xmlns:C="svn:">
<C:error/>
<m:human-readable errcode="200029">
Couldn't perform atomic initialization
</m:human-readable>
</D:error>

What does that mean?  Programatically, should I just try the PUT again ?


*For those interested in stats: 6.5 mins to create each 14GB random file,
and 15 mins to PUT it into Svn (with it's 6 syncs on the server side). And
I've filled a 4TB drive up to 1.3TB so far.*

- Paul

--001a113cd1126746500553ce6f00
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Same system as before - <a href=3D"https://www.reddit.com/=
r/chinapcs/comments/6ksrsi/chuwi_hibox_smart_mini_pc_4g_64g_quad_core_intel=
/">4GB RAM Intel Atom Linux box</a>, with attached 4TB USB3 driver (yes in =
a USB3 port) where the svn repo&#39;s root is.<div><br></div><div>AutoIncre=
ment is turned on (or whatever it&#39;s called), and I&#39;m using curl to =
PUT a resource.=C2=A0 Like so:</div><div><br></div><blockquote style=3D"mar=
gin:0px 0px 0px 40px;border:none;padding:0px"><pre style=3D"color:rgb(0,0,0=
);font-family:Menlo;font-size:9pt">#!/bin/bash</pre><pre style=3D"color:rgb=
(0,0,0);font-family:Menlo;font-size:9pt">while :
do
    time dd if=3D/dev/zero bs=3D1M count=3D15000 2&gt;/dev/null | openssl e=
nc -rc4-40 -pass pass:weak &gt; /path/to/abc
    time curl -u paul:myPassword <a href=3D"http://192.168.1.178/svn/svnRep=
o1/abc">http://192.168.1.178/svn/svnRepo1/abc</a> --upload-file /path/to/ab=
c
    du -s -h --block-size=3D1G /media/thatLittle4TBdrive/svnParent/
done</pre></blockquote><div>=C2=A0Fifth iteration of that loop barfed in ab=
out 1/4 of the time the transfer would have taken :(</div><blockquote style=
=3D"margin:0 0 0 40px;border:none;padding:0px"><div><p class=3D"gmail-p1"><=
span class=3D"gmail-s1">&lt;?xml version=3D&quot;1.0&quot; encoding=3D&quot=
;utf-8&quot;?&gt;<br></span>&lt;D:error xmlns:D=3D&quot;DAV:&quot; xmlns:m=
=3D&quot;<a href=3D"http://apache.org/dav/xmlns">http://apache.org/dav/xmln=
s</a>&quot; xmlns:C=3D&quot;svn:&quot;&gt;<br>&lt;C:error/&gt;<br>&lt;m:hum=
an-readable errcode=3D&quot;200029&quot;&gt;<br>Couldn&#39;t perform atomic=
 initialization<br>&lt;/m:human-readable&gt;<br>&lt;/D:error&gt;</p></div><=
/blockquote>What does that mean?=C2=A0 Programatically, should I just try t=
he PUT again ? =C2=A0<div><br></div><div><i>For those interested in stats: =
6.5 mins to create each 14GB random file, and 15 mins to PUT it into Svn (w=
ith it&#39;s 6 syncs on the server side). And I&#39;ve filled a 4TB drive u=
p to 1.3TB so far.<br></i><div><br></div><div>- Paul</div></div></div>

--001a113cd1126746500553ce6f00--