From users-return-27305-archive-asf-public=cust-asf.ponee.io@subversion.apache.org Fri Jul 13 23:00:40 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 4BC8E180626 for ; Fri, 13 Jul 2018 23:00:39 +0200 (CEST) Received: (qmail 97088 invoked by uid 500); 13 Jul 2018 21:00:38 -0000 Mailing-List: contact users-help@subversion.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list users@subversion.apache.org Delivered-To: moderator for users@subversion.apache.org Received: (qmail 8987 invoked by uid 99); 13 Jul 2018 20:01:26 -0000 X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.988 X-Spam-Level: * X-Spam-Status: No, score=1.988 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=inadvantage.onmicrosoft.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inadvantage.onmicrosoft.com; s=selector1-inadvantage-com0e; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qsqtCIRj3Slh+CAirlVfrfyJMDetCXuw6+JGgmSjwQc=; b=Q+lJN+vd1MkjTCWG8rb6afPGlgtNvl0AaAvJeZ5BEW1V1JsznqgsECX75wpKIPizCdiGlRLMl9axEamuU/94SkvBUKYQoaNLsTe/cbVFb+DnqfOdmKWnIrFWmZUg6WpSne5tOIzSb98kH7YM0u2yY2bg4BpA32UBCv3NasOLGQ8= From: Colin Foster To: "users@subversion.apache.org" Subject: svnsync fails to replicate large revision Thread-Topic: svnsync fails to replicate large revision Thread-Index: AdQa4HCElFps42wYQ4Wz6KrQVE5U+A== Date: Fri, 13 Jul 2018 20:01:13 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=colin.Foster@in-advantage.com; x-originating-ip: [96.93.101.165] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;CY4PR10MB1478;7:fLtowNJllX9sB8ctFAc9snejSE2tDreiJXsbO8TVkvd17k0ugeHpCl9DATkG6hlmiO2MKCM63oL6Lk5pJwoG+sWabqh4i0t6zvSD/vmauVIoBYUV8p258GJtziOrB44Mp4iqo+6ZjsYd8BEztwAtgTaBKetMWvuubria4bZqVs0QdLRXpeAqEAIPSER44FpGteEGDw748HdD2qDysLp/tdhCdGRiQqhf3AQ9lckHi/QW+gJzHDHBoIlrZHlsd6zN x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: 44631e56-112d-4d4a-3237-08d5e8fb633b x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652040)(7021125)(8989117)(5600053)(711020)(4534165)(7022125)(4603075)(4627221)(201702281549075)(8990107)(7048125)(7024125)(7027125)(7028125)(7023125)(2017052603328)(7153060)(49563074)(7193020);SRVR:CY4PR10MB1478; x-ms-traffictypediagnostic: CY4PR10MB1478: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(28532068793085)(158342451672863)(21748063052155); x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(102415395)(6040522)(2401047)(8121501046)(5005006)(10201501046)(3231311)(944501410)(52105095)(3002001)(93006095)(93001095)(149027)(150027)(6041310)(20161123560045)(20161123562045)(20161123564045)(2016111802025)(20161123558120)(6043046)(6072148)(201708071742011)(7699016);SRVR:CY4PR10MB1478;BCL:0;PCL:0;RULEID:;SRVR:CY4PR10MB1478; x-forefront-prvs: 07326CFBC4 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(136003)(366004)(346002)(376002)(39830400003)(396003)(189003)(199004)(6306002)(6916009)(8676002)(6436002)(81166006)(99936001)(102836004)(2906002)(66066001)(8936002)(55016002)(74316002)(9686003)(81156014)(733005)(99286004)(316002)(7736002)(478600001)(53936002)(5640700003)(54896002)(1730700003)(5250100002)(86362001)(476003)(236005)(54556002)(486006)(33656002)(3846002)(25786009)(186003)(2900100001)(14454004)(5660300001)(2501003)(97736004)(6116002)(790700001)(68736007)(105586002)(14444005)(6506007)(106356001)(7696005)(2351001)(256004)(26005)(9326002);DIR:OUT;SFP:1102;SCL:1;SRVR:CY4PR10MB1478;H:CY4PR10MB1894.namprd10.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;MX:1;A:1; received-spf: None (protection.outlook.com: in-advantage.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: cc6IkfBT3lHRiulvwrzrJ6NUF9MS7oaIgdlRuFu+hzayxXoOymydvFe1TPMb2jON7RqDDXpTOxcbjnDpwBlpj9qgSRj0z2KsGNlJWowmYOr7pkZp0St0jAagS13tNMI1spcDIdx5n/1g94bsdl5uRoyig+IWuqtLa3YnoXt+VJMrwmVnSEyMydKeXsfxLvEv1YgfqahYSQ008ARI+mOJuxUFC7E6ubrUhD7IUCJIy7yPKJp747uH8YYEzpY2V4RDkn3YkkvQmNDk1WcTBBwun0iwQVvmT/L0RzyoT6qjsBr6ZQWJKHKq7p00eI121QgGQlWKjmYzdhET3STw7bOnFr98uuaj9UhbmDiBFmk5wGg= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/related; boundary="_004_CY4PR10MB18947BB949D6D7EDDBF01B99A4580CY4PR10MB1894namp_"; type="multipart/alternative" MIME-Version: 1.0 X-OriginatorOrg: in-advantage.com X-MS-Exchange-CrossTenant-Network-Message-Id: 44631e56-112d-4d4a-3237-08d5e8fb633b X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Jul 2018 20:01:13.9950 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 48e842ca-fbd8-4633-a79d-0c955a7d3aae X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR10MB1478 --_004_CY4PR10MB18947BB949D6D7EDDBF01B99A4580CY4PR10MB1894namp_ Content-Type: multipart/alternative; boundary="_000_CY4PR10MB18947BB949D6D7EDDBF01B99A4580CY4PR10MB1894namp_" --_000_CY4PR10MB18947BB949D6D7EDDBF01B99A4580CY4PR10MB1894namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hello, I'm not sure if this is a "bug", a "configuration issue", or simply a netwo= rk issue. I'm hoping it is just a configuration issue. I'm creating an off-site replica of our SVN server. Our current server is r= unning the latest CollabNet SVNEdge server. Subversion version 1.8.19-4419.= 51 There was a large commit that fails after an indeterminate amount of time -= sometimes 45 minutes, sometime 4.5 hours. I've been tinkering with Timout = and KeepAlive settings to no avail. The error I continue to see when the failure happens is: [Fri Jul 13 11:22:33.773429 2018] [dav:error] [pid 1906] [client XX:38654] = Provider encountered an error while streaming a REPORT response. [500, #0] [Fri Jul 13 11:22:33.773445 2018] [dav:error] [pid 1906] [client XX:38654] = Problem replaying revision [500, #104] [Fri Jul 13 11:22:33.773448 2018] [dav:error] [pid 1906] [client XX:38654] = Error writing base64 data: Connection reset by peer [500, #104] The initial requests are seen here: [13/Jul/2018:09:45:46 -0700] gregc IA rev-proplist r18116 9 With the failure showing up as such (note the timestamp of the two messages= ): [13/Jul/2018:11:20:01 -0700] jenkins IA get-dir / /trunk r44281 props 0 [13/Jul/2018:09:45:54 -0700] gregc IA replay / r18116 5799 Relevant settings: Bulk updates allowed. I've tried preferring but that didn't seem to fix the= issue Timeout: I've set it between 12,000 and 120,000. Issue not fixed KeepAlive: Yes (always) MaxKeelAliveRequests: I've set it between 10,000 and 100,000 KeepAliveTimeout: I've set it between 15 and 900 Compression set to 5 Server cache: 64 MB, enabled for Full Texts, Deltas, and RevProps I have had to remove "mod_deflate" from loading - I believe this was due to= crashes when transferring files > 4GB. The server seems to be syncing at about 500KBps (4Mbps). The file "db/revs/= 18/18116" is 441 MB on disk: FSFS V6, Repo format 5, Not packed. This is supposedly the message the client is exiting with (garbled with the= output of "time"?): 57:43.26 .svnsync: E175002: REPORT request on '/svn/IA/!svn/rev/18116' failed Command exited with non-zero status 1 1158.67user 425.49system 57:43.26elapsed 45%CPU (0avgtext+0avgdata 35588max= resident)k 216336inputs+1877472outputs (19major+808715minor)pagefaults 0swaps That is all the relevant information I can think of in this instance. Seemi= ngly the client is terminating the "svnsync synchronize" request. Or is thi= s something in the server settings that is causing this issue? Or could thi= s be something else? Thank you very much! [143421_logo_final_25] Colin Foster Software Engineer Tel 262-409-9898 colin.foster@in-advantage.com www.in-advantage.com --_000_CY4PR10MB18947BB949D6D7EDDBF01B99A4580CY4PR10MB1894namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hello,

 

I’m not sure if this is a “bug”, a= “configuration issue”, or simply a network issue. I’m ho= ping it is just a configuration issue.

 

I’m creating an off-site replica of our SVN se= rver. Our current server is running the latest CollabNet SVNEdge server. Su= bversion version 1.8.19-4419.51

 

There was a large commit that fails after an indeter= minate amount of time – sometimes 45 minutes, sometime 4.5 hours. I&#= 8217;ve been tinkering with Timout and KeepAlive settings to no avail.

 

The error I continue to see when the failure happens= is:

[Fri Jul= 13 11:22:33.773429 2018] [dav:error] [pid 1906] [client XX:38654] Provider= encountered an error while streaming a REPORT response.  [500, #0]

[Fri Jul= 13 11:22:33.773445 2018] [dav:error] [pid 1906] [client XX:38654] Problem = replaying revision  [500, #104]

[Fri Jul= 13 11:22:33.773448 2018] [dav:error] [pid 1906] [client XX:38654] Error wr= iting base64 data: Connection reset by peer  [500, #104]

 

 

The initial requests are seen here:

 

[13/Jul/2018:09:45:46 -0700] gregc IA rev-proplist r18116 9<=
o:p>

 

With the failure showing up as such (note the timest= amp of the two messages):

[13/Jul/2018:11:20:01 -0700] jenkins IA get-dir / /trunk r44=
281 props 0
[13/Jul/2018:09:45:54 -0700] gregc IA replay / r18116 5799

 

 

Relevant settings:

Bulk updates allowed. I’ve tried preferring bu= t that didn’t seem to fix the issue

Timeout: I’ve set it between 12,000 and 120,00= 0. Issue not fixed

KeepAlive: Yes (always)

MaxKeelAliveRequests: I’ve set it between 10,0= 00 and 100,000

KeepAliveTimeout: I’ve set it between 15 and 9= 00

Compression set to 5

Server cache: 64 MB, enabled for Full Texts, Deltas,= and RevProps

 

I have had to remove “mod_deflate” from = loading – I believe this was due to crashes when transferring files &= gt; 4GB.

 

 

The server seems to be syncing at about 500KBps (4Mb= ps). The file “db/revs/18/18116” is 441 MB on disk: FSFS V6, Re= po format 5, Not packed.

 

This is supposedly the message the client is exiting= with (garbled with the output of “time”?):

57:43.26

.svnsync: E175002: REPORT request on '/svn/IA/!svn/rev/18116'= failed

Command exited with non-zero status 1

1158.67user 425.49system 57:43.26elapsed 45%CPU (0avgtext+= ;0avgdata 35588maxresident)k

216336inputs+1877472outputs (19major+808715minor)page= faults 0swaps

 

 

 

That is all the relevant information I can think of = in this instance. Seemingly the client is terminating the “svnsync sy= nchronize” request. Or is this something in the server settings that = is causing this issue? Or could this be something else?

 

 

Thank you very much!

 

3D"143421_logo_final_25"=

Colin Foster

Software Engineer=

Tel 262-409-9898 =

colin.foster@in-advan= tage.com

www.in-advantage.com<= /o:p>

 

--_000_CY4PR10MB18947BB949D6D7EDDBF01B99A4580CY4PR10MB1894namp_-- --_004_CY4PR10MB18947BB949D6D7EDDBF01B99A4580CY4PR10MB1894namp_ Content-Type: image/jpeg; name="image001.jpg" Content-Description: image001.jpg Content-Disposition: inline; filename="image001.jpg"; size=1705; creation-date="Fri, 13 Jul 2018 20:01:13 GMT"; modification-date="Fri, 13 Jul 2018 20:01:13 GMT" Content-ID: Content-Transfer-Encoding: base64 /9j/4AAQSkZJRgABAQEAYABgAAD/2wBDAAoHBwgHBgoICAgLCgoLDhgQDg0NDh0VFhEYIx8lJCIf IiEmKzcvJik0KSEiMEExNDk7Pj4+JS5ESUM8SDc9Pjv/2wBDAQoLCw4NDhwQEBw7KCIoOzs7Ozs7 Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozv/wAARCAAeAGMDASIA AhEBAxEB/8QAHwAAAQUBAQEBAQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAAAgEDAwIEAwUFBAQA AAF9AQIDAAQRBRIhMUEGE1FhByJxFDKBkaEII0KxwRVS0fAkM2JyggkKFhcYGRolJicoKSo0NTY3 ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqDhIWGh4iJipKTlJWWl5iZmqKjpKWm p6ipqrKztLW2t7i5usLDxMXGx8jJytLT1NXW19jZ2uHi4+Tl5ufo6erx8vP09fb3+Pn6/8QAHwEA AwEBAQEBAQEBAQAAAAAAAAECAwQFBgcICQoL/8QAtREAAgECBAQDBAcFBAQAAQJ3AAECAxEEBSEx BhJBUQdhcRMiMoEIFEKRobHBCSMzUvAVYnLRChYkNOEl8RcYGRomJygpKjU2Nzg5OkNERUZHSElK U1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6goOEhYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3 uLm6wsPExcbHyMnK0tPU1dbX2Nna4uPk5ebn6Onq8vP09fb3+Pn6/9oADAMBAAIRAxEAPwD0HWfG mn6c9xawMZ7uH5XVRlYz/tGq9v4jvreGK7uPLvLKX/lrD/CfT2I9DWBqlqPD3jq5e+AGla6GjaQ9 EY4OT9G/Q1lO2oeDtVmKx+fZMdt1atyrr6j8OhoxFGEnFQk4ya0fRvs/M4VVqKTctl96/wAz1q1u 4L23W4t5BJG/QisaXU76LV57S3jSdpbkRxiVyqxDyQ5PA9f51m2+ufY7i2vraQS6LdqAgUf6vjBB /wBoY5rol0y2e+GoK7F2k80YPyklNn5YqKNVNyjNarc6neSTiUV1nUZrqOxhs7cXW6VZWeU7F2bT kYGSCHFOh1m9vmFtaWsK3KBjcea52JhymBgZOSp/Cp4rfT4ddJW4P211eXyi38LbQTj/AIAP1plx pNtaK94l7NZspdnmUg/KzbiCCCCMnj0ro93sTaXcjh8RAeeLu38gwROxAbOWQ4dR69VI9d1Iurap NBNPb2EBW2GJUeUhncDLKvGOM4yepqw/h+xkgtonEjfZpvODFvmdicnce+TyfoKLnQ0uHn8u8ube K6/18UTABzjBOSMqSOuKLwC0zJTVtTmumlKosUgtWijWU5BfPB46Hv8ASrdx4njhs4LhYN2+HzJV LY8s7ggUn/fJH4Grg0W0gRW3yBYhDyT0EWdv/wBemwaLp0kV3JFudNRIlZg3TuCvpz831NDcH0Eo zXUi0zXHur8Wc32aQuhdJLZ2ZRjGVbIGDzwe/NbVUrTTmt5zPNe3F1Jt2L5pACj6AAZ9+tXaiVr6 Gsb21CiiipKMzxBodt4h0mSwueN3KSAcow6EVx0r29xdt4cvoWtLq1Hl2c877hcJ2DE+vb8q9ErM 1rQbHXbcRXcfzr/q5V4ZD7H+lVaE4unU+H8vMwqwl8UN/wAzzvQVfStWvfC2oZjgu1Mlv5nHlyAc fnjH4Cu68I3Tz6L5cp5t3MYJ9Ov9azovA8kuqWl1qmpNeRWSlYUK4Yg9mPoK6m3t4bWEQwRLHGvR VGBWdWn++jNSvpZvuTh1JR1VjmG/tAk68LeLyxcecDubzfIA2Y24/u5brVPUWsZNHumupZzrBdgV Vm3/AHuAF6bNuPbHvXcUmB1xW6qW6FulpucvJ/aPnz6Vb+aWsvMuY5Dn5wQTEue+GJ4/2B61UmfT A2nHTri5a7aT9/h3LH5Gz5oPQ59e9dpikwPTrQqnkDpeZyg0yGGw07aJibu2ZbndIxMn7rd83PXI qKzi06CKGHVmeGBbSJrVWd1XlcuRg8vu/HpiuxpMD0o9ow9kuhxeltavBD/bks/2fyM2xuGZcne+ 4nH8f3evPpVa2keSGH7ZMpstsnkNfvIu5vNfOSP4sbev4V2N7pkV5KsxmuIJFXbvglKEr6Gp7a1h tLZLeGMLFGMKvWq9qtyVSd7FfRRcDRrX7VI0kuzlnUqxHbIPOcY60VeorFu7ubpWVj//2Q== --_004_CY4PR10MB18947BB949D6D7EDDBF01B99A4580CY4PR10MB1894namp_--