hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tony Stevenson <pct...@apache.org>
Subject Re: SVN EU sync delays for 20 minutes triggered by commits to hbase website
Date Tue, 28 Oct 2014 09:02:54 GMT
Hi,

This is to be expected, its the way that the SVN master and mirror
operates.  The master has to send the entirety of the revision to the
mirror before the mirror can accept new commits.  In fact when you
commit to the EU mirror it proxies those to the US master, which then
replays that back to the EU mirror.

On the aspect of asking the hbase PMC to change their build, this is
not something that Infrastructure would typically get involved in,
unless it is significantly detrimental to the infrastructure. In this
case I dont think it is. They aren't breaking things, they are just
causing things to slow down for a short period. While I appreciate
this might be irritating for those affected by the transaction.  If
this is sufficiently irritating for you, can I ask you to take this up
with the hbase PMC directly.





On 28 October 2014 00:16, Konstantin Kolinko <knst.kolinko@gmail.com> wrote:
> CC: infrastructure
>
> Hi!
>
> I am observing significant delays in replication between main US svn
> server and its EU mirror. The delays are up to 20 minutes.
>
> I observed this behavior several times, the first one was on
> 2014-10-22, and in all times the apparent cause was a commit
> publishing an update to hbase web site. Sample commit: r1634723
>
> Questions:
> =========
>
> 1) There may be some misconfiguration at infrastructure, because when
> I visit the live http://hbase.apache.org/  site, I do not see it being
> updated by those commits.  Is that 20 min delay caused by some real
> work, or just waiting on a timeout?
>
> 2) I think that the size of this commit is unnecessary big and can be
> made smaller by reconfiguration in hbase project.
>
>
> Full story
> ========
>
> I am working on Apache Tomcat. I am located in Europe and my svn
> client is expected to contact the EU write-through mirror of
> Subversion.
>
> This mis-synchronization of SVN servers manifests in the following way:
>
> 1) I do a "svn commit"
> 2) I do a "svn update" after a short pause.
> The update fails,
> [[[
> Updating '.':
> svn: E160006: No such reported revision '1634735' found in the
> repository.  Perhaps the repository
>  is out of date with respect to the master repository?
> ]]]
>
> 3) I go to https://svn-us.apache.org/repos/asf/
> The page says that US server is at revision 1634735
>
> 4) I go to https://svn-eu.apache.org/repos/asf/
> The page says that EU server is at revision 1634722
>
> 5) I go to http://svn-us.apache.org/viewvc?view=revision&revision=1634723
> The page says that the commit was done 21 minutes ago.
>
> So the EU server is lagging for 20 minutes.
>
> The r1634723 commit was changing 6K+ files in /hbase/hbase.apache.org/trunk/.
>
> Most of this commit are changes in time stamp on every page, such as
> [[[
> --- hbase/hbase.apache.org/trunk/apidocs/com/google/protobuf/HBaseZeroCopyByteString.html
> 2014/10/27 22:53:37 1634722
> +++ hbase/hbase.apache.org/trunk/apidocs/com/google/protobuf/HBaseZeroCopyByteString.html
> 2014/10/27 22:55:29 1634723
> @@ -2,10 +2,10 @@
>  <!-- NewPage -->
>  <html lang="en">
>  <head>
> -<!-- Generated by javadoc (version 1.7.0_65) on Mon Oct 27 16:00:28
> EST 2014 -->
> +<!-- Generated by javadoc (version 1.7.0_65) on Tue Oct 28 08:14:59
> EST 2014 -->
>  <meta http-equiv="Content-Type" content="text/html" charset="UTF-8">
>  <title>HBaseZeroCopyByteString (HBase 2.0.0-SNAPSHOT API)</title>
> -<meta name="date" content="2014-10-27">
> +<meta name="date" content="2014-10-28">
>  <link rel="stylesheet" type="text/css" href="../../../stylesheet.css"
> title="Style">
>  </head>
>  <body>
> ]]]
>
> I know that Javadoc can be configured to do not generate such
> timestamps by passing "-notimestamp" command-line option. [1]  I
> configured Tomcat with that option in r1633500. [2]
>
> Can hbase project be reconfigured to do not include timestamps in
> generated javadoc?
>
>
> If I visit HBase site -> User API section [3]
> and open the HTML source text of a random Javadoc page, I do not see
> those timestamp comments. It is as if the changes are not actually
> published to the live web site.
>
>
> [1] http://docs.oracle.com/javase/7/docs/technotes/tools/solaris/javadoc.html#standard
> [2] http://svn.apache.org/viewvc?view=revision&revision=1633500
>
> [3] http://hbase.apache.org/apidocs/index.html
>
> Best regards,
> Konstantin Kolinko



-- 


Cheers,
Tony

----------------------------------
Tony Stevenson

tony@pc-tony.com
pctony@apache.org

http://www.pc-tony.com

GPG - 1024D/51047D66
----------------------------------

Mime
View raw message