hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Konstantin Kolinko <knst.koli...@gmail.com>
Subject SVN EU sync delays for 20 minutes triggered by commits to hbase website
Date Tue, 28 Oct 2014 00:16:15 GMT
CC: infrastructure

Hi!

I am observing significant delays in replication between main US svn
server and its EU mirror. The delays are up to 20 minutes.

I observed this behavior several times, the first one was on
2014-10-22, and in all times the apparent cause was a commit
publishing an update to hbase web site. Sample commit: r1634723

Questions:
=========

1) There may be some misconfiguration at infrastructure, because when
I visit the live http://hbase.apache.org/  site, I do not see it being
updated by those commits.  Is that 20 min delay caused by some real
work, or just waiting on a timeout?

2) I think that the size of this commit is unnecessary big and can be
made smaller by reconfiguration in hbase project.


Full story
========

I am working on Apache Tomcat. I am located in Europe and my svn
client is expected to contact the EU write-through mirror of
Subversion.

This mis-synchronization of SVN servers manifests in the following way:

1) I do a "svn commit"
2) I do a "svn update" after a short pause.
The update fails,
[[[
Updating '.':
svn: E160006: No such reported revision '1634735' found in the
repository.  Perhaps the repository
 is out of date with respect to the master repository?
]]]

3) I go to https://svn-us.apache.org/repos/asf/
The page says that US server is at revision 1634735

4) I go to https://svn-eu.apache.org/repos/asf/
The page says that EU server is at revision 1634722

5) I go to http://svn-us.apache.org/viewvc?view=revision&revision=1634723
The page says that the commit was done 21 minutes ago.

So the EU server is lagging for 20 minutes.

The r1634723 commit was changing 6K+ files in /hbase/hbase.apache.org/trunk/.

Most of this commit are changes in time stamp on every page, such as
[[[
--- hbase/hbase.apache.org/trunk/apidocs/com/google/protobuf/HBaseZeroCopyByteString.html
2014/10/27 22:53:37 1634722
+++ hbase/hbase.apache.org/trunk/apidocs/com/google/protobuf/HBaseZeroCopyByteString.html
2014/10/27 22:55:29 1634723
@@ -2,10 +2,10 @@
 <!-- NewPage -->
 <html lang="en">
 <head>
-<!-- Generated by javadoc (version 1.7.0_65) on Mon Oct 27 16:00:28
EST 2014 -->
+<!-- Generated by javadoc (version 1.7.0_65) on Tue Oct 28 08:14:59
EST 2014 -->
 <meta http-equiv="Content-Type" content="text/html" charset="UTF-8">
 <title>HBaseZeroCopyByteString (HBase 2.0.0-SNAPSHOT API)</title>
-<meta name="date" content="2014-10-27">
+<meta name="date" content="2014-10-28">
 <link rel="stylesheet" type="text/css" href="../../../stylesheet.css"
title="Style">
 </head>
 <body>
]]]

I know that Javadoc can be configured to do not generate such
timestamps by passing "-notimestamp" command-line option. [1]  I
configured Tomcat with that option in r1633500. [2]

Can hbase project be reconfigured to do not include timestamps in
generated javadoc?


If I visit HBase site -> User API section [3]
and open the HTML source text of a random Javadoc page, I do not see
those timestamp comments. It is as if the changes are not actually
published to the live web site.


[1] http://docs.oracle.com/javase/7/docs/technotes/tools/solaris/javadoc.html#standard
[2] http://svn.apache.org/viewvc?view=revision&revision=1633500

[3] http://hbase.apache.org/apidocs/index.html

Best regards,
Konstantin Kolinko

Mime
View raw message