hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Artem Ervits <artemerv...@gmail.com>
Subject Re: [VOTE] The second HBase 1.4.2 release candidate (RC1) is available
Date Tue, 27 Feb 2018 03:10:35 GMT
Andrew, please see HBASE-20091

On Feb 26, 2018 10:09 PM, "Andrew Purtell" <apurtell@apache.org> wrote:

> Thanks Artem, appreciate the report.
>
> HBASE-20096
>
>
> On Mon, Feb 26, 2018 at 1:21 PM, Artem Ervits <artemervits@gmail.com>
> wrote:
>
> > Ted's correct, I mistakenly pulled the wrong hbase-site. Please see other
> > warning on missing plugin version.
> >
> > On Feb 26, 2018 4:12 PM, "Ted Yu" <yuzhihong@gmail.com> wrote:
> >
> > > Artem:
> > > Please check your hbase-site.xml and remove BackupLogCleaner which
> should
> > > be left over from another deployment.
> > >
> > > Cheers
> > >
> > > On Mon, Feb 26, 2018 at 1:07 PM, Andrew Purtell <apurtell@apache.org>
> > > wrote:
> > >
> > > > Thanks for the vote Artem.
> > > >
> > > > ​> FAILURE! - in org.apache.hadoop.hbase.http.TestSpnegoHttpServer
> > > >
> > > > Is this due to the same reason as before? The minikdc doesn't come up
> > > > because of a missing configuration file directory? Perhaps with your
> > > Linux
> > > > variant installing the client package isn't enough, you'll also have
> to
> > > put
> > > > in place a valid configuration?
> > > >
> > > > > java.lang.ClassNotFoundException: org.apache.hadoop.hbase.
> > > > backup.master.BackupLogCleaner
> > > >
> > > > This class doesn't exist in HBase 1.x so I am confused as to how this
> > is
> > > > possible.
> > > >
> > > >
> > > > On Mon, Feb 26, 2018 at 1:01 PM, Artem Ervits <artemervits@gmail.com
> >
> > > > wrote:
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > Hadoop Pseudo-distrbibuted: 2.7.5
> > > > > $M2_HOME from scratch
> > > > > Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d;
> > > > > 2017-10-18T07:58:13Z)
> > > > > Maven home: /opt/maven/apache-maven-3.5.2
> > > > > Java version: 1.8.0_161, vendor: Oracle Corporation
> > > > > Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.
> > > > > x86_64/jre
> > > > > Default locale: en_US, platform encoding: UTF-8
> > > > > OS name: "linux", version: "3.10.0-693.11.6.el7.x86_64", arch:
> > "amd64",
> > > > > family: "unix"
> > > > >
> > > > > Binary Release:
> > > > > Java 1M rows: OK
> > > > > LTT 1M rows: OK
> > > > > PE 1M rows: OK
> > > > > MD5: OK
> > > > >
> > > > > hbase shell: OK
> > > > > create, list, scan, count, truncate, disable, drop
> > > > > snapshot, restore_snapshot
> > > > > UI: OK
> > > > >
> > > > > Source Release:
> > > > > Build with: mvn clean -DskipTests -Dhadoop-two.version=2.7.5
> install
> > &&
> > > > mvn
> > > > > clean -DskipTests -Dhadoop-two.version=2.7.5 package
> assembly:single
> > > > > MD5: OK
> > > > >         installed and ran from src: OK
> > > > >
> > > > > reviewed the logs, all OK except for master:
> > > > >
> > > > > 2018-02-26 20:12:47,478 WARN  [hadoop:16000.activeMasterManager]
> > > > > cleaner.CleanerChore: Can NOT create CleanerDelegate:
> > > > > org.apache.hadoop.hbase
> > > > > .backup.master.BackupLogCleaner
> > > > > java.lang.ClassNotFoundException:
> > > > > org.apache.hadoop.hbase.backup.master.BackupLogCleaner
> > > > >         at java.net.URLClassLoader.findClass(URLClassLoader.java:
> > 381)
> > > > >         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > > > >         at sun.misc.Launcher$AppClassLoader.loadClass(
> > > Launcher.java:338)
> > > > >         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > > > >         at java.lang.Class.forName0(Native Method)
> > > > >         at java.lang.Class.forName(Class.java:264)
> > > > >         at
> > > > > org.apache.hadoop.hbase.master.cleaner.CleanerChore.
> > > > > newFileCleaner(CleanerChore.java:109)
> > > > >         at
> > > > > org.apache.hadoop.hbase.master.cleaner.CleanerChore.
> > > > > initCleanerChain(CleanerChore.java:91)
> > > > >         at
> > > > > org.apache.hadoop.hbase.master.cleaner.CleanerChore.<
> > > > > init>(CleanerChore.java:71)
> > > > >         at
> > > > > org.apache.hadoop.hbase.master.cleaner.LogCleaner.<
> > > > > init>(LogCleaner.java:49)
> > > > >         at
> > > > > org.apache.hadoop.hbase.master.HMaster.
> startServiceThreads(HMaster.
> > > > > java:1222)
> > > > >         at
> > > > > org.apache.hadoop.hbase.master.HMaster.
> > finishActiveMasterInitializati
> > > > > on(HMaster.java:781)
> > > > >         at
> > > > > org.apache.hadoop.hbase.master.HMaster.access$600(
> HMaster.java:205)
> > > > >         at org.apache.hadoop.hbase.master.HMaster$2.run(HMaster.
> > > > java:2023)
> > > > >         at java.lang.Thread.run(Thread.java:748)
> > > > >
> > > > >
> > > > > Noticed the following:
> > > > >
> > > > > *[WARNING]*
> > > > > *[WARNING] Some problems were encountered while building the
> > effective
> > > > > model for org.apache.hbase:hbase-shaded-
> check-invariants:pom:1.4.2*
> > > > > *[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:
is
> > > > > missing. @
> > > > > org.apache.hbase:hbase-shaded-check-invariants:[unknown-version],
> > > > > /tmp/hbase-1.4.2/hbase-shaded/hbase-shaded-check-invariants/
> pom.xml,
> > > > line
> > > > > 161, column 15*
> > > > > *[WARNING]*
> > > > > *[WARNING] It is highly recommended to fix these problems because
> > they
> > > > > threaten the stability of your build.*
> > > > > *[WARNING]*
> > > > > *[WARNING] For this reason, future Maven versions might no longer
> > > support
> > > > > building such malformed projects.*
> > > > >
> > > > > this is addressed in master
> > > > > https://github.com/apache/hbase/blob/master/hbase-
> > > > > shaded/hbase-shaded-check-invariants/pom.xml#L164
> > > > >
> > > > > ran the
> > > > >
> > > > > mvn test -P runSmallTests: not OK
> > > > >
> > > > > I pointed it out in hbase-1.4.1 vote and perhaps it is due to my
> dev
> > > env
> > > > > though I did try installing Kerberos libs previously and errors
> > > > persisted.
> > > > >
> > > > >
> > > > > *[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time
> > > > elapsed:
> > > > > 0.263 s - in org.apache.hadoop.hbase.TestTimeout*
> > > > >
> > > > > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time
> > > > elapsed:
> > > > > 1.937 s - in org.apache.hadoop.hbase.client.TestClientNoCluster*
> > > > >
> > > > > *WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time
> > > elapsed:
> > > > > 6.424 s - in org.apache.hadoop.hbase.client.
> TestHBaseAdminNoCluster*
> > > > >
> > > > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 8, Time
> > > > elapsed:
> > > > > 0 s - in
> > > > > org.apache.hadoop.hbase.master.balancer.
> > TestFavoredNodeAssignmentHelpe
> > > r*
> > > > >
> > > > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 2, Time
> > > > elapsed:
> > > > > 5.837 s - in org.apache.hadoop.hbase.security.TestSecureIPC*
> > > > >
> > > > > *[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time
> > > > elapsed:
> > > > > 0 s - in org.apache.hadoop.hbase.ipc.TestRpcHandlerException*
> > > > >
> > > > > *[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time
> > > > elapsed:
> > > > > 1.237 s - in org.apache.hadoop.hbase.http.TestServletFilter*
> > > > >
> > > > > *[WARNING] Tests run: 16, Failures: 0, Errors: 0, Skipped: 3, Time
> > > > elapsed:
> > > > > 3.626 s - in org.apache.hadoop.hbase.http.TestHttpServer*
> > > > > *[INFO] Running org.apache.hadoop.hbase.http.TestSpnegoHttpServer*
> > > > > *[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
> > > elapsed:
> > > > > 0.001 s <<< FAILURE! - in org.apache.hadoop.hbase.http.
> > > > > TestSpnegoHttpServer*
> > > > > *[ERROR] org.apache.hadoop.hbase.http.TestSpnegoHttpServer  Time
> > > > elapsed:
> > > > > 0
> > > > > s  <<< ERROR!*
> > > > > *java.lang.RuntimeException: Unable to parse:includedir
> > > > /etc/krb5.conf.d/*
> > > > > * at
> > > > > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.buildMiniKdc(
> > > > > TestSpnegoHttpServer.java:143)*
> > > > > * at
> > > > > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.setupServer(
> > > > > TestSpnegoHttpServer.java:91)*
> > > > > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 6, Time
> > > > elapsed:
> > > > > 0 s - in org.apache.hadoop.hbase.http.TestHttpServerLifecycle*
> > > > >
> > > > > *[INFO]*
> > > > > *[INFO] Results:*
> > > > > *[INFO]*
> > > > > *[ERROR] Errors:*
> > > > > *[ERROR]   TestSpnegoHttpServer.setupServer:91->buildMiniKdc:143
»
> > > > Runtime
> > > > > Unable to pars...*
> > > > > *[INFO]*
> > > > > *[ERROR] Tests run: 1157, Failures: 0, Errors: 1, Skipped: 22*
> > > > > *[INFO]*
> > > > > *[INFO]
> > > > > ------------------------------------------------------------
> > > > ------------*
> > > > > *[INFO] Reactor Summary:*
> > > > > *[INFO]*
> > > > > *[INFO] Apache HBase .......................................
> > SUCCESS [
> > > > > 3.101 s]*
> > > > > *[INFO] Apache HBase - Checkstyle ..........................
> SUCCESS
> > [
> > > > > 0.700 s]*
> > > > > *[INFO] Apache HBase - Resource Bundle .....................
> SUCCESS
> > [
> > > > > 0.255 s]*
> > > > > *[INFO] Apache HBase - Annotations .........................
> SUCCESS
> > [
> > > > > 0.839 s]*
> > > > > *[INFO] Apache HBase - Protocol ............................
> SUCCESS
> > [
> > > > > 0.349 s]*
> > > > > *[INFO] Apache HBase - Common ..............................
> SUCCESS
> > > > [02:07
> > > > > min]*
> > > > > *[INFO] Apache HBase - Procedure ...........................
> SUCCESS
> > > > [03:16
> > > > > min]*
> > > > > *[INFO] Apache HBase - Metrics API .........................
> SUCCESS
> > [
> > > > > 2.668 s]*
> > > > > *[INFO] Apache HBase - Hadoop Compatibility ................
> SUCCESS
> > [
> > > > > 13.360 s]*
> > > > > *[INFO] Apache HBase - Metrics Implementation ..............
> SUCCESS
> > [
> > > > > 8.440 s]*
> > > > > *[INFO] Apache HBase - Hadoop Two Compatibility ............
> SUCCESS
> > [
> > > > > 19.941 s]*
> > > > > *[INFO] Apache HBase - Client ..............................
> SUCCESS
> > > > [02:13
> > > > > min]*
> > > > > *[INFO] Apache HBase - Prefix Tree .........................
> SUCCESS
> > [
> > > > > 15.483 s]*
> > > > > *[INFO] Apache HBase - Server ..............................
> FAILURE
> > > > [28:53
> > > > > min]*
> > > > > *[INFO] Apache HBase - Testing Util ........................
> SKIPPED*
> > > > > *[INFO] Apache HBase - Thrift ..............................
> SKIPPED*
> > > > > *[INFO] Apache HBase - Rest ................................
> > SKIPPED*
> > > > > *[INFO] Apache HBase - RSGroup .............................
> SKIPPED*
> > > > > *[INFO] Apache HBase - Shell ...............................
> > SKIPPED*
> > > > > *[INFO] Apache HBase - Integration Tests ...................
> SKIPPED*
> > > > > *[INFO] Apache HBase - Examples ............................
> SKIPPED*
> > > > > *[INFO] Apache HBase - External Block Cache ................
> SKIPPED*
> > > > > *[INFO] Apache HBase - Assembly ............................
> SKIPPED*
> > > > > *[INFO] Apache HBase - Shaded ..............................
> SKIPPED*
> > > > > *[INFO] Apache HBase - Shaded - Client .....................
> SKIPPED*
> > > > > *[INFO] Apache HBase - Shaded - Server .....................
> SKIPPED*
> > > > > *[INFO] Apache HBase Shaded Packaging Invariants ...........
> SKIPPED*
> > > > > *[INFO] Apache HBase - Archetypes ..........................
> SKIPPED*
> > > > > *[INFO] Apache HBase - Exemplar for hbase-client archetype .
> SKIPPED*
> > > > > *[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype
> > > > SKIPPED*
> > > > > *[INFO] Apache HBase - Archetype builder ...................
> SKIPPED*
> > > > > *[INFO]
> > > > > ------------------------------------------------------------
> > > > ------------*
> > > > > *[INFO] BUILD FAILURE*
> > > > > *[INFO]
> > > > > ------------------------------------------------------------
> > > > ------------*
> > > > > *[INFO] Total time: 37:39 min*
> > > > > *[INFO] Finished at: 2018-02-26T19:10:39Z*
> > > > > *[INFO] Final Memory: 84M/345M*
> > > > > *[INFO]
> > > > > ------------------------------------------------------------
> > > > ------------*
> > > > > *[ERROR] Failed to execute goal
> > > > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test
> > > > (default-test)
> > > > > on project hbase-server: There are test failures.*
> > > > > *[ERROR]*
> > > > > *[ERROR] Please refer to
> > > > > /tmp/hbase-1.4.2/hbase-server/target/surefire-reports for the
> > > individual
> > > > > test results.*
> > > > > *[ERROR] Please refer to dump files (if any exist)
> > > [date]-jvmRun[N].dump,
> > > > > [date].dumpstream and [date]-jvmRun[N].dumpstream.*
> > > > > *[ERROR] -> [Help 1]*
> > > > > *[ERROR]*
> > > > > *[ERROR] To see the full stack trace of the errors, re-run Maven
> with
> > > the
> > > > > -e switch.*
> > > > > *[ERROR] Re-run Maven using the -X switch to enable full debug
> > > logging.*
> > > > > *[ERROR]*
> > > > > *[ERROR] For more information about the errors and possible
> > solutions,
> > > > > please read the following articles:*
> > > > > *[ERROR] [Help 1]
> > > > > http://cwiki.apache.org/confluence/display/MAVEN/
> > MojoFailureException
> > > > > <http://cwiki.apache.org/confluence/display/MAVEN/
> > MojoFailureException
> > > >*
> > > > > *[ERROR]*
> > > > > *[ERROR] After correcting the problems, you can resume the build
> with
> > > the
> > > > > command*
> > > > > *[ERROR]   mvn <goals> -rf :hbase-server *
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Mon, Feb 26, 2018 at 1:28 PM, Ted Yu <yuzhihong@gmail.com>
> wrote:
> > > > >
> > > > > > +1
> > > > > >
> > > > > > Checked signatures
> > > > > > Ran unit test suite against JDK 1.8 - passed
> > > > > > Tried some basic shell commands
> > > > > >
> > > > > > On Mon, Feb 26, 2018 at 9:24 AM, Josh Elser <elserj@apache.org>
> > > wrote:
> > > > > >
> > > > > > > +1 (binding)
> > > > > > >
> > > > > > > * src release contents looks OK
> > > > > > > * sigs/xsums OK
> > > > > > > * apache-rat:check OK
> > > > > > > * Can build src release
> > > > > > > * LICENSE looks OK
> > > > > > > * Copyright in NOTICE needs updating for 2018
> > > > > > >
> > > > > > > Only thing I noticed is that we need to update the checksum
> > naming
> > > > > > > convention for SHA*. Per [1], .sha filenames should only
> contain
> > > > SHA1,
> > > > > > and
> > > > > > > .sha512 file names should be used for SHA512 xsum. I believe
> this
> > > > means
> > > > > > we
> > > > > > > just need to modify make_rc.sh to put the xsum into .sha512
> > instead
> > > > of
> > > > > > > .sha. We do not need to distribute SHA1 xsums and, afaik,
there
> > is
> > > > > little
> > > > > > > cryptographic value to this.
> > > > > > >
> > > > > > > [1] http://www.apache.org/dev/release-distribution.html#
> > > > sigs-and-sums
> > > > > > >
> > > > > > > On 2/22/18 6:55 PM, Andrew Purtell wrote:
> > > > > > >
> > > > > > >> The second HBase 1.4.2 release candidate (RC1) is available
> for
> > > > > download
> > > > > > >> at
> > > > > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/
> > and
> > > > > Maven
> > > > > > >> artifacts are available in the temporary repository
> > > > > > >> https://repository.apache.org/content/repositories/
> > > > > orgapachehbase-1196/
> > > > > > .
> > > > > > >>
> > > > > > >> The git tag corresponding to the candidate is '1.4.2RC1'
> > > > (b4ec89059c).
> > > > > > >> Note
> > > > > > >> this is different from branch-1.4 by one commit because
we had
> > an
> > > > > > >> intervening commit between tag and push (08b9939974,
> > HBASE-20016)
> > > > > while
> > > > > > I
> > > > > > >> was running tests. The only difference is the CHANGES.txt
> update
> > > for
> > > > > > >> 1.4.2RC1 is placed ahead of the commit for HBASE-20016,
but
> does
> > > not
> > > > > > >> mention it, which is fine, because 1.4.2RC1 does not
contain
> > > > > > HBASE-20016.
> > > > > > >>
> > > > > > >> A detailed source and binary compatibility report for
this
> > release
> > > > is
> > > > > > >> available for your review at
> > > > > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/
> > > > > > >> compat-check-report.html
> > > > > > >> .
> > > > > > >>
> > > > > > >> A list of the 22 issues resolved in this release can
be found
> at
> > > > > > >> https://s.apache.org/aGcb .
> > > > > > >>
> > > > > > >> Please try out the candidate and vote +1/0/-1.
> > > > > > >>
> > > > > > >> This vote will be open for at least 72 hours. Unless
> objection I
> > > > will
> > > > > > try
> > > > > > >> to close it Thursday February 28, 2018 if we have sufficient
> > > votes.
> > > > > > >>
> > > > > > >> Prior to making this announcement I made the following
> preflight
> > > > > checks:
> > > > > > >>
> > > > > > >>     - RAT check passes (7u80)
> > > > > > >>     - Unit test suite passes (8u131)
> > > > > > >>     - LTT load 1M rows with 100% verification and 20%
updates
> > > > (8u131)
> > > > > > >>     - PE sequentialWrite, sequentialRead, randomWrite,
> > randomRead,
> > > > > > >>     scanRange100 (8u131)
> > > > > > >>     - ITBLL Loop 1 100M rows (8u131)
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message