hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
Date Wed, 02 Aug 2017 16:40:40 GMT
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/

[Aug 1, 2017 4:56:33 PM] (jianhe) YARN-6872. Ensure apps could run given NodeLabels are disabled
post RM
[Aug 1, 2017 8:31:44 PM] (arp) HDFS-14676. Wrong default value for fs.df.interval. Contributed
by
[Aug 1, 2017 8:34:25 PM] (mackrorysd) HDFS-12151. Hadoop 2 clients cannot writeBlock to Hadoop
3 DataNodes.
[Aug 1, 2017 8:36:28 PM] (stevel) HADOOP-14660 wasb: improve throughput by 34% when account
limit
[Aug 1, 2017 10:13:29 PM] (wang) HADOOP-14701. Configuration can log misleading warnings about
an attempt
[Aug 1, 2017 11:00:53 PM] (lei) HADOOP-14495. Add set options interface to FSDataOutputStreamBuilder.
[Aug 1, 2017 11:28:20 PM] (manojpec) HDFS-12217. HDFS snapshots doesn't capture all open files
when one of
[Aug 2, 2017 12:13:02 AM] (junping_du) HADOOP-14683. FileStatus.compareTo binary compatible
issue. Contributed
[Aug 2, 2017 12:28:17 AM] (Carlo Curino) YARN-5300. Exclude generated federation protobuf
sources from YARN
[Aug 2, 2017 12:28:17 AM] (Carlo Curino) YARN-3662. Federation Membership State Store internal
APIs.
[Aug 2, 2017 12:28:18 AM] (Carlo Curino) YARN-5406. In-memory based implementation of the
[Aug 2, 2017 12:28:18 AM] (Carlo Curino) YARN-5390. Federation Subcluster Resolver. Contributed
by Ellen Hui.
[Aug 2, 2017 12:28:18 AM] (Carlo Curino) YARN-5307. Federation Application State Store internal
APIs
[Aug 2, 2017 12:28:18 AM] (Carlo Curino) YARN-3664. Federation PolicyStore internal APIs
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-5408. Compose Federation membership/application/policy
APIs into an
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-5407. In-memory based implementation of the
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-5519. Add SubClusterId in AddApplicationHomeSubClusterResponse
for
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-3672. Create Facade for Federation State and
Policy Store.
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-5467. InputValidator for the FederationStateStore
internal APIs.
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-3673. Create a FailoverProxy for Federation
services. Contributed
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-3671. Integrate Federation services with ResourceManager.
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-5612. Return SubClusterId in
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-5601. Make the RM epoch base value configurable.
Contributed by
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-5323. Policies APIs for Federation Router and
AMRMProxy policies.
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5324. Stateless Federation router policies implementation.
(Carlo
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5325. Stateless ARMRMProxy policies implementation.
(Carlo Curino
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5391. PolicyManager to tie together Router/AMRM
Federation
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5634. Simplify initialization/use of RouterPolicy
via a
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5676. Add a HashBasedRouterPolicy, and small
policies and test
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-5905. Update the RM webapp host that is reported
as part of
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-5872. Add AlwayReject policies for router and
amrmproxy. (Carlo
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-6093. Minor bugs with AMRMtoken renewal and
state store
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-5410. Bootstrap Router server module. (Giovanni
Matteo Fumarola via
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-6190. Validation and synchronization fixes in
[Aug 2, 2017 12:28:23 AM] (Carlo Curino) YARN-6247. Share a single instance of SubClusterResolver
instead of
[Aug 2, 2017 12:28:23 AM] (Carlo Curino) YARN-6370. Properly handle rack requests for non-active
subclusters in
[Aug 2, 2017 12:28:23 AM] (Carlo Curino) YARN-5602. Utils for Federation State and Policy
Store. (Giovanni Matteo
[Aug 2, 2017 12:28:23 AM] (Carlo Curino) YARN-6203: Occasional test failure in TestWeightedRandomRouterPolicy
[Aug 2, 2017 12:28:24 AM] (Carlo Curino) YARN-3663. Federation State and Policy Store (DBMS
implementation).
[Aug 2, 2017 12:28:24 AM] (Carlo Curino) YARN-5411. Create a proxy chain for ApplicationClientProtocol
in the
[Aug 2, 2017 12:28:24 AM] (Carlo Curino) YARN-5413. Create a proxy chain for ResourceManager
Admin API in the
[Aug 2, 2017 12:28:24 AM] (Carlo Curino) YARN-5531. UnmanagedAM pool manager for federating
application across
[Aug 2, 2017 12:28:25 AM] (Carlo Curino) Bumping up hadoop-yarn-server-router module to 3.0.0-alpha4
post rebase.
[Aug 2, 2017 12:28:25 AM] (Carlo Curino) YARN-6666. Fix unit test failure in TestRouterClientRMService.
(Botong
[Aug 2, 2017 12:28:25 AM] (Carlo Curino) YARN-6484. Documenting the YARN Federation feature.
(Carlo Curino via
[Aug 2, 2017 12:28:25 AM] (Carlo Curino) YARN-3666. Federation Intercepting and propagating
AM- home RM
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-6511. Federation: transparently spanning application
across
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-6691. Update YARN daemon startup/shutdown scripts
to include Router
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-6724. Add ability to blacklist sub-clusters
when invoking Routing
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-3659. Federation: routing client invocations
transparently to
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-6807. Adding required missing configs to Federation
configuration
[Aug 2, 2017 12:28:27 AM] (Carlo Curino) YARN-6815. FederationStateStoreFacade return behavior
should be
[Aug 2, 2017 12:28:27 AM] (Carlo Curino) YARN-6821. Move FederationStateStore SQL DDL files
from test resource to
[Aug 2, 2017 12:28:27 AM] (Carlo Curino) Bumping up yarn-server-router (new) module pom to
beta1 and fixing
[Aug 2, 2017 12:28:27 AM] (Carlo Curino) Bumping up hadoop-yarn-server-router module to 3.0.0-beta1
post rebase.
[Aug 2, 2017 12:28:28 AM] (Carlo Curino) YARN-6866. Minor clean-up and fixes in anticipation
of YARN-2915 merge
[Aug 2, 2017 12:28:28 AM] (Carlo Curino) YARN-5412. Create a proxy chain for ResourceManager
REST API in the
[Aug 2, 2017 12:28:28 AM] (Carlo Curino) YARN-6902. Update Microsoft JDBC Driver for SQL Server
version in
[Aug 2, 2017 12:28:28 AM] (Carlo Curino) YARN-6853. Add MySql Scripts for FederationStateStore.
(Contributed by
[Aug 2, 2017 1:34:07 AM] (wheat9) HDFS-12107. FsDatasetImpl#removeVolumes floods the logs
when removing
[Aug 2, 2017 6:06:25 AM] (iwasakims) HADOOP-14702. Fix formatting issue and regression caused
by conversion




-1 overall


The following subsystems voted -1:
    findbugs unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
    cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
    unit


Specific tests:

    FindBugs :

       module:hadoop-hdfs-project/hadoop-hdfs-client 
       Possible exposure of partially initialized object in org.apache.hadoop.hdfs.DFSClient.initThreadsNumForStripedReads(int)
At DFSClient.java:object in org.apache.hadoop.hdfs.DFSClient.initThreadsNumForStripedReads(int)
At DFSClient.java:[line 2906] 
       org.apache.hadoop.hdfs.server.protocol.SlowDiskReports.equals(Object) makes inefficient
use of keySet iterator instead of entrySet iterator At SlowDiskReports.java:keySet iterator
instead of entrySet iterator At SlowDiskReports.java:[line 105] 

    FindBugs :

       module:hadoop-hdfs-project/hadoop-hdfs 
       Possible null pointer dereference in org.apache.hadoop.hdfs.qjournal.server.JournalNode.getJournalsStatus()
due to return value of called method Dereferenced at JournalNode.java:org.apache.hadoop.hdfs.qjournal.server.JournalNode.getJournalsStatus()
due to return value of called method Dereferenced at JournalNode.java:[line 302] 
       org.apache.hadoop.hdfs.server.common.HdfsServerConstants$StartupOption.setClusterId(String)
unconditionally sets the field clusterId At HdfsServerConstants.java:clusterId At HdfsServerConstants.java:[line
193] 
       org.apache.hadoop.hdfs.server.common.HdfsServerConstants$StartupOption.setForce(int)
unconditionally sets the field force At HdfsServerConstants.java:force At HdfsServerConstants.java:[line
217] 
       org.apache.hadoop.hdfs.server.common.HdfsServerConstants$StartupOption.setForceFormat(boolean)
unconditionally sets the field isForceFormat At HdfsServerConstants.java:isForceFormat At
HdfsServerConstants.java:[line 229] 
       org.apache.hadoop.hdfs.server.common.HdfsServerConstants$StartupOption.setInteractiveFormat(boolean)
unconditionally sets the field isInteractiveFormat At HdfsServerConstants.java:isInteractiveFormat
At HdfsServerConstants.java:[line 237] 
       Possible null pointer dereference in org.apache.hadoop.hdfs.server.datanode.DataStorage.linkBlocksHelper(File,
File, int, HardLink, boolean, File, List) due to return value of called method Dereferenced
at DataStorage.java:org.apache.hadoop.hdfs.server.datanode.DataStorage.linkBlocksHelper(File,
File, int, HardLink, boolean, File, List) due to return value of called method Dereferenced
at DataStorage.java:[line 1339] 
       Possible null pointer dereference in org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager.purgeOldLegacyOIVImages(String,
long) due to return value of called method Dereferenced at NNStorageRetentionManager.java:org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager.purgeOldLegacyOIVImages(String,
long) due to return value of called method Dereferenced at NNStorageRetentionManager.java:[line
258] 
       Possible null pointer dereference in org.apache.hadoop.hdfs.server.namenode.NNUpgradeUtil$1.visitFile(Path,
BasicFileAttributes) due to return value of called method Dereferenced at NNUpgradeUtil.java:org.apache.hadoop.hdfs.server.namenode.NNUpgradeUtil$1.visitFile(Path,
BasicFileAttributes) due to return value of called method Dereferenced at NNUpgradeUtil.java:[line
133] 
       Useless condition:argv.length >= 1 at this point At DFSAdmin.java:[line 2100] 
       Useless condition:numBlocks == -1 at this point At ImageLoaderCurrent.java:[line 727]


    FindBugs :

       module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager

       Useless object stored in variable removedNullContainers of method org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.removeOrTrackCompletedContainersFromContext(List)
At NodeStatusUpdaterImpl.java:removedNullContainers of method org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.removeOrTrackCompletedContainersFromContext(List)
At NodeStatusUpdaterImpl.java:[line 642] 
       org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.removeVeryOldStoppedContainersFromCache()
makes inefficient use of keySet iterator instead of entrySet iterator At NodeStatusUpdaterImpl.java:keySet
iterator instead of entrySet iterator At NodeStatusUpdaterImpl.java:[line 719] 
       Hard coded reference to an absolute pathname in org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.runtime.DockerLinuxContainerRuntime.launchContainer(ContainerRuntimeContext)
At DockerLinuxContainerRuntime.java:absolute pathname in org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.runtime.DockerLinuxContainerRuntime.launchContainer(ContainerRuntimeContext)
At DockerLinuxContainerRuntime.java:[line 490] 
       org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.createStatus()
makes inefficient use of keySet iterator instead of entrySet iterator At ContainerLocalizer.java:keySet
iterator instead of entrySet iterator At ContainerLocalizer.java:[line 357] 
       org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainerMetrics.usageMetrics
is a mutable collection which should be package protected At ContainerMetrics.java:which should
be package protected At ContainerMetrics.java:[line 134] 

    Failed junit tests :

       hadoop.security.TestKDiag 
       hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080 
       hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy 
       hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150 
       hadoop.hdfs.TestDFSStripedOutputStreamWithFailure120 
       hadoop.yarn.server.nodemanager.containermanager.scheduler.TestContainerSchedulerQueuing

       hadoop.yarn.client.TestFederationRMFailoverProxyProvider 
       hadoop.yarn.client.api.impl.TestNMClient 
       hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps 
       hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities 
       hadoop.yarn.sls.nodemanager.TestNMSimulator 

    Timed out junit tests :

       org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA 
      

   cc:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-compile-cc-root.txt
 [4.0K]

   javac:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-compile-javac-root.txt
 [308K]

   checkstyle:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-checkstyle-root.txt
 [17M]

   pylint:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-patch-pylint.txt
 [20K]

   shellcheck:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-patch-shellcheck.txt
 [20K]

   shelldocs:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-patch-shelldocs.txt
 [12K]

   whitespace:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/whitespace-eol.txt
 [12M]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/whitespace-tabs.txt
 [1.2M]

   findbugs:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client-warnings.html
 [8.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
 [16K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-warnings.html
 [12K]

   javadoc:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-javadoc-javadoc-root.txt
 [1.9M]

   unit:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
 [148K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
 [244K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
 [40K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
 [64K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
 [40K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase-tests.txt
 [12K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-tools_hadoop-sls.txt
 [8.0K]

Powered by Apache Yetus 0.6.0-SNAPSHOT   http://yetus.apache.org

Mime
View raw message