hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
Date Mon, 13 Aug 2018 14:39:27 GMT
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/

[Aug 12, 2018 10:05:52 AM] (umamahesh) HDFS-10794. [SPS]: Provide storage policy satisfy worker
at DN for
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-10800: [SPS]: Daemon thread in Namenode to find
blocks placed in
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-10801. [SPS]: Protocol buffer changes for sending
storage movement
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-10884: [SPS]: Add block movement tracker to track
the completion of
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-10954. [SPS]: Provide mechanism to send blocks
movement result back
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-11029. [SPS]:Provide retry mechanism for the blocks
which were
[Aug 12, 2018 10:05:54 AM] (umamahesh) HDFS-11068: [SPS]: Provide unique trackID to track
the block movement
[Aug 12, 2018 10:05:54 AM] (umamahesh) HDFS-10802. [SPS]: Add satisfyStoragePolicy API in
HdfsAdmin.
[Aug 12, 2018 10:05:54 AM] (umamahesh) HDFS-11151. [SPS]: StoragePolicySatisfier should gracefully
handle when
[Aug 12, 2018 10:05:55 AM] (umamahesh) HDFS-10885. [SPS]: Mover tool should not be allowed
to run when Storage
[Aug 12, 2018 10:05:55 AM] (umamahesh) HDFS-11123. [SPS] Make storage policy satisfier daemon
work on/off
[Aug 12, 2018 10:05:55 AM] (umamahesh) HDFS-11032: [SPS]: Handling of block movement failure
at the coordinator
[Aug 12, 2018 10:05:55 AM] (umamahesh) HDFS-11248: [SPS]: Handle partial block location movements.
Contributed
[Aug 12, 2018 10:05:56 AM] (umamahesh) HDFS-11193 : [SPS]: Erasure coded files should be considered
for
[Aug 12, 2018 10:05:56 AM] (umamahesh) HDFS-11289. [SPS]: Make SPS movement monitor timeouts
configurable.
[Aug 12, 2018 10:05:56 AM] (umamahesh) HDFS-11293: [SPS]: Local DN should be given preference
as source node,
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11150: [SPS]: Provide persistence when satisfying
storage policy.
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11186. [SPS]: Daemon thread of SPS should start
only in Active NN.
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11309. [SPS]: chooseTargetTypeInSameNode should
pass accurate block
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11243. [SPS]: Add a protocol command from NN to
DN for dropping the
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11239: [SPS]: Check Mover file ID lease also to
determine whether
[Aug 12, 2018 10:05:58 AM] (umamahesh) HDFS-11336: [SPS]: Remove xAttrs when movements done
or SPS disabled.
[Aug 12, 2018 10:05:58 AM] (umamahesh) HDFS-11338: [SPS]: Fix timeout issue in unit tests
caused by longger NN
[Aug 12, 2018 10:05:58 AM] (umamahesh) HDFS-11334: [SPS]: NN switch and rescheduling movements
can lead to have
[Aug 12, 2018 10:05:58 AM] (umamahesh) HDFS-11572. [SPS]: SPS should clean Xattrs when no
blocks required to
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11695: [SPS]: Namenode failed to start while loading
SPS xAttrs
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11883: [SPS] : Handle NPE in BlockStorageMovementTracker
when
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11762. [SPS]: Empty files should be ignored in
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11726. [SPS]: StoragePolicySatisfier should not
select same storage
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11966. [SPS] Correct the log in
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11670: [SPS]: Add CLI command for satisfy storage
policy
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-11965: [SPS]: Should give chance to satisfy the
low redundant
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-11264: [SPS]: Double checks to ensure that SPS/Mover
are not
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-11874. [SPS]: Document the SPS feature. Contributed
by Uma
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-12146. [SPS]: Fix
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-12141: [SPS]: Fix checkstyle warnings. Contributed
by Rakesh R.
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-12152: [SPS]: Re-arrange StoragePolicySatisfyWorker
stopping
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12214: [SPS]: Fix review comments of StoragePolicySatisfier
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12225: [SPS]: Optimize extended attributes for
tracking SPS
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12291: [SPS]: Provide a mechanism to recursively
iterate and
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12570: [SPS]: Refactor Co-ordinator datanode logic
to track the
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12556: [SPS] : Block movement analysis should
be done in read lock.
[Aug 12, 2018 10:06:02 AM] (umamahesh) HDFS-12310: [SPS]: Provide an option to track the status
of in progress
[Aug 12, 2018 10:06:02 AM] (umamahesh) HDFS-12790: [SPS]: Rebasing HDFS-10285 branch after
HDFS-10467,
[Aug 12, 2018 10:06:02 AM] (umamahesh) HDFS-12106: [SPS]: Improve storage policy satisfier
configurations.
[Aug 12, 2018 10:06:02 AM] (umamahesh) HDFS-12955: [SPS]: Move SPS classes to a separate package.
Contributed
[Aug 12, 2018 10:06:02 AM] (umamahesh) HDFS-12982 : [SPS]: Reduce the locking and cleanup
the Namesystem
[Aug 12, 2018 10:06:03 AM] (umamahesh) HDFS-12911. [SPS]: Modularize the SPS code and expose
necessary
[Aug 12, 2018 10:06:03 AM] (umamahesh) HDFS-13025. [SPS]: Implement a mechanism to scan the
files for external
[Aug 12, 2018 10:06:03 AM] (umamahesh) HDFS-13033: [SPS]: Implement a mechanism to do file
block movements for
[Aug 12, 2018 10:06:04 AM] (umamahesh) HDFS-13057: [SPS]: Revisit configurations to make SPS
service modes
[Aug 12, 2018 10:06:04 AM] (umamahesh) HDFS-13075. [SPS]: Provide External Context implementation.
Contributed
[Aug 12, 2018 10:06:04 AM] (umamahesh) HDFS-13050: [SPS]: Create start/stop script to start
external SPS
[Aug 12, 2018 10:06:04 AM] (umamahesh) HDFS-13077. [SPS]: Fix review comments of external
storage policy
[Aug 12, 2018 10:06:04 AM] (umamahesh) HDFS-13097: [SPS]: Fix the branch review comments(Part1).
Contributed by
[Aug 12, 2018 10:06:05 AM] (umamahesh) HDFS-13110: [SPS]: Reduce the number of APIs in NamenodeProtocol
used by
[Aug 12, 2018 10:06:05 AM] (umamahesh) HDFS-13166: [SPS]: Implement caching mechanism to keep
LIVE datanodes to
[Aug 12, 2018 10:06:05 AM] (umamahesh) HDFS-13165: [SPS]: Collects successfully moved block
details via IBR.
[Aug 12, 2018 10:06:06 AM] (umamahesh) HDFS-13381 : [SPS]: Use DFSUtilClient#makePathFromFileId()
to prepare
[Aug 12, 2018 10:06:06 AM] (umamahesh) HDFS-13076: [SPS]: Resolve conflicts after rebasing
HDFS-10285 branch to
[Aug 12, 2018 10:06:06 AM] (umamahesh) HDFS-13076: [SPS]: Addendum. Resolve conflicts after
rebasing branch to
[Aug 12, 2018 10:06:06 AM] (umamahesh) HDFS-13076: [SPS]: Cleanup work for HDFS-10285 merge.
Contributed by
[Aug 12, 2018 10:06:07 AM] (umamahesh) HDFS-13808: [SPS]: Remove unwanted FSNamesystem #isFileOpenedForWrite()




-1 overall


The following subsystems voted -1:
    asflicense findbugs pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
    cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
    unit


Specific tests:

    Failed CTEST tests :

       test_test_libhdfs_threaded_hdfs_static 
       test_libhdfs_threaded_hdfspp_test_shim_static 

    Failed junit tests :

       hadoop.hdfs.client.impl.TestBlockReaderLocal 
       hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS 
       hadoop.hdfs.TestErasureCodingPoliciesWithRandomECPolicy 
       hadoop.hdfs.web.TestWebHdfsTimeouts 
       hadoop.mapred.TestMRTimelineEventHandling 
      

   cc:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/diff-compile-cc-root.txt
 [4.0K]

   javac:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/diff-compile-javac-root.txt
 [328K]

   checkstyle:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/diff-checkstyle-root.txt
 [4.0K]

   pathlen:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/pathlen.txt
 [12K]

   pylint:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/diff-patch-pylint.txt
 [24K]

   shellcheck:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/diff-patch-shellcheck.txt
 [20K]

   shelldocs:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/diff-patch-shelldocs.txt
 [16K]

   whitespace:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/whitespace-eol.txt
 [9.4M]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/whitespace-tabs.txt
 [1.1M]

   xml:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/xml.txt
 [4.0K]

   findbugs:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-hdds_client.txt
 [56K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt
 [52K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-hdds_framework.txt
 [12K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt
 [52K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-hdds_tools.txt
 [16K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-ozone_client.txt
 [4.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-ozone_common.txt
 [28K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt
 [4.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt
 [4.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-ozone_ozonefs.txt
 [8.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/branch-findbugs-hadoop-ozone_tools.txt
 [4.0K]

   javadoc:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/diff-javadoc-javadoc-root.txt
 [760K]

   CTEST:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt
 [116K]

   unit:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
 [340K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt
 [112K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt
 [8.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
 [88K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-hdds_client.txt
 [48K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-hdds_container-service.txt
 [48K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-hdds_framework.txt
 [12K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-hdds_server-scm.txt
 [52K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-hdds_tools.txt
 [12K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-ozone_client.txt
 [4.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-ozone_common.txt
 [24K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-ozone_integration-test.txt
 [4.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-ozone_objectstore-service.txt
 [4.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-ozone_ozone-manager.txt
 [4.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-ozone_ozonefs.txt
 [4.0K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-unit-hadoop-ozone_tools.txt
 [4.0K]

   asflicense:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/artifact/out/patch-asflicense-problems.txt
 [4.0K]

Powered by Apache Yetus 0.8.0-SNAPSHOT   http://yetus.apache.org

Mime
View raw message