hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
Date Mon, 11 Jul 2016 14:25:48 GMT
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/

[Jul 10, 2016 3:45:28 PM] (sjlee) YARN-3063. Bootstrapping TimelineServer next generation
module.
[Jul 10, 2016 3:45:28 PM] (sjlee) YARN-3030. Set up TS aggregator with basic request serving
structure and
[Jul 10, 2016 3:45:29 PM] (sjlee) YARN-3041. Added the overall data model of timeline service
next gen.
[Jul 10, 2016 3:45:29 PM] (sjlee) YARN-3240. Implement client API to put generic entities.
Contributed by
[Jul 10, 2016 3:45:29 PM] (sjlee) YARN-3240. Added ".keep" file which was missed before.
[Jul 10, 2016 3:45:29 PM] (sjlee) YARN-3087. Made the REST server of per-node aggregator work
alone in NM
[Jul 10, 2016 3:45:30 PM] (sjlee) YARN-3125. Made the distributed shell use timeline service
next gen and
[Jul 10, 2016 3:45:30 PM] (sjlee) YARN-3210. Refactored timeline aggregator according to new
code
[Jul 10, 2016 3:45:30 PM] (sjlee) YARN-3264. Created backing storage write interface and a
POC only FS
[Jul 10, 2016 3:45:31 PM] (sjlee) YARN-3039. Implemented the app-level timeline aggregator
discovery
[Jul 10, 2016 3:45:31 PM] (sjlee) YARN-3333. Rename TimelineAggregator etc. to TimelineCollector.
[Jul 10, 2016 3:45:31 PM] (sjlee) YARN-3377. Fixed test failure in TestTimelineServiceClientIntegration.
[Jul 10, 2016 3:45:32 PM] (sjlee) YARN-3034. Implement RM starting its timeline collector.
Contributed by
[Jul 10, 2016 3:45:32 PM] (sjlee) YARN-3040. Make putEntities operation be aware of the app's
context.
[Jul 10, 2016 3:45:32 PM] (sjlee) YARN-3374. Collector's web server should randomly bind an
available
[Jul 10, 2016 3:45:33 PM] (sjlee) YARN-3334. NM uses timeline client to publish container
metrics to new
[Jul 10, 2016 3:45:33 PM] (sjlee) YARN-3391. Clearly define flow ID/ flow run / flow version
in API and
[Jul 10, 2016 3:45:33 PM] (sjlee) YARN-3390. Reuse TimelineCollectorManager for RM (Zhijie
Shen via sjlee)
[Jul 10, 2016 3:45:34 PM] (sjlee) YARN-3431. Sub resources of timeline entity needs to be
passed to a
[Jul 10, 2016 3:45:34 PM] (sjlee) MAPREDUCE-6327. Made MR AM use timeline service v2 API to
write history
[Jul 10, 2016 3:45:34 PM] (sjlee) MAPREDUCE-6335. Created MR job based performance test driver
for the
[Jul 10, 2016 3:45:35 PM] (sjlee) YARN-3551. Consolidate data model change according to the
backend
[Jul 10, 2016 3:45:35 PM] (sjlee) YARN-3562. unit tests failures and issues found from findbug
from
[Jul 10, 2016 3:45:35 PM] (sjlee) YARN-3134. Implemented Phoenix timeline writer to access
HBase backend.
[Jul 10, 2016 3:45:36 PM] (sjlee) YARN-3529. Added mini HBase cluster and Phoenix support
to timeline
[Jul 10, 2016 3:45:36 PM] (sjlee) YARN-3634. TestMRTimelineEventHandling and TestApplication
are broken.
[Jul 10, 2016 3:45:36 PM] (sjlee) YARN-3411. [Storage implementation] explore the native HBase
write
[Jul 10, 2016 3:45:36 PM] (sjlee) YARN-3726. Fix TestHBaseTimelineWriterImpl unit test failure
by fixing
[Jul 10, 2016 3:45:37 PM] (sjlee) YARN-3721. build is broken on YARN-2928 branch due to possible
[Jul 10, 2016 3:45:37 PM] (sjlee) YARN-3276. Code cleanup for timeline service API records.
Contributed by
[Jul 10, 2016 3:45:37 PM] (sjlee) YARN-3044. Made RM write app, attempt and optional container
lifecycle
[Jul 10, 2016 3:45:38 PM] (sjlee) YARN-3801. [JDK-8] Exclude jdk.tools from hbase-client and
[Jul 10, 2016 3:45:38 PM] (sjlee) YARN-3706. Generalize native HBase writer for additional
tables (Joep
[Jul 10, 2016 3:45:38 PM] (sjlee) YARN-3792. Test case failures in TestDistributedShell and
some issue
[Jul 10, 2016 3:45:38 PM] (sjlee) YARN-3051. Created storage oriented reader interface for
fetching raw
[Jul 10, 2016 3:45:39 PM] (sjlee) YARN-3047. [Data Serving] Set up ATS reader with basic request
serving
[Jul 10, 2016 3:45:39 PM] (sjlee) YARN-3836. add equals and hashCode to TimelineEntity and
other classes
[Jul 10, 2016 3:45:39 PM] (sjlee) YARN-3949. Ensure timely flush of timeline writes. Contributed
by
[Jul 10, 2016 3:45:40 PM] (sjlee) YARN-3908. Fixed bugs in HBaseTimelineWriterImpl. Contributed
by
[Jul 10, 2016 3:45:40 PM] (sjlee) YARN-3993. Changed to use the AM flag in ContainerContext
determine AM
[Jul 10, 2016 3:45:40 PM] (sjlee) YARN-3984. Adjusted the event column key schema and avoided
missing
[Jul 10, 2016 3:45:41 PM] (sjlee) YARN-3049. [Storage Implementation] Implement storage reader
interface
[Jul 10, 2016 3:45:41 PM] (sjlee) YARN-3906. Split the application table from the entity table.
[Jul 10, 2016 3:45:41 PM] (sjlee) MAPREDUCE-6337. Added a mode to replay MR job history files
and put them
[Jul 10, 2016 3:45:41 PM] (sjlee) MAPREDUCE-6370. Made the timeline service v2 test driver
write event ID.
[Jul 10, 2016 3:45:42 PM] (sjlee) YARN-3904. Refactor timelineservice.storage to add support
to online and
[Jul 10, 2016 3:45:42 PM] (sjlee) YARN-3045. Implement NM writing container lifecycle events
to Timeline
[Jul 10, 2016 3:45:42 PM] (sjlee) YARN-4025. Deal with byte representations of Longs in writer
code.
[Jul 10, 2016 3:45:43 PM] (sjlee) YARN-4064. build is broken at TestHBaseTimelineWriterImpl.java
(sjlee)
[Jul 10, 2016 3:45:43 PM] (sjlee) YARN-3814. REST API implementation for getting raw entities
in
[Jul 10, 2016 3:45:43 PM] (sjlee) YARN-4058. Miscellaneous issues in NodeManager project (Naganarasimha
G
[Jul 10, 2016 3:45:43 PM] (sjlee) YARN-4102. Add a "skip existing table" mode for timeline
schema creator
[Jul 10, 2016 3:45:44 PM] (sjlee) YARN-3901. Populate flow run data in the flow_run &
flow activity tables
[Jul 10, 2016 3:45:44 PM] (sjlee) YARN-4074. [timeline reader] implement support for querying
for flows
[Jul 10, 2016 3:45:44 PM] (sjlee) YARN-4075 [reader REST API] implement support for querying
for flows and
[Jul 10, 2016 3:45:45 PM] (sjlee) YARN-4203. Add request/response logging & timing for
each REST endpoint
[Jul 10, 2016 3:45:45 PM] (sjlee) YARN-4210. HBase reader throws NPE if Get returns no rows
(Varun Saxena
[Jul 10, 2016 3:45:45 PM] (sjlee) YARN-3864. Implement support for querying single app and
all apps for a
[Jul 10, 2016 3:45:45 PM] (sjlee) YARN-4178. [storage implementation] app id as string in
row keys can
[Jul 10, 2016 3:45:46 PM] (sjlee) YARN-4237 Support additional queries for ATSv2 Web UI. Contributed
by
[Jul 10, 2016 3:45:46 PM] (sjlee) YARN-4179. [reader implementation] support flow activity
queries based
[Jul 10, 2016 3:45:46 PM] (sjlee) YARN-4129. Refactor the SystemMetricPublisher in RM to better
support
[Jul 10, 2016 3:45:47 PM] (sjlee) YARN-4221. Store user in app to flow table (Varun Saxena
via sjlee)
[Jul 10, 2016 3:45:47 PM] (sjlee) YARN-4053. Change the way metric values are stored in HBase
Storage
[Jul 10, 2016 3:45:47 PM] (sjlee) YARN-4297. TestJobHistoryEventHandler and TestRMContainerAllocator
[Jul 10, 2016 3:45:48 PM] (sjlee) YARN-3862. Support for fetching specific configs and metrics
based on
[Jul 10, 2016 3:45:48 PM] (sjlee) YARN-3623. Add a config to indicate the Timeline Service
version.
[Jul 10, 2016 3:45:48 PM] (sjlee) YARN-4356. Ensure the timeline service v.2 is disabled cleanly
and has
[Jul 10, 2016 3:45:49 PM] (sjlee) YARN-4450. TestTimelineAuthenticationFilter and
[Jul 10, 2016 3:45:49 PM] (sjlee) YARN-4392. ApplicationCreatedEvent event time resets after
RM
[Jul 10, 2016 3:45:49 PM] (sjlee) YARN-4460. [Bug fix] RM fails to start when SMP is enabled.
(Li Lu via
[Jul 10, 2016 3:45:49 PM] (sjlee) YARN-4445. Unify the term flowId and flowName in timeline
v2 codebase.
[Jul 10, 2016 3:45:50 PM] (sjlee) YARN-4350. TestDistributedShell fails for V2 scenarios.
(Naganarasimha G
[Jul 10, 2016 3:45:50 PM] (sjlee) YARN-3586. RM to only get back addresses of Collectors that
NM needs to
[Jul 10, 2016 3:45:50 PM] (sjlee) YARN-3995. Some of the NM events are not getting published
due race
[Jul 10, 2016 3:45:51 PM] (sjlee) YARN-4200. Refactor reader classes in storage to nest under
hbase
[Jul 10, 2016 3:45:51 PM] (sjlee) Rebase to latest trunk
[Jul 10, 2016 3:45:51 PM] (sjlee) YARN-4622. TestDistributedShell fails for v2 test cases
after
[Jul 10, 2016 3:45:52 PM] (sjlee) YARN-4238. createdTime and modifiedTime is not reported
while publishing
[Jul 10, 2016 3:45:52 PM] (sjlee) YARN-4224. Support fetching entities by UID and change the
REST
[Jul 10, 2016 3:45:52 PM] (sjlee) YARN-4644. TestRMRestart fails and findbugs issue in YARN-2928
branch
[Jul 10, 2016 3:45:52 PM] (sjlee) YARN-4446. Refactor reader API for better extensibility
(Varun Saxena
[Jul 10, 2016 3:45:53 PM] (sjlee) YARN-4409. Fix javadoc and checkstyle issues in timelineservice
code
[Jul 10, 2016 3:45:53 PM] (sjlee) YARN-3367. Replace starting a separate thread for post entity
with event
[Jul 10, 2016 3:45:53 PM] (sjlee) YARN-4700. ATS storage has one extra record each time the
RM got
[Jul 10, 2016 3:45:54 PM] (sjlee) MAPREDUCE-6546. reconcile the two versions of the timeline
service
[Jul 10, 2016 3:45:54 PM] (sjlee) YARN-4062. Add the flush and compaction functionality via
coprocessors
[Jul 10, 2016 3:45:54 PM] (sjlee) YARN-4712. CPU Usage Metric is not captured properly in
YARN-2928.
[Jul 10, 2016 3:45:55 PM] (sjlee) YARN-4711. NM is going down with NPE's due to single thread
processing
[Jul 10, 2016 3:45:55 PM] (sjlee) YARN-3461. Consolidate flow name/version/run defaults. (Sangjin
Lee via
[Jul 10, 2016 3:45:55 PM] (sjlee) YARN-3863. Support complex filters in TimelineReader (Varun
Saxena via
[Jul 10, 2016 3:45:56 PM] (sjlee) Addendum to YARN-3863. Deleted files that were added incorrectly.
[Jul 10, 2016 3:45:56 PM] (sjlee) YARN-3816. [Aggregation] App-level aggregation and accumulation
for YARN
[Jul 10, 2016 3:45:56 PM] (sjlee) YARN-4986. Add a check in the coprocessor for table to operated
on
[Jul 10, 2016 3:45:57 PM] (sjlee) YARN-3150. Documenting the timeline service v2. (Sangjin
Lee and
[Jul 10, 2016 3:45:57 PM] (sjlee) MAPREDUCE-6424. Store MR counters as timeline metrics instead
of event.
[Jul 10, 2016 3:45:57 PM] (sjlee) YARN-4447. Provide a mechanism to represent complex filters
and parse
[Jul 10, 2016 3:45:57 PM] (sjlee) MAPREDUCE-6688. Store job configurations in Timeline Service
v2 (Varun
[Jul 10, 2016 3:45:58 PM] (sjlee) YARN-5045. hbase unit tests fail due to dependency issues.
(Sangjin Lee
[Jul 10, 2016 3:45:58 PM] (sjlee) YARN-5102. timeline service build fails with java 8. (Sangjin
Lee via
[Jul 10, 2016 3:45:58 PM] (sjlee) YARN-5096. timelinereader has a lot of logging that's not
useful.
[Jul 10, 2016 3:45:59 PM] (sjlee) YARN-5096 addendum. Turned another logging statement to
debug.
[Jul 10, 2016 3:45:59 PM] (sjlee) YARN-5050. Code cleanup for TestDistributedShell (Li Lu
via sjlee)
[Jul 10, 2016 3:45:59 PM] (sjlee) YARN-5093. created time shows 0 in most REST output (Varun
Saxena via
[Jul 10, 2016 3:45:59 PM] (sjlee) YARN-5018. Online aggregation logic should not run immediately
after
[Jul 10, 2016 3:46:00 PM] (sjlee) YARN-5097. NPE in Separator.joinEncoded() (Vrushali C via
sjlee)
[Jul 10, 2016 3:46:00 PM] (sjlee) YARN-5095. flow activities and flow runs are populated with
wrong
[Jul 10, 2016 3:46:00 PM] (sjlee) YARN-5138. fix "no findbugs output file" error for
[Jul 10, 2016 3:46:01 PM] (sjlee) YARN-5109. timestamps are stored unencoded causing parse
errors (Varun
[Jul 10, 2016 3:46:01 PM] (sjlee) YARN-5111. YARN container system metrics are not aggregated
to
[Jul 10, 2016 3:46:01 PM] (sjlee) YARN-5015. entire time series is returned for YARN container
system
[Jul 10, 2016 3:46:01 PM] (sjlee) YARN-5189. Make HBaseTimeline[Reader|Writer]Impl default
and move
[Jul 10, 2016 3:46:02 PM] (sjlee) YARN-5142. fix findbugs warnings/errors for
[Jul 10, 2016 3:46:02 PM] (sjlee) YARN-5167. Escape occurences of encodedValues. (Sangjin
Lee via Varun
[Jul 10, 2016 3:46:02 PM] (sjlee) YARN-5210 NPE in Distributed Shell while publishing DS_CONTAINER_START
[Jul 10, 2016 3:46:03 PM] (sjlee) YARN-5170. Eliminate singleton converters and static method
access.
[Jul 10, 2016 3:46:03 PM] (sjlee) YARN-5052 Update timeline service v2 documentation to capture
[Jul 10, 2016 3:46:03 PM] (sjlee) YARN-5243. fix several rebase and other miscellaneous issues
before
[Jul 10, 2016 3:46:04 PM] (sjlee) YARN-5070. upgrade HBase version for first merge (Vrushali
C via sjlee)
[Jul 10, 2016 3:46:04 PM] (sjlee) Cleanup changes during rebase with trunk (Vrushali C)
[Jul 10, 2016 3:46:04 PM] (sjlee) MAPREDUCE-6720. Inconsistent values of counters across tasks
and job
[Jul 10, 2016 3:46:04 PM] (sjlee) YARN-5174. [documentation] several updates/corrections to
timeline
[Jul 10, 2016 3:46:05 PM] (sjlee) YARN-5316  fix hadoop-aws pom not to do the exclusion  (Sangjin
Li via
[Jul 10, 2016 3:46:05 PM] (sjlee) Fixed the build after the rebase with trunk.
[Jul 10, 2016 3:46:05 PM] (sjlee) Made a number of miscellaneous fixes for javac, javadoc,
and checstyle
[Jul 10, 2016 3:58:52 PM] (varunsaxena) YARN-5037. Fix random failure of




-1 overall


The following subsystems voted -1:
    asflicense unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
    cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
    unit


Specific tests:

    Failed junit tests :

       hadoop.hdfs.server.namenode.TestEditLog 
       hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics 
       hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
       hadoop.yarn.server.TestContainerManagerSecurity 
       hadoop.yarn.client.cli.TestLogsCLI 
       hadoop.yarn.client.api.impl.TestYarnClient 
      

   cc:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/diff-compile-cc-root.txt
 [4.0K]

   javac:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/diff-compile-javac-root.txt
 [172K]

   checkstyle:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/diff-checkstyle-root.txt
 [16M]

   pylint:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/diff-patch-pylint.txt
 [16K]

   shellcheck:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/diff-patch-shellcheck.txt
 [20K]

   shelldocs:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/diff-patch-shelldocs.txt
 [16K]

   whitespace:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/whitespace-eol.txt
 [12M]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/whitespace-tabs.txt
 [1.3M]

   javadoc:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/diff-javadoc-javadoc-root.txt
 [2.3M]

   unit:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
 [144K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
 [268K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
 [16K]
       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
 [124K]

   asflicense:

       https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/91/artifact/out/patch-asflicense-problems.txt
 [4.0K]

Powered by Apache Yetus 0.4.0-SNAPSHOT   http://yetus.apache.org



Mime
View raw message