hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Work logged] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode
Date Mon, 30 Sep 2019 11:02:00 GMT

     [ https://issues.apache.org/jira/browse/HDDS-1569?focusedWorklogId=320454&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-320454
]

ASF GitHub Bot logged work on HDDS-1569:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 30/Sep/19 11:01
            Start Date: 30/Sep/19 11:01
    Worklog Time Spent: 10m 
      Work Description: hadoop-yetus commented on issue #1431: HDDS-1569 Support creating
multiple pipelines with same datanode
URL: https://github.com/apache/hadoop/pull/1431#issuecomment-536512188
 
 
   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime | Comment |
   |:----:|----------:|--------:|:--------|
   | 0 | reexec | 37 | Docker mode activated. |
   ||| _ Prechecks _ |
   | +1 | dupname | 1 | No case conflicting files found. |
   | +1 | @author | 0 | The patch does not contain any @author tags. |
   | +1 | test4tests | 0 | The patch appears to include 19 new or modified test files. |
   ||| _ HDDS-1564 Compile Tests _ |
   | 0 | mvndep | 20 | Maven dependency ordering for branch |
   | -1 | mvninstall | 29 | hadoop-hdds in HDDS-1564 failed. |
   | -1 | mvninstall | 35 | hadoop-ozone in HDDS-1564 failed. |
   | -1 | compile | 17 | hadoop-hdds in HDDS-1564 failed. |
   | -1 | compile | 13 | hadoop-ozone in HDDS-1564 failed. |
   | +1 | checkstyle | 55 | HDDS-1564 passed |
   | +1 | mvnsite | 0 | HDDS-1564 passed |
   | +1 | shadedclient | 919 | branch has no errors when building and testing our client artifacts.
|
   | -1 | javadoc | 17 | hadoop-hdds in HDDS-1564 failed. |
   | -1 | javadoc | 15 | hadoop-ozone in HDDS-1564 failed. |
   | 0 | spotbugs | 999 | Used deprecated FindBugs config; considering switching to SpotBugs.
|
   | -1 | findbugs | 27 | hadoop-hdds in HDDS-1564 failed. |
   | -1 | findbugs | 16 | hadoop-ozone in HDDS-1564 failed. |
   ||| _ Patch Compile Tests _ |
   | 0 | mvndep | 24 | Maven dependency ordering for patch |
   | -1 | mvninstall | 30 | hadoop-hdds in the patch failed. |
   | -1 | mvninstall | 34 | hadoop-ozone in the patch failed. |
   | -1 | compile | 20 | hadoop-hdds in the patch failed. |
   | -1 | compile | 14 | hadoop-ozone in the patch failed. |
   | -1 | javac | 20 | hadoop-hdds in the patch failed. |
   | -1 | javac | 14 | hadoop-ozone in the patch failed. |
   | -0 | checkstyle | 23 | hadoop-hdds: The patch generated 2 new + 0 unchanged - 3 fixed
= 2 total (was 3) |
   | +1 | mvnsite | 0 | the patch passed |
   | +1 | whitespace | 0 | The patch has no whitespace issues. |
   | +1 | xml | 1 | The patch has no ill-formed XML file. |
   | +1 | shadedclient | 757 | patch has no errors when building and testing our client artifacts.
|
   | -1 | javadoc | 17 | hadoop-hdds in the patch failed. |
   | -1 | javadoc | 15 | hadoop-ozone in the patch failed. |
   | -1 | findbugs | 27 | hadoop-hdds in the patch failed. |
   | -1 | findbugs | 16 | hadoop-ozone in the patch failed. |
   ||| _ Other Tests _ |
   | -1 | unit | 23 | hadoop-hdds in the patch failed. |
   | -1 | unit | 22 | hadoop-ozone in the patch failed. |
   | +1 | asflicense | 28 | The patch does not generate ASF License warnings. |
   | | | 2380 | |
   
   
   | Subsystem | Report/Notes |
   |----------:|:-------------|
   | Docker | Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/Dockerfile
|
   | GITHUB PR | https://github.com/apache/hadoop/pull/1431 |
   | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient
findbugs checkstyle xml |
   | uname | Linux 76e0561ad5ca 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019
x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | personality/hadoop.sh |
   | git revision | HDDS-1564 / 7b5a5fe |
   | Default Java | 1.8.0_222 |
   | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/branch-mvninstall-hadoop-hdds.txt
|
   | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/branch-mvninstall-hadoop-ozone.txt
|
   | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/branch-compile-hadoop-hdds.txt
|
   | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/branch-compile-hadoop-ozone.txt
|
   | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/branch-javadoc-hadoop-hdds.txt
|
   | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/branch-javadoc-hadoop-ozone.txt
|
   | findbugs | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/branch-findbugs-hadoop-hdds.txt
|
   | findbugs | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/branch-findbugs-hadoop-ozone.txt
|
   | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-mvninstall-hadoop-hdds.txt
|
   | mvninstall | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-mvninstall-hadoop-ozone.txt
|
   | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-compile-hadoop-hdds.txt
|
   | compile | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-compile-hadoop-ozone.txt
|
   | javac | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-compile-hadoop-hdds.txt
|
   | javac | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-compile-hadoop-ozone.txt
|
   | checkstyle | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/diff-checkstyle-hadoop-hdds.txt
|
   | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-javadoc-hadoop-hdds.txt
|
   | javadoc | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-javadoc-hadoop-ozone.txt
|
   | findbugs | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-findbugs-hadoop-hdds.txt
|
   | findbugs | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-findbugs-hadoop-ozone.txt
|
   | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-unit-hadoop-hdds.txt
|
   | unit | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/artifact/out/patch-unit-hadoop-ozone.txt
|
   |  Test Results | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/testReport/
|
   | Max. process+thread count | 341 (vs. ulimit of 5500) |
   | modules | C: hadoop-hdds/common hadoop-hdds/server-scm hadoop-ozone/integration-test
hadoop-ozone/tools U: . |
   | Console output | https://builds.apache.org/job/hadoop-multibranch/job/PR-1431/17/console
|
   | versions | git=2.7.4 maven=3.3.9 |
   | Powered by | Apache Yetus 0.10.0 http://yetus.apache.org |
   
   
   This message was automatically generated.
   
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 320454)
    Time Spent: 5h 50m  (was: 5h 40m)

> Add ability to SCM for creating multiple pipelines with same datanode
> ---------------------------------------------------------------------
>
>                 Key: HDDS-1569
>                 URL: https://issues.apache.org/jira/browse/HDDS-1569
>             Project: Hadoop Distributed Data Store
>          Issue Type: Sub-task
>          Components: SCM
>            Reporter: Siddharth Wagle
>            Assignee: Li Cheng
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 5h 50m
>  Remaining Estimate: 0h
>
> - Refactor _RatisPipelineProvider.create()_ to be able to create pipelines with datanodes
that are not a part of sufficient pipelines
> - Define soft and hard upper bounds for pipeline membership
> - Create SCMAllocationManager that can be leveraged to get a candidate set of datanodes
based on placement policies
> - Add the datanodes to internal datastructures



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message