hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-20691) Storage policy should allow deferring to HDFS
Date Wed, 04 Jul 2018 10:55:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-20691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16532619#comment-16532619
] 

Hudson commented on HBASE-20691:
--------------------------------

Results for branch branch-2
	[build #942 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/942/]:
(/) *{color:green}+1 overall{color}*
----
details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/942//General_Nightly_Build_Report/]




(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/942//JDK8_Nightly_Build_Report_(Hadoop2)/]


(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/942//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Storage policy should allow deferring to HDFS
> ---------------------------------------------
>
>                 Key: HBASE-20691
>                 URL: https://issues.apache.org/jira/browse/HBASE-20691
>             Project: HBase
>          Issue Type: Bug
>          Components: Filesystem Integration, wal
>    Affects Versions: 1.5.0, 2.0.0
>            Reporter: Sean Busbey
>            Assignee: Yu Li
>            Priority: Blocker
>             Fix For: 2.1.0, 1.5.0, 2.0.2
>
>         Attachments: HBASE-20691.branch-1.patch, HBASE-20691.patch, HBASE-20691.v2.patch,
HBASE-20691.v3.patch, HBASE-20691.v4.patch, HBASE-20691.v5.patch, HBASE-20691.v6.patch, HBASE-20691.v7.patch,
HBASE-20691.v8.patch
>
>
> In HBase 1.1 - 1.4 we can defer storage policy decisions to HDFS by using "NONE" as the
storage policy in hbase configs.
> As described on this [dev@hbase thread "WAL storage policies and interactions with Hadoop
admin tools."|https://lists.apache.org/thread.html/d220726fab4bb4c9e117ecc8f44246402dd97bfc986a57eb22311117@%3Cdev.hbase.apache.org%3E]
we no longer have that option in 2.0.0 and 1.5.0 (as the branch is now). Additionally, we
can't set the policy to HOT in the event that HDFS has changed the policy for a parent directory
of our WALs.
> We should put back that ability. Presuming this is done by re-adopting the "NONE" placeholder
variable, we need to ensure that value doesn't get passed to HDFS APIs. Since it isn't a valid
storage policy attempting to use it will cause a bunch of logging churn (which will be a regression
of the problem HBASE-18118 sought to fix).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message