hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Busbey <bus...@apache.org>
Subject Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
Date Tue, 21 Jul 2020 13:33:43 GMT
that is the detail message of why it determined that the FileSystem
doesn't support setStoragePolicy. As opposed to e.g. a security
manager denying access to introspect the methods available.

On Tue, Jul 21, 2020 at 8:24 AM Debraj Manna <subharaj.manna@gmail.com> wrote:
>
> I understood the "util.CommonFSUtils: FileSystem doesn't support
> setStoragePolicy;" part.
>
> Can you let me know why it is saying "java.lang.NoSuchMethodException:
> org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20
> 06:02:24,859 WARN  [StoreOpener-1588230740-1]" ?
>
>
> On Tue, Jul 21, 2020 at 6:43 PM zheng wang <18031031@qq.com> wrote:
>
> > This log info just as a warning that cant make it disappear for now, but
> > will not impact anything, so you can just ignore it in local mode.
> >
> >
> > ------------------&nbsp;原始邮件&nbsp;------------------
> > 发件人:
> >                                                   "user"
> >                                                                 <
> > subharaj.manna@gmail.com&gt;;
> > 发送时间:&nbsp;2020年7月21日(星期二) 晚上9:19
> > 收件人:&nbsp;"Hbase-User"<user@hbase.apache.org&gt;;
> >
> > 主题:&nbsp;Re: HBase 2.1.0 - NoSuchMethodException
> > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> >
> >
> >
> > Thanks for replying.
> >
> > Yes it is a single node hbase cluster. I am not specifying any storage
> > policy. Looking at the HStore
> > <
> > https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274&gt
> > ;
> > code it appears even if no storage policy is specified it will take HOT.
> >
> > Can you explain this a bit more how can I get around this error or in a
> > single node hbase cluster I should be ignoring this?
> >
> >
> > On Tue, Jul 21, 2020 at 3:03 PM zheng wang <18031031@qq.com&gt; wrote:
> >
> > &gt; LocalFileSystem? The&amp;nbsp;setStoragePolicy could only be used in
> > &gt; distributed hdfs.
> > &gt; &amp;nbsp;
> > &gt;
> > &gt;
> > &gt; ------------------&amp;nbsp;原始邮件&amp;nbsp;------------------
> > &gt; 发件人:
> > &gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> > "user"
> > &gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> > <
> > &gt; subharaj.manna@gmail.com&amp;gt;;
> > &gt; 发送时间:&amp;nbsp;2020年7月21日(星期二) 下午5:58
> > &gt; 收件人:&amp;nbsp;"Hbase-User"<user@hbase.apache.org&amp;gt;;
> > &gt;
> > &gt; 主题:&amp;nbsp;HBase 2.1.0 - NoSuchMethodException
> > &gt; org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> > &gt;
> > &gt;
> > &gt;
> > &gt; Hi
> > &gt;
> > &gt; I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase master logs I am
> > &gt; seeing a warning like below
> > &gt;
> > &gt; 2020-07-20 06:02:24,859 WARN&amp;nbsp; [StoreOpener-1588230740-1]
> > &gt; util.CommonFSUtils: FileSystem doesn't support setStoragePolicy;
> > &gt; HDFS-6584, HDFS-9345 not available. This is normal and expected on
> > &gt; earlier Hadoop versions.
> > &gt; java.lang.NoSuchMethodException:
> > &gt;
> > &gt;
> > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path,
> > &gt; java.lang.String)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt; java.lang.Class.getDeclaredMethod(Class.java:2130)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt;
> > org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:577)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt;
> > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:558)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt;
> > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:526)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt;
> > org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:194)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt;
> > org.apache.hadoop.hbase.regionserver.HStore.<init&amp;gt;(HStore.java:264)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt;
> > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5731)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt; org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1059)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt; org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1056)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt; java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt;
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt; java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt;
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt;
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> > &gt;
> > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
at
> > &gt; java.lang.Thread.run(Thread.java:748)
> > &gt;
> > &gt; As per my understanding, this error should not be coming with Hadoop
> > &gt; 3.0.0. Can someone let me know if my understanding is correct or what
> > &gt; could be going wrong here?



-- 
Sean

Mime
View raw message