Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ECB3DF94C for ; Thu, 21 Mar 2013 19:09:37 +0000 (UTC) Received: (qmail 7771 invoked by uid 500); 21 Mar 2013 19:09:37 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 7691 invoked by uid 500); 21 Mar 2013 19:09:37 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 7683 invoked by uid 99); 21 Mar 2013 19:09:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Mar 2013 19:09:37 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of chrajeshbabu32@gmail.com designates 209.85.214.47 as permitted sender) Received: from [209.85.214.47] (HELO mail-bk0-f47.google.com) (209.85.214.47) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Mar 2013 19:09:33 +0000 Received: by mail-bk0-f47.google.com with SMTP id jc3so1534193bkc.20 for ; Thu, 21 Mar 2013 12:09:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=Xq8aVIyZE8yME5wO4nTZarR5Y+UL+KU395Pbzk+WY+A=; b=XwA6WWexCV+apIIBCpWY4TDneJG7sFfFBijmBVHQ/icT9Je0Okcn/DWfzPkI/d7rBF XUxZo/hOENtLgyxyff6Oe2sFZFPgEc+nHhqoDWt2F3NFw1IrddJWULIfVxlhl6jf3u5D TSokNH1AhsbGB/7lBM8wY1izp6Ut3C2mtgMZNe4VKDBGh/hDSpdjzjUrsF01pJXDRzU1 7VGK4EIvXjxK/8vUWdGfqOq7l1H/LYezpLnSOsrCSo0YOp6HHiPsBqqVnx2KTRzdfHEF fKw0dmnTRzDj0ItYE540fXOxWPqwYg+Iyvt6gKyeUaf8DiLJlC+NzkYEVgYgWTEtDkTt tZXg== MIME-Version: 1.0 X-Received: by 10.204.190.81 with SMTP id dh17mr14115268bkb.15.1363892952010; Thu, 21 Mar 2013 12:09:12 -0700 (PDT) Received: by 10.204.227.75 with HTTP; Thu, 21 Mar 2013 12:09:11 -0700 (PDT) In-Reply-To: References: Date: Fri, 22 Mar 2013 00:39:11 +0530 Message-ID: Subject: Re: file system query support from hbase script. From: rajesh babu chintaguntla To: dev@hbase.apache.org Content-Type: multipart/alternative; boundary=485b397dd6a7eace7f04d87412e9 X-Virus-Checked: Checked by ClamAV on apache.org --485b397dd6a7eace7f04d87412e9 Content-Type: text/plain; charset=ISO-8859-1 Hi Jon, Thanks for reply. bq.If this is the case, is there a reason why you can't just use the hadoop script (which i believe calls FsShell) in your scripts? In case of stand alone cluster we can just use linux commands(hadoop script also if present) other wise we can use hadoop script. My intention is to just provide abstraction from local file system or hdfs to query underneath file system in the same way from hbase bash shell by using FsShell.(hadoop build may or may not present). On Thu, Mar 21, 2013 at 7:04 PM, Jonathan Hsieh wrote: With your example your hbase scripts seem to be at the bash shell level (as opposed to the jruby hbase shell level). If this is the case, is there a reason why you can't just use the hadoop script (which i believe calls FsShell) in your scripts? Ex: $HADOOP_HOME/bin/hadoop fs -ls hdfs://127.0.0.1/hbase/.logs Jon. On Thu, Mar 21, 2013 at 6:20 AM, rajeshbabu chintaguntla < rajeshbabu.chintaguntla@huawei.com> wrote: > ________________________________ > > > Hi Dev, > > Just I want to know your opinion about having file system query support > from hbase script. > Presently We can use org.apache.hadoop.fs.FsShell tool from hbase script > to get basic information like list of files,disk usage etc from underneath > file system. > But user need to pass full path details like > hdfs://namenodehost/parent/child or file:///rootdir/path to the command. > For this user need to know whether hbase is using local file system or > hdfs and host details to form full path(need to check in configurations). > > Ex: $HBASE_HOME/bin/hbase org.apache.hadoop.fs.FsShell -ls hdfs:// > 127.0.0.1/hbase/.logs > > I want to simplify this by having one more command like "fscli" in hbase > script just like zkcli command support in such a way that user can query > file system by passing commands with simple paths as argument. > > Ex: $HBASE_HOME/bin/hbase fscli -ls /hbase/.logs > > New fscli command will also use FsShell tool but we will parse the > hbase.rootdir property value to get FS details and and append simple path > to it. > > If every one ok with it I will open a jira and contribute it. > > Thanks and Regards. > Rajeshbabu > > > > > -- // Jonathan Hsieh (shay) // Software Engineer, Cloudera // jon@cloudera.com --485b397dd6a7eace7f04d87412e9--