Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A52B610504 for ; Thu, 3 Oct 2013 16:47:09 +0000 (UTC) Received: (qmail 60059 invoked by uid 500); 3 Oct 2013 16:47:08 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 59662 invoked by uid 500); 3 Oct 2013 16:47:06 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Delivered-To: moderator for dev@hbase.apache.org Received: (qmail 83479 invoked by uid 99); 3 Oct 2013 16:03:56 -0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) X-Yahoo-Newman-Property: ymail-5 X-Yahoo-Newman-Id: 470963.17624.bm@omp1060.mail.bf1.yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1380816206; bh=w34gvTcO5/5dCxaP+CvikBr4FgCHdTGc144jfn/JiCs=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=zYlQaaEawzHcLPMMwtWGPLAb3HiTHdNYbhIYHlzgH8vawMbrozuOqxUzUO3plUlL14/IB39F1o+0INZP7NR6lfF3Y6MPpARU6K3JKRpXnrrt9jiOri8QFn0Wsi4y/azSIYNT0tWZZY7iybMfSW8Su+iiBtVUYysHffojtBU5tkM= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=zKwF0D+NdkhOXgHzmP6ERS3UQGWczB1FMFFwwmpGNxNhqGorzmM4spujwxl71cTorXep3j9+2XV36RvW02IPHRax6Pxis7OuGbWLsa+JCXyQ9zxPhXauzdp6AR3aCi+3UApj6c3Km7Eqvym+U9eKdtLvJG9QwgKtTOLYQ0UC7aI=; X-YMail-OSG: FXo_aR4VM1ldJ7fEXji4CG_rGBqgBTrd3zjPJDq.wHWaBHo VsuucO5dpJU2Bt1g41FUuVvD1.VR6TFlkfMZc6IBCetfZZ2nGKWfpwIt7ESj 3N6KIm0lPjQOt5kJKU0rtZgcrLufItKA7kPUsza5K.LNgHXZfkxQouY08fQs 01OS__XHHZ175zoniFXzfGQQEfUnlVTVySeB0bW5GzPxhDd9rwRuVkyr0LnN JP.pWfj9_NRtgwDLKbE7bzEJGyTDpaIf0bwM81FLVkeeeVE5WsNKX110uKLe WyM2._FKiP1LgGDy7hIIYDFV1_JxkXMDsr1GYPLa6teyLnAXqjN99iN11utd 6Monz8Kc7HnpVKQTH7bmacwdpPj0EPUtjWxyL6L9G1YrjhVGQZPYZ_PPz4Dt _vGLEZgZjohr6hUQHpe4VJek1SGEYnDAD5kg4H1HqGU8a5KhGa9Hhtgfv6s2 cWUYL57c6sTM1k6ENTuhEkhay6AFOgickutCutJpOcWAYiPKerwKlCIzXsyq f4VqMHGyLuiyQOUMMe684QaVblqEVLsfTWE9Cdp2FpXtEHQ3dvILuKtBVb.B kEK4.t8fAN0ik87pxGzssoHlsmj_v.QHvOpHbfd8- X-Rocket-MIMEInfo: 002.001,QWRkaW5nIGRldkBoYmFzZS4KCi1IYXJkaWsuCgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KIEZyb206IGhhcmRpayBkb3NoaSA8a29vbF9oYXJkaWtAeWFob28uY29tPgpUbzogInVzZXJAaGJhc2UuYXBhY2hlLm9yZyIgPHVzZXJAaGJhc2UuYXBhY2hlLm9yZz4gClNlbnQ6IFdlZG5lc2RheSwgT2N0b2JlciAyLCAyMDEzIDQ6MzEgUE0KU3ViamVjdDogVGVtcCBkaXJlY3RvcnkgcGVybWlzc2lvbiBpc3N1ZSBpbiBMb2FkSW5jcmVtZW50YWxIRmlsZXMKIAoKCkhlbGxvLAoKV2UncmUgdXNpbmcBMAEBAQE- X-Mailer: YahooMailWebService/0.8.160.587 References: <1380756706.34613.YahooMailNeo@web140605.mail.bf1.yahoo.com> Message-ID: <1380816206.97569.YahooMailNeo@web140605.mail.bf1.yahoo.com> Date: Thu, 3 Oct 2013 09:03:26 -0700 (PDT) From: hardik doshi Reply-To: hardik doshi Subject: Re: Temp directory permission issue in LoadIncrementalHFiles To: "user@hbase.apache.org" , "dev@hbase.apache.org" In-Reply-To: <1380756706.34613.YahooMailNeo@web140605.mail.bf1.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="1254654340-712835670-1380816206=:97569" X-Virus-Checked: Checked by ClamAV on apache.org --1254654340-712835670-1380816206=:97569 Content-Type: text/plain; charset=us-ascii Adding dev@hbase. -Hardik. ________________________________ From: hardik doshi To: "user@hbase.apache.org" Sent: Wednesday, October 2, 2013 4:31 PM Subject: Temp directory permission issue in LoadIncrementalHFiles Hello, We're using LoadIncrementalHFiles.doBulkLoad to upload HFiles to an hbase table in bulk programmatically. But at times, the HFiles are too big to fit in a single region. So, the doBulkLoad method splits and stores the parts in a _tmp directory. This _tmp directory has 755 as permission and because of it, when actual upload starts we get an exception since the hbase user do not have permission to move this _tmp directory. org.apache.hadoop.security.AccessControlException: Permission denied: user=hbase, access=WRITE, inode="/tmp/BulkHBaseLoad/1380673269233/E/_tmp":bulkloader:supergroup:drwxr-xr-x We do set fs.permissions.umask-mode to 000 at the start of the job. (Which I believe has no effect) I understand that this the same problem described in https://issues.apache.org/jira/browse/HBASE-8495 I was wondering if there's any work around that i can use before the HBASE-8495 gets fixed. Thanks, Hardik. --1254654340-712835670-1380816206=:97569--