Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6729A10645 for ; Wed, 2 Oct 2013 23:36:23 +0000 (UTC) Received: (qmail 14715 invoked by uid 500); 2 Oct 2013 23:36:20 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 14622 invoked by uid 500); 2 Oct 2013 23:36:20 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Delivered-To: moderator for user@hbase.apache.org Received: (qmail 10917 invoked by uid 99); 2 Oct 2013 23:32:14 -0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 543970.44105.bm@omp1049.mail.bf1.yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1380756706; bh=rn27KQMWSzPdJJro+mPh+i2rlVdbvzd5ysod6CMOCpE=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type; b=K36I/sl12LBv+YK3zK5uuxKUVVRkOaLLSghzVNx5Dup4Hqnb48Vf+haa7tSeWfrcYRdX8n7uA0GqOMrTc/BcBevdt6uZQJK+lKeai/bKxcnBVVF3XmBSyaJhW6ZGSlzWkR3yizBtqHSj51vaObATsTk1552TOLH9SQF+o8yzEQk= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type; b=zr1mEdRImqHpnP17lhejcxfCMRhiqTaVqkEkfm/iqLRePUwme9n9ewfqlDy1jXNeVcsvd37Wo2PjdCZSJa9K1xL0AEuQ8N8SQxTlWz4z3CxgOFCbE4n4rIjg8W9m2pMlIduh0M44HuK0+wEQdrKdn5kk3dNj2nFQzX5L5SyReDs=; X-YMail-OSG: p1Lvv5cVM1n1_kzblzdXROrByK0ZTg.cQADFbHY0z5kQDwQ Lc_CCrQw542Zk5E3f46.fvmWW2_TRcBfP5F3FzGXSNaj5tJ.l6pyWRz.ace8 kBz_qv3qoXndzgfbzhmrnGSNiwVg6knCsGrGlpyjXmNNXnqxCbKgViadd8zu _c9cSVqhCicMfcwQfPfeefivT_t6TZa_bZzr1VmD302PKumQ7HlgATwsSAt9 R2tTmP.zl_F9_zqdOhDBGM.irubV8IkLzhuxCYd04iM6q2tE_Y4OoA_btk7e kHDPVk05VzNNK2L.lB384On7PlPp3SMMk3ZZIdxAqk.GIeSAMyUw6AI4Cj5j NFqgLkRenlTJ.f3CwMzTC1uECVhB1QI48tFvwNJQuPGif5vPfgqWsfJNkI.n 5kAalatQHJm0wPdb_xyvYfFciDdIVxTa_d8mBy7ix8Ft1g5R8xWZAfaPlwdz gR8J8356vImcYki4fzABUGpqROqDvakG1WsDrgrdNYLyqls4aQZQf5kaieEF rdNXXUwiVlAPC_zftmIjRL9OtLm2_Z5rxnYKLzVrVn59TZPcBIUpQW1_cWny 6eb55mAuDEpV4x_bu.bsNUt_jl4JudyqBWrlVDZXwAfc8mywuOzZQtVkqCEZ gYZ1e6Cqy_e3.Bg1Dz_uDUubkkXB3LGDvnImgMs44ZsKdJbuz X-Rocket-MIMEInfo: 002.001,SGVsbG8sCgpXZSdyZSB1c2luZyBMb2FkSW5jcmVtZW50YWxIRmlsZXMuZG9CdWxrTG9hZCB0byB1cGxvYWQgSEZpbGVzIHRvIGFuIGhiYXNlIHRhYmxlIGluIGJ1bGsgcHJvZ3JhbW1hdGljYWxseS4KQnV0IGF0IHRpbWVzLCB0aGUgSEZpbGVzIGFyZSB0b28gYmlnIHRvIGZpdCBpbiBhIHNpbmdsZSByZWdpb24uIFNvLCB0aGUgZG9CdWxrTG9hZCBtZXRob2Qgc3BsaXRzIGFuZCBzdG9yZXMgdGhlIHBhcnRzCmluIGEgX3RtcCBkaXJlY3RvcnkuIFRoaXMgX3RtcCBkaXJlY3RvcnkgaGFzIDc1NSBhcyBwZXJtaXMBMAEBAQE- X-Mailer: YahooMailWebService/0.8.160.587 Message-ID: <1380756706.34613.YahooMailNeo@web140605.mail.bf1.yahoo.com> Date: Wed, 2 Oct 2013 16:31:46 -0700 (PDT) From: hardik doshi Reply-To: hardik doshi Subject: Temp directory permission issue in LoadIncrementalHFiles To: "user@hbase.apache.org" MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="1254654340-620655410-1380756706=:34613" X-Virus-Checked: Checked by ClamAV on apache.org --1254654340-620655410-1380756706=:34613 Content-Type: text/plain; charset=us-ascii Hello, We're using LoadIncrementalHFiles.doBulkLoad to upload HFiles to an hbase table in bulk programmatically. But at times, the HFiles are too big to fit in a single region. So, the doBulkLoad method splits and stores the parts in a _tmp directory. This _tmp directory has 755 as permission and because of it, when actual upload starts we get an exception since the hbase user do not have permission to move this _tmp directory. org.apache.hadoop.security.AccessControlException: Permission denied: user=hbase, access=WRITE, inode="/tmp/BulkHBaseLoad/1380673269233/E/_tmp":bulkloader:supergroup:drwxr-xr-x We do set fs.permissions.umask-mode to 000 at the start of the job. (Which I believe has no effect) I understand that this the same problem described in https://issues.apache.org/jira/browse/HBASE-8495 I was wondering if there's any work around that i can use before the HBASE-8495 gets fixed. Thanks, Hardik. --1254654340-620655410-1380756706=:34613--