Return-Path: Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: (qmail 63373 invoked from network); 9 Aug 2010 21:12:47 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 9 Aug 2010 21:12:47 -0000 Received: (qmail 46529 invoked by uid 500); 9 Aug 2010 21:12:47 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 46484 invoked by uid 500); 9 Aug 2010 21:12:47 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 46476 invoked by uid 99); 9 Aug 2010 21:12:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Aug 2010 21:12:46 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [67.195.8.118] (HELO web110513.mail.gq1.yahoo.com) (67.195.8.118) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 09 Aug 2010 21:12:38 +0000 Received: (qmail 91481 invoked by uid 60001); 9 Aug 2010 21:12:16 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1281388336; bh=y0Ds4xRlG82B98u7YnZuQQD3dA4Ivu8bME6JtwwTuCc=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=E7TnPLHWyNcXnHvCAHyPMipYIPPQDb45joox0icg/1kqngF2c36Kvht/pUWtlKAh2bj7myteqOlL05Th46BCu7bkQO3NdhCWASoA22OaFypv/gessXwsqJ/lN3gKJPIJyQE/4lIBns266Q9kKEsistxOqKZEyKIfaUoJShvYiW8= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=fxvRlhq+26l1JVVFfPrRg6u2KoFjDJdZI1YfodtXKBJVVEbcYQCeOPWInF840CYjAzNp8OuiCGECqWOeDTys5aojqf5lVBhtpIKaJ1EvC7OXCB+wi4FCcdlBEddEOXUsVzvBQ/Un2gkvRS7KT7ho7uOB564WSNwmeoikKW3hNP8=; Message-ID: <307009.90706.qm@web110513.mail.gq1.yahoo.com> X-YMail-OSG: qkTWn90VM1lMr.hC9uRMH1jSq2zPpsuhMr4EnqQB8y8Y.rw boL7AMIl0bFcEbFtS0eHIIxA14h.hBeRbfh9sPISCQuC8jdzvPFXQT3ADKxg KQeUgtefAb8wevWVGU8Qv5qICbLpUJrV4FvSLFFC1ESQGpAUrRbk4VwIXODi ZTR33D6AWZyA4aGKF7jeDV_S.KJxfkmG.ffkRz6EJJ8581iR6DwX3cj4.JBR MB0obzqhHjl3nUdwdCJS8s0ZSD3LCByNGOfQqvsIZA4AwpeZVUqo8s4_ui1A x4Bw7gHHKkISn2iyDtB4sNZhsnK7L7bqbU_hdE.wGypGxTYRvgFzDg7AUGML .qhVS82zkdR_D8ATFeNneEvOTTXp9iL_IcNl6X5K_In_RuI.QIqBG19bZN9P GARQGTdFRVrIC Received: from [216.113.168.141] by web110513.mail.gq1.yahoo.com via HTTP; Mon, 09 Aug 2010 14:12:15 PDT X-Mailer: YahooMailRC/459 YahooMailWebService/0.8.105.279950 Date: Mon, 9 Aug 2010 14:12:15 -0700 (PDT) From: Ayon Sinha Subject: HDFS client java access To: hdfs-user@hadoop.apache.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="0-1944789725-1281388335=:90706" X-Virus-Checked: Checked by ClamAV on apache.org --0-1944789725-1281388335=:90706 Content-Type: text/plain; charset=us-ascii I have a HDFS java client on the same network domain as the cluster which needs to read the dfs file with permissions rw-r--r-- I get java.io.IOException at org.apache.hadoop.dfs.DFSClient.(DFSClient.java:169) at org.apache.hadoop.dfs.DistributedFileSystem.initialize(DistributedFileSystem.java:67) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1339) at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:56) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1351) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:213) Caused by: javax.security.auth.login.LoginException: Login failed: Expect one token as the result of whoami: nt authority\\system at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250) at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275) at org.apache.hadoop.dfs.DFSClient.(DFSClient.java:167)\r\n\t... 20 more\r\n&msg=2010-08-06 16:25:38,069 ERROR - com.ebay.integ.dal.cache2.CacheLoaderFailurenull\r\n Can I use job.set("dfs.permissions", "false"); My question is: Is it a matter of setting the right property values in the conf object? like user.name or dfs.web.ugi or does the clinet need to actually have a Unix login or passwordless ssh setup? -Ayon --0-1944789725-1281388335=:90706 Content-Type: text/html; charset=us-ascii
I have a HDFS java client on the same network domain as the cluster which needs to read the dfs file with permissions  rw-r--r--

I get 

java.io.IOException
at org.apache.hadoop.dfs.DFSClient.(DFSClient.java:169)
at org.apache.hadoop.dfs.DistributedFileSystem.initialize(DistributedFileSystem.java:67)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1339)
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:56)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1351)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:213)


Caused by: javax.security.auth.login.LoginException: Login failed: Expect one token as the result of whoami: nt authority\\system
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275) at org.apache.hadoop.dfs.DFSClient.(DFSClient.java:167)\r\n\t... 20 more\r\n&msg=2010-08-06 16:25:38,069 ERROR -
com.ebay.integ.dal.cache2.CacheLoaderFailurenull\r\n


Can I use 
job.set("dfs.permissions", "false");

My question is: Is it a matter of setting the right property values in the conf object? like user.name or  dfs.web.ugi or does the clinet need to actually have a Unix login or passwordless ssh setup?
 
-Ayon


--0-1944789725-1281388335=:90706--