hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karim Awara <karim.aw...@kaust.edu.sa>
Subject Re: Permission problem in Junit test - Hadoop 2.2.0
Date Wed, 18 Dec 2013 12:45:32 GMT
Note: I have built hadoop not in my home directory but rather in a
different volume.

--
Best Regards,
Karim Ahmed Awara


On Wed, Dec 18, 2013 at 10:41 AM, Karim Awara <karim.awara@kaust.edu.sa>wrote:

>
> Still the same problem. IF you notice, The unit test actually created the
> directories upto  $HOME_HDFS/build/test/data/dfs  without problems at all.
> I think that because MiniDFSCluster is emulating a cluster of one namenode
> and two datanodes, it tries to create dir for th datanodes and this is
> where it hit the permissions problem. May be something related to
> localhost  settings?
>
> --
> Best Regards,
> Karim Ahmed Awara
>
>
> On Wed, Dec 18, 2013 at 2:47 AM, Andre Kelpe <akelpe@concurrentinc.com>wrote:
>
>> You have to start eclipse from an environment that has the correct umask
>> set, otherwise it will not inherit the settings.
>>
>> Open a terminal, do umask 022 && eclipse and re-try to run the tests.
>>
>> - André
>>
>>
>> On Wed, Dec 18, 2013 at 12:35 AM, Karim Awara <karim.awara@kaust.edu.sa>wrote:
>>
>>>
>>> Yes. Nothing yet. I should mention I compiled hadoop 2.2 from the src
>>> using maven on a single machine (mac os x). It seems whatever I do in the
>>> permissions, the error persists.
>>>
>>> --
>>> Best Regards,
>>> Karim Ahmed Awara
>>>
>>>
>>> On Wed, Dec 18, 2013 at 2:24 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>>>
>>>> Have you set umask to 022 ?
>>>>
>>>> See https://issues.apache.org/jira/browse/HDFS-2556
>>>>
>>>> Cheers
>>>>
>>>>
>>>> On Tue, Dec 17, 2013 at 3:12 PM, Karim Awara <karim.awara@kaust.edu.sa>wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I am running Junit test on hadoop 2.2.0 on eclipse on mac os x.
>>>>> Whenever I run the test, I am faced with the following error
>>>>>
>>>>> It seems there is a problem with the permission test data dir.
>>>>> Please advise.
>>>>>
>>>>>
>>>>> 2013-12-18 02:09:19,326 ERROR hdfs.MiniDFSCluster
>>>>> (MiniDFSCluster.java:initMiniDFSCluster(647)) - IOE creating namenodes.
>>>>> Permissions dump:
>>>>> path 'build/test/data/dfs/data':
>>>>>
>>>>> absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build/test/data/dfs/data
>>>>>     permissions: ----
>>>>> path 'build/test/data/dfs':
>>>>>
>>>>> absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build/test/data/dfs
>>>>>     permissions: drwx
>>>>> path 'build/test/data':
>>>>>     absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build/test/data
>>>>>     permissions: drwx
>>>>> path 'build/test':
>>>>>     absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build/test
>>>>>     permissions: drwx
>>>>> path 'build':
>>>>>     absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build
>>>>>     permissions: drwx
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Best Regards,
>>>>> Karim Ahmed Awara
>>>>>
>>>>> ------------------------------
>>>>> This message and its contents, including attachments are intended
>>>>> solely for the original recipient. If you are not the intended recipient
or
>>>>> have received this message in error, please notify me immediately and
>>>>> delete this message from your computer system. Any unauthorized use or
>>>>> distribution is prohibited. Please consider the environment before printing
>>>>> this email.
>>>>
>>>>
>>>>
>>>
>>> ------------------------------
>>> This message and its contents, including attachments are intended solely
>>> for the original recipient. If you are not the intended recipient or have
>>> received this message in error, please notify me immediately and delete
>>> this message from your computer system. Any unauthorized use or
>>> distribution is prohibited. Please consider the environment before printing
>>> this email.
>>>
>>
>>
>>
>> --
>> André Kelpe
>> andre@concurrentinc.com
>> http://concurrentinc.com
>>
>
>

-- 

------------------------------
This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.

Mime
View raw message