hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gangadhar Ramini <use.had...@gmail.com>
Subject Re: Hello and request some advice.
Date Fri, 04 Jan 2013 18:51:25 GMT
Following is the configuration i put in config.
core-site.xml

  <property>
    <name>hadoop.tmp.dir</name>
    <value>/usr/local/hadoop/datastore/hadoop-${user.name}</value>
  </property>

hdfs-site.xml

 <property>
    <name>dfs.name.dir</name>
    <value>C:/cygwin/dfs/logs</value>
 </property>
 <property>
    <name>dfs.data.dir</name>
    <value>C:/cygwin/dfs/data</value>
 </property>

Thanks
-Gangadhar


On Fri, Jan 4, 2013 at 10:19 AM, Nitin Pawar <nitinpawar432@gmail.com>wrote:

> what about other directories like hdfs directories and tmp directories ?
>
>
> On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <use.hadoop@gmail.com>wrote:
>
>> Yes user owns the directory and had right permissions, still i don't
>> understand what could be the issue.
>>
>>
>> ls -ltr ~/hadoop-1.0.4/logs/history
>> total 0
>> drwxr-xr-x+ 1 garamini mkgroup 0 Jan  2 22:15
>>
>> Thanks
>> -Gangadhar
>>
>>
>>
>>
>>
>>
>>
>>
>> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <nitinpawar432@gmail.com>wrote:
>>
>>> Does your user have permissions to read/write on the dfs directories you
>>> made?
>>>
>>> try changing the directory ownerships to the user which is running
>>> hadoop.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <use.hadoop@gmail.com>wrote:
>>>
>>>> Hi Nitin,
>>>>
>>>>    I tried latest stable Hadoop version on windows with cygwin, I see
>>>> following error in JobTracker logs. Do you have any advice?
>>>>
>>>>  C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>>>         at
>>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>>>         at
>>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>>>         at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>>>         at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>>>         at
>>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>>>         at java.security.AccessController.doPrivileged(Native Method)^M
>>>>         at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>>>         at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>>> Thanks
>>>> -Gangadhar
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <nitinpawar432@gmail.com>wrote:
>>>>
>>>>> - Is Ubuntu a good O.S. for running Hadoop?  I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free
O.S.
>>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>>> RedHat then you may want to have look at Scientific Linux (Its free as
well)
>>>>>
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>>> and you can use it with localhost all the time.
>>>>>
>>>>>
>>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>>> cristiancarranza_1@hotmail.com> wrote:
>>>>>
>>>>>>   Hi all in this list!
>>>>>>
>>>>>> My name is Cristián Carranza, a statistician and quality consultant
>>>>>> that for the second time, intends to learn Hadoop and Big Data related
>>>>>> issues.
>>>>>> I’am requesting advice in order to plan my learning.
>>>>>> I read the page “ Products that include Apache Hadoop or derivative
>>>>>> works and Commercial Support”
>>>>>> but after that, I am still with doubts.
>>>>>>
>>>>>> Please, as a newcomer, I want some advice about the following topics:
>>>>>>
>>>>>> - I want to begin by learning how to find specified strings of text
>>>>>> in a hiuge data set (csv, txt format, huge means 10 Gb.
>>>>>> - Is Ubuntu a good O.S. for running Hadoop?  I’ve tried to learn
in
>>>>>> the past using Red Hat & Infosphere Biginsights, but I need a
free O.S.
>>>>>> - Is there a way to learn Hadoop without a static IP address? That
>>>>>> was really a problem for me when dealing with Infosphere, since I
travel
>>>>>> frequently.
>>>>>>
>>>>>> That’s all for now.
>>>>>> Any help will be greatly appreciated.
>>>>>>
>>>>>> thanks!
>>>>>>
>>>>>> Cristián Carranza
>>>>>> Brazil.
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Nitin Pawar
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>

Mime
View raw message