hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shashidhar Rao <raoshashidhar...@gmail.com>
Subject Re: MR2 submit job help
Date Sat, 01 Jun 2013 20:14:47 GMT
Shahab Yunus,

You are right , thanks so much for your help , now I am able to see the
file with
bin/hadoop fs -ls /

Thanks
Shashidhar


On Sun, Jun 2, 2013 at 12:51 AM, Shahab Yunus <shahab.yunus@gmail.com>wrote:

> Shashidhar,
>
> You ran the put command with 'fs'
> bin/hadoop fs -put sample.txt /sample3.txt
>
> Have you tried the ls command with fs too? I see you are using 'hdfs'. Try
> with 'fs'.
>
> Plus, the warning can be ignored. You would most probably need to build
> the code with your native libs but I think it is not needed at this point.
>
> Regards,
> Shahab
>
>
> On Sat, Jun 1, 2013 at 1:22 PM, Shashidhar Rao <raoshashidhar123@gmail.com
> > wrote:
>
>> Thanks Rahul, worked a bit but not fully
>>
>> Now when I run
>> bin/hadoop fs -put sample.txt /sample3.txt
>>
>> The warning still comes
>> 13/06/01 22:43:31 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>>
>> But, `sample.txt': No such file or directory error which came earlier do
>> not came.
>>
>> Now when I run ,bin/hadoop hdfs -ls
>>
>> Error: Could not find or load main class hdfs
>>
>> I have exported the export HADOOP_HDFS_HOME=${HADOOP_HOME} where
>> HADOOP_HOME is the root dir and  in this dir I have all the hdfs*.jars and
>> also the bin dir is inside HADOOP_HOME .
>>
>> Anything i have to export?
>>
>> Thanks
>> shashidhar
>>
>>
>> On Sat, Jun 1, 2013 at 10:27 PM, Rahul Bhattacharjee <
>> rahul.rec.dgp@gmail.com> wrote:
>>
>>> Thats a warn
>>>
>>> You might not have the users dir in hdfs.
>>>
>>>  try
>>>
>>>
>>> hadoop fs -put sample.txt /sample.txt
>>>
>>> Rahul
>>>
>>>
>>> On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao <
>>> raoshashidhar123@gmail.com> wrote:
>>>
>>>> After building MR2 , I am able to start all the daemons
>>>> 27873 Jps
>>>> 27096 NameNode
>>>> 27169 DataNode
>>>> 27326 NodeManager
>>>> 27398 JobHistoryServer
>>>> 13329
>>>> 27257 ResourceManager
>>>> 27043 Bootstrap
>>>>
>>>> but when I run bin/hadoop fs -put sample.txt sample.txt
>>>> I get the error
>>>> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load
>>>> native-hadoop library for your platform... using builtin-java classes where
>>>> applicable
>>>> put: `sample.txt': No such file or directory
>>>>
>>>> Native-hadoop library is not loaded
>>>>
>>>> what I need to do?
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <shahab.yunus@gmail.com>wrote:
>>>>
>>>>> Is you file name file.txt or file that you are trying to upload? Have
>>>>> you made sure about that? Is any other command working? Have you tried
>>>>> copyFromLocal?
>>>>>
>>>>> Regards,
>>>>> Shahab
>>>>>
>>>>>
>>>>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>>>>> rahul.rec.dgp@gmail.com> wrote:
>>>>>
>>>>>> you should be able to use hadoop fs -put <file> . file in the
>>>>>> directory where you are running the command.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>>>>> raoshashidhar123@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Users,
>>>>>>>
>>>>>>> Please help me with some documentation on how to submit job in
YARN
>>>>>>> and upload files in HDFS. Can I still use the MR1 commands for
file
>>>>>>> uploading to hadoop fs -put and hadoop jar job.jar input ouput?
Because I
>>>>>>> ran with errors saying file cannot be uploaded as file cannot
found. The
>>>>>>> directory structure is same .
>>>>>>>
>>>>>>> MR2 Directory structure/same as MR1
>>>>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>>>>> hadoop/ file.txt, job.jar etc
>>>>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>>>>
>>>>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file
file
>>>>>>> It says file cannot be found but I was able to run without error
in
>>>>>>> MR1
>>>>>>>
>>>>>>> Thanks
>>>>>>> shashidhar
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>

Mime
View raw message