flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Alten-Lorenz <wget.n...@gmail.com>
Subject Re: error writing to collectorSink on mac os x
Date Fri, 30 Nov 2012 07:17:17 GMT
Hi,

Can you connect to your HDFS instance? Attach the config file for further debug.
Btw, per homebrew installed HDFS / Flume / whatever depends on the recipes homebrew uses.
Check this first please.

Best
- Alex


On Nov 30, 2012, at 6:50 AM, Abhi Dubey <abhishekit@gmail.com> wrote:

>> Hi,
>> 
>> I am running hadoop in pseudo-distributed mode on mac os x 10.8.2. I installed flume
(via homebrew) and I can write to console and local file system using text. Hadoop was also
installed via homebrew.
>> 
>> But if I use collectorSink and either a file target file:/// or hdfs://, I get an
error. The error is same for both types of targets.
>> 
>> 
>> 2012-11-29 20:22:47,182 [logicalNode new-host-2.home-21] INFO debug.InsistentAppendDecorator:
append attempt 6 failed, backoff (60000ms): failure to login
>> 2012-11-29 20:23:47,181 [pool-8-thread-1] INFO hdfs.EscapedCustomDfsSink: Opening
file:///Users/abhi/flume/testfile20121129-202317290-0800.1354249397290310000.00000037
>> 2012-11-29 20:23:47,183 [logicalNode new-host-2.home-21] INFO debug.StubbornAppendSink:
append failed on event 'new-host-2.home [INFO Thu Nov 29 20:21:44 PST 2012] #' with error:
failure to login
>> 2012-11-29 20:23:47,183 [logicalNode new-host-2.home-21] INFO rolling.RollSink: closing
RollSink 'escapedCustomDfs("file:///Users/abhi/flume","testfile%{rolltag}" )'
>> 2012-11-29 20:23:47,183 [logicalNode new-host-2.home-21] INFO rolling.RollSink: opening
RollSink  'escapedCustomDfs("file:///Users/abhi/flume","testfile%{rolltag}" )'
>> 2012-11-29 20:23:47,184 [logicalNode new-host-2.home-21] INFO debug.InsistentOpenDecorator:
Opened MaskDecorator on try 0
>> 2012-11-29 20:23:47,185 [pool-9-thread-1] INFO hdfs.EscapedCustomDfsSink: Opening
file:///Users/abhi/flume/testfile20121129-202347184-0800.1354249427184178000.00000021
>> 2012-11-29 20:23:47,192 [logicalNode new-host-2.home-21] INFO debug.InsistentAppendDecorator:
append attempt 7 failed, backoff (60000ms): failure to login
>> 
>> I am not sure what is going on. The permissions to the directory is 777. Can anyone
help with this error?
>> 
>> 
>> Thanks,
>> 
>> Abhi
> 

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF


Mime
View raw message