Mailing-List: contact user-help@flume.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flume.apache.org
Received-SPF: pass (athena.apache.org: domain of wget.null@gmail.com
 designates 209.85.215.179 as permitted sender)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\))
Subject: Re: error writing to collectorSink on mac os x
From: Alexander Alten-Lorenz <wget.null@gmail.com>
In-Reply-To: <4179D3AE-2789-4D0F-9E3C-5AF5B5CF5140@gmail.com>
Date: Fri, 30 Nov 2012 08:17:17 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <0DBB48FE-FEF6-45D0-AE99-898E64CC3D01@gmail.com>
References: <A7B9CD4B-7126-4D4B-A0EE-88BE33A405F7@gmail.com>
 <4179D3AE-2789-4D0F-9E3C-5AF5B5CF5140@gmail.com>
To: user@flume.apache.org

Hi,

Can you connect to your HDFS instance? Attach the config file for =
further debug.
Btw, per homebrew installed HDFS / Flume / whatever depends on the =
recipes homebrew uses. Check this first please.

Best
- Alex


On Nov 30, 2012, at 6:50 AM, Abhi Dubey <abhishekit@gmail.com> wrote:

>> Hi,
>>=20
>> I am running hadoop in pseudo-distributed mode on mac os x 10.8.2. I =
installed flume (via homebrew) and I can write to console and local file =
system using text. Hadoop was also installed via homebrew.
>>=20
>> But if I use collectorSink and either a file target file:/// or =
hdfs://, I get an error. The error is same for both types of targets.
>>=20
>>=20
>> 2012-11-29 20:22:47,182 [logicalNode new-host-2.home-21] INFO =
debug.InsistentAppendDecorator: append attempt 6 failed, backoff =
(60000ms): failure to login
>> 2012-11-29 20:23:47,181 [pool-8-thread-1] INFO =
hdfs.EscapedCustomDfsSink: Opening =
file:///Users/abhi/flume/testfile20121129-202317290-0800.13542493972903100=
00.00000037
>> 2012-11-29 20:23:47,183 [logicalNode new-host-2.home-21] INFO =
debug.StubbornAppendSink: append failed on event 'new-host-2.home [INFO =
Thu Nov 29 20:21:44 PST 2012] #' with error: failure to login
>> 2012-11-29 20:23:47,183 [logicalNode new-host-2.home-21] INFO =
rolling.RollSink: closing RollSink =
'escapedCustomDfs("file:///Users/abhi/flume","testfile%{rolltag}" )'
>> 2012-11-29 20:23:47,183 [logicalNode new-host-2.home-21] INFO =
rolling.RollSink: opening RollSink  =
'escapedCustomDfs("file:///Users/abhi/flume","testfile%{rolltag}" )'
>> 2012-11-29 20:23:47,184 [logicalNode new-host-2.home-21] INFO =
debug.InsistentOpenDecorator: Opened MaskDecorator on try 0
>> 2012-11-29 20:23:47,185 [pool-9-thread-1] INFO =
hdfs.EscapedCustomDfsSink: Opening =
file:///Users/abhi/flume/testfile20121129-202347184-0800.13542494271841780=
00.00000021
>> 2012-11-29 20:23:47,192 [logicalNode new-host-2.home-21] INFO =
debug.InsistentAppendDecorator: append attempt 7 failed, backoff =
(60000ms): failure to login
>>=20
>> I am not sure what is going on. The permissions to the directory is =
777. Can anyone help with this error?
>>=20
>>=20
>> Thanks,
>>=20
>> Abhi
>=20

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF