Return-Path: 
 <flume-user-return-147-apmail-incubator-flume-user-archive=incubator.apache.org@incubator.apache.org>
X-Original-To: apmail-incubator-flume-user-archive@minotaur.apache.org
Delivered-To: apmail-incubator-flume-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id B7B0E8B9C
	for <apmail-incubator-flume-user-archive@minotaur.apache.org>;
 Thu, 18 Aug 2011 18:25:16 +0000 (UTC)
Received: (qmail 59299 invoked by uid 500); 18 Aug 2011 18:25:16 -0000
Delivered-To: apmail-incubator-flume-user-archive@incubator.apache.org
Received: (qmail 59279 invoked by uid 500); 18 Aug 2011 18:25:15 -0000
Mailing-List: contact flume-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:flume-user-help@incubator.apache.org>
List-Unsubscribe: <mailto:flume-user-unsubscribe@incubator.apache.org>
List-Post: <mailto:flume-user@incubator.apache.org>
List-Id: <flume-user.incubator.apache.org>
Reply-To: flume-user@incubator.apache.org
Delivered-To: mailing list flume-user@incubator.apache.org
Received: (qmail 59271 invoked by uid 99); 18 Aug 2011 18:25:15 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Aug 2011 18:25:15 +0000
X-ASF-Spam-Status: No, hits=1.6 required=5.0
	tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of jonny2112@gmail.com
 designates 209.85.210.41 as permitted sender)
Received: from [209.85.210.41] (HELO mail-pz0-f41.google.com) (209.85.210.41)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Aug 2011 18:25:08 +0000
Received: by pzk4 with SMTP id 4so4729876pzk.28
        for <flume-user@incubator.apache.org>;
 Thu, 18 Aug 2011 11:24:48 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=mime-version:from:date:message-id:subject:to:content-type;
        bh=1mta9zDkLwyFxQHskVIdO/mXwXn+5+tPaqxBOmieWVQ=;
        b=XflwAdeFCDGDbYtsnMXpnni2lcadtpGL6VgZ+v55sApeYIvyMlbx2ldPWTu5tQW7bb
         t5cZVYIMMEI4qJjfXdlmAwfetunvAiq1dX11IT6v0qZOR10zER9kOWBFH+jcmFtxh0Ar
         nH/gRRMz42G7E7CyghKy9LhnBWKremyaeHJr4=
Received: by 10.142.222.1 with SMTP id u1mr508816wfg.141.1313691888610; Thu,
 18 Aug 2011 11:24:48 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.142.195.3 with HTTP; Thu, 18 Aug 2011 11:24:27 -0700 (PDT)
From: Jonathan <jonny2112@gmail.com>
Date: Thu, 18 Aug 2011 14:24:27 -0400
Message-ID: 
 <CAH2V9sV6fsAQKAh74K1xovkFiwTLu2iiWMBavnVQWaGthxg9og@mail.gmail.com>
Subject: Getting Data from S3
To: flume-user@incubator.apache.org
Content-Type: multipart/alternative; boundary=000e0cd327a85d6c8604aacbbaef

--000e0cd327a85d6c8604aacbbaef
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I was wondering if Flume supports retrieving data from an S3 bucket and
sinking into HDFS. The s3 bucket is getting updated on a regular basis so I
would like for flume to catch any changes on s3 and move them accordingly.
 I have seen a lot of documentation on using S3 as a sink but I haven't been
able to find anything going the other way. Is this even possible?


Thanks
Jonathan

--000e0cd327a85d6c8604aacbbaef
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<span class=3D"Apple-style-span" style=3D"color: rgb(51, 51, 51); font-fami=
ly: arial, sans-serif; font-size: 13px; background-color: rgb(255, 255, 255=
); ">Hi,<div><br></div><div>I was wondering if Flume=A0supports=A0retrievin=
g data from an S3 bucket and sinking into HDFS. The s3 bucket is getting up=
dated on a regular basis so I would like for flume to catch any changes on =
s3 and move them accordingly. =A0I have seen a lot of=A0documentation=A0on =
using S3 as a sink but I=A0haven&#39;t=A0been able to find anything going t=
he other way. Is this even possible?</div>

<div><br></div></span><div><br></div><div>Thanks</div><div>Jonathan</div><d=
iv><br></div>

--000e0cd327a85d6c8604aacbbaef--