Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 970A9DB4A for ; Fri, 24 Aug 2012 00:06:46 +0000 (UTC) Received: (qmail 82771 invoked by uid 500); 24 Aug 2012 00:06:46 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 82696 invoked by uid 500); 24 Aug 2012 00:06:46 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 82685 invoked by uid 99); 24 Aug 2012 00:06:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Aug 2012 00:06:46 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of shaposhnik@gmail.com designates 209.85.212.51 as permitted sender) Received: from [209.85.212.51] (HELO mail-vb0-f51.google.com) (209.85.212.51) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Aug 2012 00:06:40 +0000 Received: by vbbfn1 with SMTP id fn1so1398874vbb.38 for ; Thu, 23 Aug 2012 17:06:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=mime-version:sender:date:x-google-sender-auth:message-id:subject :from:to:content-type; bh=AZQGE9GAovgnofTdJrHBcGvOOpl8WILyKnjSmPFSnuc=; b=LP+tsd0c+ANm5MRsLIBxGwX3vzDtrbJ49TtyaOvQuouwcluSVpOrpwTQaDjJK2b25+ ZO4OtiQsF3yv2480IT33T10MZ1m4Iy/iaTSic+K8UJMlDEOI9FfBNysq5YaVjZTfB9C7 jF1VRrOOq476vSJtIlMNaQZBIQl+evlmCDeAA52Xjg79Ajf6ZKO3QY8QjET3LpGfogXW ti1EAvT1zlf6CxTiDRhFEWn8MwAg13vWkv03056hOaASztjj2iq5VmEp3Kx/HVpiQsar MEewSAQ9ZLTIhutjPdAoj6RWNo5c9NWumnxXcE1Rj6VVmbjqNaWsnFeE0S9k1Xb8mDIy ShtQ== MIME-Version: 1.0 Received: by 10.220.218.133 with SMTP id hq5mr2891534vcb.60.1345766779389; Thu, 23 Aug 2012 17:06:19 -0700 (PDT) Sender: shaposhnik@gmail.com Received: by 10.58.207.228 with HTTP; Thu, 23 Aug 2012 17:06:19 -0700 (PDT) Date: Thu, 23 Aug 2012 17:06:19 -0700 X-Google-Sender-Auth: eu6coDbiVuPtaTIlUI71IyQGPAY Message-ID: Subject: S3 source From: Roman Shaposhnik To: user@flume.apache.org Content-Type: text/plain; charset=ISO-8859-1 Hi! I have, what I would imagine, is a pretty common use case -- a bunch of S3 buckets with access logging enabled. S3 is nice in a sense that the logging for the bucket all goes back to a bucket of your choice, but of course, I really want this data in HDFS so I can analyze it. Is there a flume source that can help me here? I couldn't find one. Thanks, Roman.