Return-Path: X-Original-To: apmail-apex-dev-archive@minotaur.apache.org Delivered-To: apmail-apex-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EA6B718239 for ; Thu, 17 Mar 2016 08:34:23 +0000 (UTC) Received: (qmail 28423 invoked by uid 500); 17 Mar 2016 08:34:23 -0000 Delivered-To: apmail-apex-dev-archive@apex.apache.org Received: (qmail 28350 invoked by uid 500); 17 Mar 2016 08:34:23 -0000 Mailing-List: contact dev-help@apex.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.incubator.apache.org Delivered-To: mailing list dev@apex.incubator.apache.org Received: (qmail 28338 invoked by uid 99); 17 Mar 2016 08:34:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Mar 2016 08:34:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id D828A1A064C for ; Thu, 17 Mar 2016 08:34:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.298 X-Spam-Level: * X-Spam-Status: No, score=1.298 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=datatorrent-com.20150623.gappssmtp.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id Iy3MPERfMBpe for ; Thu, 17 Mar 2016 08:34:20 +0000 (UTC) Received: from mail-qg0-f45.google.com (mail-qg0-f45.google.com [209.85.192.45]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id 1EEB25F22F for ; Thu, 17 Mar 2016 08:34:20 +0000 (UTC) Received: by mail-qg0-f45.google.com with SMTP id a36so34169693qge.0 for ; Thu, 17 Mar 2016 01:34:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=datatorrent-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=aTqA5PxTMy9eUhUcVN3pOpaAjKakcxVtzR+/yAa2CS4=; b=RZeNARtjCEPaYYzaBgVFKKR/korMVNJmVw3lgDYKHyK7SN3jimhTI3oHm2768AAnsD l6AupTNg8Qu7+7UlhB3+LIHFNP6ul0jUNIxHWC3KXNtm940Fu5anBLyzT1CXqzBJT4lf vQezeY0EyIa51av2kO73/DFeRDVpdHPihEpZNmXBQhxYDcxRBi0U66cpj11uaiyvkJ5R gUgu6TCmbMdSMnS9DT4ZTf7Lr6F3W1NrXsCy9sVb+XBASbJQ0b/miT5ePPzrhc4HktV2 De8Wo/oK4Pys9lLK1pf2j/G2dkrueKjOovAm8vIMiSbXzJywLDTz4Td62/Fhessjvsib Z80Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=aTqA5PxTMy9eUhUcVN3pOpaAjKakcxVtzR+/yAa2CS4=; b=TklBz5iPF18EX3Ui3pzfO/zVQKMRbgnZ6i7ckKeXcsmkBOsN13TYrHG3ou9qM7LGny t0BFamuIIMrv8ZwAD+6iVxnKj7YwLCPuogqHfNm5U11BA28961eyDGxUdK5xeovfHXhK 7yWa147xVqLnkdExj9a/DWP88pLzyBJ50uRhaJiAKUIH8trnQBTora5i6jtdHxHRJSne nrgEpF+exqJm9g3jDqdv+M7RmRj+B9YH4mpR6eJvEFv6UcpB1m3f30nrQArxJ/dNgx5I dMo5t9I4s8VhKkBXuAYf4bHd23ukVdmAyGx6zOO1UB/asuBxV8b/mMtxlvfdcM5H4LC4 IgJg== X-Gm-Message-State: AD7BkJIcSs+pwmrWW1sVC6SHpIgi+lAJWuf60++XbAdMyZq87/PJCm5G5RzHhwfLbyOjDELejIs9nihpCXPsBmBp MIME-Version: 1.0 X-Received: by 10.140.242.21 with SMTP id n21mr13397806qhc.2.1458203659238; Thu, 17 Mar 2016 01:34:19 -0700 (PDT) Received: by 10.140.43.99 with HTTP; Thu, 17 Mar 2016 01:34:19 -0700 (PDT) In-Reply-To: References: Date: Thu, 17 Mar 2016 14:04:19 +0530 Message-ID: Subject: Re: S3 Input Module From: Priyanka Gugale To: dev@apex.incubator.apache.org Content-Type: multipart/alternative; boundary=001a1139384c1ead81052e3a7f0a --001a1139384c1ead81052e3a7f0a Content-Type: text/plain; charset=UTF-8 It's a good idea to extract out common code in parent class. +1 for this feature. -Priyanka On Thu, Mar 17, 2016 at 1:57 PM, Chaitanya Chebolu < chaitanya@datatorrent.com> wrote: > Dear Community, > > I am proposing S3 Input Module. Primary functionality of this module is > to parallel read files from S3 bucket. > > Below is the JIRA created for this task: > https://issues.apache.org/jira/browse/APEXMALHAR-2019 > > Design of this module is similar to HDFS input module. So, I will extend > HDFS input module for S3 module. > > Instead of extending HDFS input module, I will create common class for > all such file system modules. JIRA for creating common class is here: > https://issues.apache.org/jira/browse/APEXMALHAR-2018 > > Please share your thoughts on this. > > Regards, > Chaitanya > --001a1139384c1ead81052e3a7f0a--