Mailing-List: contact dev-help@apex.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@apex.incubator.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAMaZnT52rCFqkvb3E6pYsEpO19V+Vy+n5S-dzKXrq9zesONfgg@mail.gmail.com>
References: 
 <CAG_7j8y4ZVhEOR6dydD6X1LSe0vBEC_WA5OaOpMZSsQXmdL0bQ@mail.gmail.com>
	<CAKt=akHfrM4o70RR240Nqs4_a+3Lk-whiR0Gk1WggMzjWMnkKg@mail.gmail.com>
	<CAAMMvRnzM_2iPtbPee8uF_XAxNOincsChbVfaiBF3enTQKo9RA@mail.gmail.com>
	<CAMaZnT52rCFqkvb3E6pYsEpO19V+Vy+n5S-dzKXrq9zesONfgg@mail.gmail.com>
Date: Fri, 18 Mar 2016 10:49:03 +0530
Message-ID: 
 <CAAR+c0nC_m0UPUWEfXxf3K3Md43LFYgQ7X=Ckga2hDd2mEwHmg@mail.gmail.com>
Subject: Re: S3 Input Module
From: Pradeep Dalvi <pradeep.dalvi@datatorrent.com>
To: dev@apex.incubator.apache.org
Content-Type: multipart/alternative; boundary=001a11438a4ea78153052e4be2cd

--001a11438a4ea78153052e4be2cd
Content-Type: text/plain; charset=UTF-8

+1

On Thu, Mar 17, 2016 at 10:56 PM, Amol Kekre <amol@datatorrent.com> wrote:

> +1. Very common use case. Nice to have it.
>
> Thks
> Amol
>
>
> On Thu, Mar 17, 2016 at 1:49 AM, Sandeep Deshmukh <sandeep@datatorrent.com
> >
> wrote:
>
> > +1
> >
> > Many people face issues while copy data from S3 at large scale. This
> module
> > is a great contribution that can be readily used with simple
> configuration.
> >
> >
> > Regards,
> > Sandeep
> >
> > On Thu, Mar 17, 2016 at 2:04 PM, Priyanka Gugale <
> priyanka@datatorrent.com
> > >
> > wrote:
> >
> > > It's a good idea to extract out common code in parent class.
> > >
> > > +1 for this feature.
> > >
> > > -Priyanka
> > >
> > > On Thu, Mar 17, 2016 at 1:57 PM, Chaitanya Chebolu <
> > > chaitanya@datatorrent.com> wrote:
> > >
> > > > Dear Community,
> > > >
> > > >   I am proposing S3 Input Module. Primary functionality of this
> module
> > is
> > > > to parallel read files from S3 bucket.
> > > >
> > > >   Below is the JIRA created for this task:
> > > > https://issues.apache.org/jira/browse/APEXMALHAR-2019
> > > >
> > > >   Design of this module is similar to HDFS input module. So, I will
> > > extend
> > > > HDFS input module for S3 module.
> > > >
> > > >   Instead of extending HDFS input module, I will create common class
> > for
> > > > all such file system modules. JIRA for creating common class is here:
> > > > https://issues.apache.org/jira/browse/APEXMALHAR-2018
> > > >
> > > >  Please share your thoughts on this.
> > > >
> > > > Regards,
> > > > Chaitanya
> > > >
> > >
> >
>


-- 
Pradeep A. Dalvi

Software Engineer
DataTorrent (India)

--001a11438a4ea78153052e4be2cd--