hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sonal Goyal <sonalgoy...@gmail.com>
Subject Re: elastic mapreduce - custom outputformat?
Date Fri, 04 Feb 2011 04:19:14 GMT
Yeah, you can use any OutputFormat in your EMR job. If it is file based, it
will write to the given file output path, else to Cassandra, DB, whatever
you specify..

Thanks and Regards,
Sonal
<https://github.com/sonalgoyal/hiho>Connect Hadoop with databases,
Salesforce, FTP servers and others <https://github.com/sonalgoyal/hiho>
Nube Technologies <http://www.nubetech.co>

<http://in.linkedin.com/in/sonalgoyal>





On Wed, Feb 2, 2011 at 12:54 AM, Jeremy Hanna <jeremy.hanna1234@gmail.com>wrote:

> Thanks!
>
> Okay - is there a way to specify a completely different outputformat - I
> would like to output to my Cassandra cluster in ec2.
>
>
> On Feb 1, 2011, at 11:21 AM, Koji Noguchi wrote:
>
> > Input and output filesystems don’t have to match.
> >
> > You should be able to read from S3 and write to hdfs as long as you give
> a path like  s3:// and  hdfs:// .
> >
> > Koji
> >
> >
> > On 2/1/11 11:13 AM, "Jeremy Hanna" <jeremy.hanna1234@gmail.com> wrote:
> >
> > I wanted to input from s3 but output to someplace else in aws with
> > elastic mapreduce.  Their docs seem to only suggest that they only
> > read from/write to s3.  Is that correct?
> >
>
>

Mime
View raw message