apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Weise <tho...@datatorrent.com>
Subject Re: Proposal for concrete operator for writing to HDFS file
Date Sun, 06 Mar 2016 06:30:46 GMT
Of course it can be done. Kafka producer is an example.

On Sat, Mar 5, 2016 at 10:25 PM, Ashwin Chandra Putta <
ashwinchandrap@gmail.com> wrote:

> If it can be done, awesome!
>
> The usual use cases I have seen are CSV, json and avro.
>
> Regards,
> Ashwin.
> On Mar 5, 2016 8:28 PM, "Thomas Weise" <thomas@datatorrent.com> wrote:
>
> > >
> > > > 1. Take any java object as input and get the bytes of the string
> > returned
> > > > from toString method on the object.
> > > >
> > >
> > > Yes. It would allow any java object and byte[] will be derived from the
> > > toString(). If input is byte[]; then it would be passed on without any
> > > conversion.
> > >
> > >
> > Relying on toString() does not seem appropriate. Since you want the
> > operator configurable, why not let the user configure how to serialize
> the
> > data. Default could be JSON.
> >
> > Thanks
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message