incubator-crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joseph Adler <joseph.ad...@gmail.com>
Subject Re: trevni support
Date Mon, 17 Dec 2012 20:30:30 GMT
Old APIs.

However... Trevni is very, very similar to Avro, so it's likely that we
could reuse a lot of existing code


On Mon, Dec 17, 2012 at 12:24 PM, Josh Wills <josh.wills@gmail.com> wrote:

> I wrote Trevni Sources and Targets files as a test a couple of months ago,
> right when it first came out. I don't think we can putting it into Crunch
> core until Hadoop-2.0.x upgrades from Avro 1.5.4 to a version that includes
> Trevni support, but I would be glad to have it as a github module.
>
> Does Trevni MR support the new mapreduce.* APIs? I think it was still
> using mapred.* when I was playing around, which meant I had to roll my own
> to make it work with Crunch. If it does, the impl should be very simple.
>
> Josh
>
>
> On Mon, Dec 17, 2012 at 12:15 PM, Joseph Adler <joseph.adler@gmail.com>wrote:
>
>> Does Crunch work with Trevni files right now? If not, is anyone else
>> interested in adding Trevni support?
>>
>> -- Joe
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message