avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremy Lewi <jer...@lewi.us>
Subject Re: TetherJob example Issue 512
Date Thu, 30 Jun 2011 17:27:14 GMT
As a first step I created a Java unit test to run the java word count
tether example. In doing so I ran into a couple of issues (e.g clients
were using SaslocketServer but client was using SocketServer which at
least for me seemed problematic).

Should I report these to the mailing list or should I open a JIRA issue?

Right now I'm working on some minor modifications so that when you
specify the executable you can provide additional arguments. I was
planning on trying to produce and post a patch once this was working. 

On Thu, 2011-06-30 at 10:18 -0700, Doug Cutting wrote:
> On 06/27/2011 07:45 PM, Jeremy Lewi wrote:
> > I've been look at the code for map-reduce tethering (Issue 512
> > https://issues.apache.org/jira/browse/AVRO-512)  to see what it would
> > take to add support for python (Issue 570). 
> Great!  This would be wonderful to have.
> > I've been looking at the example provided by
> > lang/java/mapred/src/test/java...
> > 
> > It looks like the test code only includes the code for the tethered task
> > which runs the word count.
> > 
> > So it looks like example code for setting up an actual TetherJob which
> > uses this code is still missing.
> TetherTask and TetherTaskRunner (in the test tree) are the framework for
> tethered Java jobs.  They're meant to be fully general, not specific to
> WordCount, providing a reference for other implementations.
> Cheers,
> Doug

View raw message