cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yuki Morishita <mor.y...@gmail.com>
Subject Re: multiple reducers with BulkOutputFormat on the same host
Date Thu, 24 Jan 2013 12:55:51 GMT
Alexel,

You were right.
It was already fixed to use UUID for streaming session and released in 1.2.0.
See https://issues.apache.org/jira/browse/CASSANDRA-4813.


On Thursday, January 24, 2013 at 6:49 AM, Alexei Bakanov wrote:

> Hello,
> 
> We see that BulkOutputFormat fails to stream data from multiple reduce
> instances that run on the same host.
> We get the same error messages that issue
> https://issues.apache.org/jira/browse/CASSANDRA-4223 tries to address.
> Looks like (ip-adress + in_out_flag + atomic integer) is not unique
> enough for a sessionId when we have multiple JVMs streaming from one
> physical host.
> 
> We get the problem fixed by setting one reducer per machine in hadoop
> config, but it's not an option we want to deploy.
> 
> Thanks,
> Alexei Bakanov
> 
> 



Mime
View raw message