cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Frank (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-4593) Reading the ByteBuffer key from a map job causes an infinite fetch loop
Date Fri, 31 Aug 2012 06:09:07 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-4593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13445708#comment-13445708
] 

Ben Frank commented on CASSANDRA-4593:
--------------------------------------

I'll add it as a gotcha to that page, thanks for pointing it out. 

Jonathan, you really think this isn't worth being defensive about in the RecordReader? Seems
like it presents an unclear api which is also hard to document; since there isn't really a
natural point to put it in javadoc or anything. Doesn't seem like there is really any detriment
to doing this or something like it. looking at the code history it appears as if this has
been toyed with but not fully implemented. 
                
> Reading the ByteBuffer key from a map job causes an infinite fetch loop
> -----------------------------------------------------------------------
>
>                 Key: CASSANDRA-4593
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4593
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Hadoop
>    Affects Versions: 1.1.2
>            Reporter: Ben Frank
>         Attachments: cassandra-1.1-4593.txt
>
>
> Reading the ByteBuffer key from a map job empties the buffer. One of these key buffers
is later used in ColumnFamilyRecordReader to figure out the last token that was received,
then using that as a start point to fetch more rows. With a now empty buffer, the token defaults
to the start of the range and thus the end of the data is never reached.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message