crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Micah Whitacre (JIRA)" <>
Subject [jira] [Created] (CRUNCH-534) Protobuf Size Limit Exception
Date Thu, 02 Jul 2015 02:22:04 GMT
Micah Whitacre created CRUNCH-534:

             Summary: Protobuf Size Limit Exception 
                 Key: CRUNCH-534
             Project: Crunch
          Issue Type: Bug
          Components: IO
            Reporter: Micah Whitacre

With HBase's switch to ProtocolBuffers there is now an imposed restriction on the size of
data which can be stored in protocol buffers and therefore Cells/Puts/etc.  

It is definitely an HBase problem[1] but Crunch also might have changes needed since we use
protobuf serialization in our HBaseTypes.[2]  So might need to make sure error isn't only
on our side as they work through the issue or might need to look at MOB support[3].

[1] -
[2] -
[3] -

This message was sent by Atlassian JIRA

View raw message