hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17294) LLAP: switch task heartbeats to protobuf
Date Fri, 11 Aug 2017 18:22:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123787#comment-16123787
] 

Siddharth Seth commented on HIVE-17294:
---------------------------------------

The endpoint is in the LLAP AM plugin. However, that extends an upstream tez plugin - so some
translation will likely be required. That's an unnecessary step. Other than time to work on
this, another thing to watch out for is the cost of serializing protobuf, and memory overhead
of copying buffers with protobuf rpc engine.
At the moment, some parts of the system use the ProtobufRpcEngine from Hadoop, other parts
use the WritableRpcEngine (specifically the task to AM communication).

> LLAP: switch task heartbeats to protobuf
> ----------------------------------------
>
>                 Key: HIVE-17294
>                 URL: https://issues.apache.org/jira/browse/HIVE-17294
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message