falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh Seetharam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-108) HCat integration is additionally done via http
Date Tue, 15 Oct 2013 18:08:42 GMT

    [ https://issues.apache.org/jira/browse/FALCON-108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795451#comment-13795451

Venkatesh Seetharam commented on FALCON-108:

There are quite a few limitations today to be used in Falcon.

* Api does not return the table type, External or Managed, required for Eviction
* There is no partition filter API in webhcat, again required for evicting candidate partitions.
The current API returns all partitions and server could run OOM
* Does not support proxy doAs, which is required for secure falcon since webhcat itself acts
as a proxy for Hive
* webhcat does not use Hive/HCatalog API but uses bin scripts which needs Hive, Hadoop and
HCatalog t o be installed and env exported. This is a major limitation for Falcon integration
tests which brings up these services when int-tests run

> HCat integration is additionally done via http
> ----------------------------------------------
>                 Key: FALCON-108
>                 URL: https://issues.apache.org/jira/browse/FALCON-108
>             Project: Falcon
>          Issue Type: Sub-task
>            Reporter: Srikanth Sundarrajan
> HCat integration is currently done through thrift interface (FALCON-96). Though the WebHCat
implementation is coded up, it is yet to be tested or integrated. It would be good to have
that done. 

This message was sent by Atlassian JIRA

View raw message