giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maja Kabiljo (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (GIRAPH-789) Upgrade hive-io to 0.20 - less metastore accesses
Date Thu, 31 Oct 2013 18:41:18 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Maja Kabiljo updated GIRAPH-789:
--------------------------------

    Attachment: GIRAPH-789.patch

Hive-io changed so it doesn't access metastore when schema/table info is already present in
Configuration, and HiveGiraphRunner is now initializing all the formats to fill up the Configuration.
If HiveGiraphRunner is not used everything will still work, but we'll have accesses to metastore
from workers.

> Upgrade hive-io to 0.20 - less metastore accesses
> -------------------------------------------------
>
>                 Key: GIRAPH-789
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-789
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Maja Kabiljo
>            Assignee: Maja Kabiljo
>         Attachments: GIRAPH-789.patch
>
>
> Currently each worker is sending multiple requests to metastore to get info about io
formats, which is unnecessary and can cause issues when metastore is having problems.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message