Mailing-List: contact issues-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Thu, 2 Mar 2017 03:08:45 +0000 (UTC)
From: "Sergey Shelukhin (JIRA)" <jira@apache.org>
To: issues@hive.apache.org
Message-ID: <JIRA.13047556.1488423716000.38604.1488424125310@Atlassian.JIRA>
In-Reply-To: <JIRA.13047556.1488423716000@Atlassian.JIRA>
References: <JIRA.13047556.1488423716000@Atlassian.JIRA> <JIRA.13047556.1488423716686@jira-lw-us.apache.org>
Subject: [jira] [Updated] (HIVE-16085) get path-to-alias, path-to-work etc
 recursively in Hive
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 02 Mar 2017 03:08:54 -0000


     [ https://issues.apache.org/jira/browse/HIVE-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sergey Shelukhin updated HIVE-16085:
------------------------------------
    Description: 
Sometimes, we don't get correct alias/part desc/etc. from a split path because the path has subdirectories - e.g. in HIVE-15870 (for MM tables).
We have utility methods to work around that by getting the partdesc recursively from the parents of a path, but they are not applied consistently; I suspect people add calls to these methods after they discover some particular codepath is broken. Perhaps we should find such places proactively for path-to-part, path-to-work, and path-to-alias maps.
This can happen much more with MM tables, but can also happen for any recursive-path cases (incl. just a regular recursive path read enabled via an MR config).


  was:
Sometimes, we don't get correct alias/part desc/etc. from a split path because the path has subdirectories - e.g. in HIVE-15870 (for MM tables).
We have utility methods to work around that by getting the partdesc recursively from the parents of a path, but they are not applied consistently; I suspect people add calls to these methods after they discover some particular path is broken. Perhaps we should find such places proactively for path-to-part, path-to-work, and path-to-alias maps.
This can happen much more with MM tables, but can also happen for any recursive-path cases (incl. just a regular recursive path read enabled via an MR config).


> get path-to-alias, path-to-work etc recursively in Hive
> -------------------------------------------------------
>
>                 Key: HIVE-16085
>                 URL: https://issues.apache.org/jira/browse/HIVE-16085
>             Project: Hive
>          Issue Type: Task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-16085.WIP.patch
>
>
> Sometimes, we don't get correct alias/part desc/etc. from a split path because the path has subdirectories - e.g. in HIVE-15870 (for MM tables).
> We have utility methods to work around that by getting the partdesc recursively from the parents of a path, but they are not applied consistently; I suspect people add calls to these methods after they discover some particular codepath is broken. Perhaps we should find such places proactively for path-to-part, path-to-work, and path-to-alias maps.
> This can happen much more with MM tables, but can also happen for any recursive-path cases (incl. just a regular recursive path read enabled via an MR config).


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)