hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16085) get path-to-alias, path-to-work etc recursively in Hive
Date Thu, 02 Mar 2017 03:08:45 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891543#comment-15891543
] 

Sergey Shelukhin commented on HIVE-16085:
-----------------------------------------

[~ashutoshc] fyi; you might be the only expert in such obscure matters :) let me know if you
have any input

> get path-to-alias, path-to-work etc recursively in Hive
> -------------------------------------------------------
>
>                 Key: HIVE-16085
>                 URL: https://issues.apache.org/jira/browse/HIVE-16085
>             Project: Hive
>          Issue Type: Task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-16085.WIP.patch
>
>
> Sometimes, we don't get correct alias/part desc/etc. from a split path because the path
has subdirectories - e.g. in HIVE-15870 (for MM tables).
> We have utility methods to work around that by getting the partdesc recursively from
the parents of a path, but they are not applied consistently; I suspect people add calls to
these methods after they discover some particular codepath is broken. Perhaps we should find
such places proactively for path-to-part, path-to-work, and path-to-alias maps.
> This can happen much more with MM tables, but can also happen for any recursive-path
cases (incl. just a regular recursive path read enabled via an MR config).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message