hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carl Steinbach (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1889) add an option to ignore HDFS location stored in index files.
Date Thu, 06 Jan 2011 07:13:50 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12978184#action_12978184
] 

Carl Steinbach commented on HIVE-1889:
--------------------------------------

@Yongqiang: can you please add the name of the new property to this ticket so that people
can find it via search?

Also, do we lose anything in terms of functionality or performance by ignoring the HDFS path
information?
If the answer is no then we should probably just ignore this information by default instead
of adding a new
configuration property.

> add an option to ignore HDFS location stored in index files.
> ------------------------------------------------------------
>
>                 Key: HIVE-1889
>                 URL: https://issues.apache.org/jira/browse/HIVE-1889
>             Project: Hive
>          Issue Type: New Feature
>          Components: Indexing
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: HIVE-1889.1.patch
>
>
> In the current code, we use the whole hdfs path in index files to choose splits to run
mapreduce job.
> If the data got moved or the name of the cluster got changed, the index data should still
be usable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message