hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (HIVE-10564) webhcat should use webhcat-site.xml properties for controller job submission
Date Wed, 06 May 2015 00:00:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eugene Koifman reopened HIVE-10564:
-----------------------------------

Unfortunately this has unexpected side effects.
Every time a job is submitted, various properties are passed in cmd line using -Dfoo=bar

This change causes AppConfig Configuration object to accumulate the union of all these properties
so Job N+1 includes properties that belong previous jobs.

for example, if you run a job with "-D, templeton.statusdir=TestSqoop_1" and then another
job that does not specify "statusdir", the 2nd job will write to TestSqoop_1....

this will cause a major problem



> webhcat should use webhcat-site.xml properties for controller job submission
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-10564
>                 URL: https://issues.apache.org/jira/browse/HIVE-10564
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>              Labels: TODOC1.2
>             Fix For: 1.2.0
>
>         Attachments: HIVE-10564.1.patch
>
>
> webhcat should use webhcat-site.xml in configuration for the TempletonController map-only
job that it launches. This will allow users to set any MR/hdfs properties that want to see
used for the controller job.
> NO PRECOMMIT TESTS



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message