hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lorand Bendig (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-8484) HCatalog throws an exception if Pig job is of type 'fetch'
Date Thu, 16 Oct 2014 11:24:33 GMT
Lorand Bendig created HIVE-8484:
-----------------------------------

             Summary: HCatalog throws an exception if Pig job is of type 'fetch'
                 Key: HIVE-8484
                 URL: https://issues.apache.org/jira/browse/HIVE-8484
             Project: Hive
          Issue Type: Bug
          Components: HCatalog
    Affects Versions: 0.14.0
            Reporter: Lorand Bendig
             Fix For: 0.14.0


When Pig tries to retrieve result in fetch mode through HCatalog then HCatLoader#setLocation(String
location, Job job) can't set the outputschema because HCatUtil#checkJobContextIfRunningFromBackend(job)
always returns false :
{code}
public static boolean checkJobContextIfRunningFromBackend(JobContext j) {
    if (j.getConfiguration().get("mapred.task.id", "").equals("") &&
        !("true".equals(j.getConfiguration().get("pig.illustrating")))) {
      return false;
    }
    return true;
  }
{code}
This is because in fetch mode we don't have a mapred.task.id. A null outputschema will raise
an exception when HCatBaseLoader#getNext() is called: (ERROR 6018: Error converting read value
to tuple).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message