hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Navis (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-6970) HCatInputFormat in hive-hcatalog-core 0.13 does not compatible with hadoop2
Date Thu, 24 Jul 2014 05:54:39 GMT

     [ https://issues.apache.org/jira/browse/HIVE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Navis updated HIVE-6970:
------------------------

    Attachment: HIVE-6970.1.patch.txt

> HCatInputFormat in hive-hcatalog-core 0.13 does not compatible with hadoop2
> ---------------------------------------------------------------------------
>
>                 Key: HIVE-6970
>                 URL: https://issues.apache.org/jira/browse/HIVE-6970
>             Project: Hive
>          Issue Type: Bug
>          Components: HCatalog
>    Affects Versions: 0.13.0
>            Reporter: Chao Shi
>         Attachments: HIVE-6970.1.patch.txt
>
>
> I'm developing HCatalog support for Crunch (CRUNCH-340). Crunch support both hadoop 1
and 2, by specify profile -Phadoop-1 or -Phadoop-2. When I run my program with hadoop2, I
got the following error. I think this was intended to be fixed by HIVE-4460.
> {code}
> Exception in thread "Thread-4" java.lang.IncompatibleClassChangeError: Found interface
org.apache.hadoop.mapreduce.JobContext, but class was expected
>         at org.apache.hive.hcatalog.mapreduce.HCatBaseInputFormat.getSplits(HCatBaseInputFormat.java:102)
>         at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:491)
>         at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:508)
>         at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:392)
>         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
>         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
>         at org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchControlledJob.submit(CrunchControlledJob.java:331)
>         at org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.startReadyJobs(CrunchJobControl.java:201)
>         at org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.pollJobStatusAndStartNewOnes(CrunchJobControl.java:235)
>         at org.apache.crunch.impl.mr.exec.MRExecutor.monitorLoop(MRExecutor.java:112)
>         at org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor.java:55)
>         at org.apache.crunch.impl.mr.exec.MRExecutor$1.run(MRExecutor.java:83)
>         at java.lang.Thread.run(Thread.java:744)
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message