Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@phoenix.apache.org
Date: Mon, 5 Dec 2016 07:56:58 +0000 (UTC)
From: "lordk (JIRA)" <jira@apache.org>
To: dev@phoenix.apache.org
Message-ID: <JIRA.13002312.1472810791000.436462.1480924618690@Atlassian.JIRA>
In-Reply-To: <JIRA.13002312.1472810791000@Atlassian.JIRA>
References: <JIRA.13002312.1472810791000@Atlassian.JIRA> <JIRA.13002312.1472810791005@arcas>
Subject: [jira] [Issue Comment Deleted] (PHOENIX-3240) ClassCastException
 from Pig loader
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Mon, 05 Dec 2016 07:57:00 -0000


     [ https://issues.apache.org/jira/browse/PHOENIX-3240?page=3Dcom.atlass=
ian.jira.plugin.system.issuetabpanels:all-tabpanel ]

lordk updated PHOENIX-3240:
---------------------------
    Comment: was deleted

(was: I have a test under centos7.2 JDK1.8.0_112 apache-phoenix-4.9.0-HBase=
-1.2 pig-0.16.0. I still got same error :
Error: java.io.IOException: java.lang.ClassCastException: org.joda.time.Dat=
eTime cannot be cast to org.apache.phoenix.shaded.org.joda.time.DateTime at=
=20
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOpera=
tors.StoreFuncDecorator.putNext(StoreFuncDecorator.java:83) at org.apache.p=
ig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordW=
riter.write(PigOutputFormat.java:144) at org.apache.pig.backend.hadoop.exec=
utionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputF=
ormat.java:97) at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector=
.write(MapTask.java:658) at org.apache.hadoop.mapreduce.task.TaskInputOutpu=
tContextImpl.write(TaskInputOutputContextImpl.java:89) at org.apache.hadoop=
.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112) at o=
rg.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.=
collect(PigMapOnly.java:48) at org.apache.pig.backend.hadoop.executionengin=
e.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:282) =
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericM=
apBase.map(PigGenericMapBase.java:275) at org.apache.pig.backend.hadoop.exe=
cutionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:65=
) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) at org.apache.=
hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at org.apache.hadoop.m=
apred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2=
.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Nat=
ive Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.ap=
ache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:16=
57) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused b=
y: java.lang.ClassCastException: org.joda.time.DateTime cannot be cast to o=
rg.apache.phoenix.shaded.org.joda.time.DateTime at org.apache.phoenix.pig.u=
til.TypeUtil.castPigTypeToPhoenix(TypeUtil.java:199) at org.apache.phoenix.=
pig.PhoenixHBaseStorage.putNext(PhoenixHBaseStorage.java:189) at=20


my sourcedata :
AA,CC,3.5,EE,GG,2015-08-30
BB,DD,3.5,FF,HH,2015-08-05

pig script:
AA =3D load '/sourcedata/farm-prod/complete3.txt' USING PigStorage(',') AS(
name:chararray,
address:chararray,
price:double,
unit:chararray,
info_source:chararray,
date:datetime
);
dump AA;
   out put :
         (AA,CC,3.5,EE,GG,2015-08-30T00:00:00.000-04:00)
         (BB,DD,3.5,FF,HH,2015-08-05T00:00:00.000-04:00)
STORE AA into 'hbase://FARM_PRODUCT_PRICE' using org.apache.phoenix.pig.Pho=
enixHBaseStorage('dev7,dev8,dev9','-batchSize 5000');

my phoenix table :

create table FARM_PRODUCT_PRICE
(
name        varchar(30),
address     varchar(80),
price=09    double,
unit=09    varchar(20),
info_source varchar(80),
date        date not null CONSTRAINT pk PRIMARY KEY (name,address,date)
)VERSIONS=3D1,SALT_BUCKETS=3D3,COMPRESSION=3D'snappy';
)

> ClassCastException from Pig loader
> ----------------------------------
>
>                 Key: PHOENIX-3240
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3240
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.8.0
>            Reporter: YoungWoo Kim
>            Assignee: Josh Elser
>             Fix For: 4.9.0, 4.8.2
>
>
> I'm loading data from Hive table to Phoenix table in using Phoenix-Pig in=
tegration. my pig script looks like following:
> {code}
> T =3D LOAD 'mydb.$TBL' USING org.apache.hive.hcatalog.pig.HCatLoader();
> STORE T into 'hbase://MYSCHEMA.$TBL' using
>     org.apache.phoenix.pig.PhoenixHBaseStorage('i004,i005,i006','-batchSi=
ze 1000');
> {code}
> If the source table has timestamp, MapReduce job for Pig script does not =
work:
> {noformat}
> ERROR 0: java.lang.ClassCastException: org.joda.time.DateTime cannot be c=
ast to org.apache.phoenix.shaded.org.joda.time.DateTime
> org.apache.pig.backend.executionengine.ExecException: ERROR 0: java.lang.=
ClassCastException: org.joda.time.DateTime cannot be cast to org.apache.pho=
enix.shaded.org.joda.time.DateTime
> =09at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapRed=
uceLauncher.getStats(MapReduceLauncher.java:822)
> =09at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapRed=
uceLauncher.launchPig(MapReduceLauncher.java:452)
> =09at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.laun=
chPig(HExecutionEngine.java:304)
> =09at org.apache.pig.PigServer.launchPlan(PigServer.java:1390)
> =09at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:=
1375)
> =09at org.apache.pig.PigServer.execute(PigServer.java:1364)
> =09at org.apache.pig.PigServer.executeBatch(PigServer.java:415)
> =09at org.apache.pig.PigServer.executeBatch(PigServer.java:398)
> =09at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.jav=
a:171)
> =09at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser=
.java:234)
> =09at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser=
.java:205)
> =09at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> =09at org.apache.pig.Main.run(Main.java:502)
> =09at org.apache.pig.Main.main(Main.java:177)
> =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp=
l.java:62)
> =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc=
essorImpl.java:43)
> =09at java.lang.reflect.Method.invoke(Method.java:498)
> =09at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> =09at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> Caused by: java.lang.ClassCastException: org.joda.time.DateTime cannot be=
 cast to org.apache.phoenix.shaded.org.joda.time.DateTime
> =09at org.apache.phoenix.pig.util.TypeUtil.castPigTypeToPhoenix(TypeUtil.=
java:201)
> =09at org.apache.phoenix.pig.PhoenixHBaseStorage.putNext(PhoenixHBaseStor=
age.java:189)
> =09at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOut=
putFormat$PigRecordWriter.write(PigOutputFormat.java:136)
> =09at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOut=
putFormat$PigRecordWriter.write(PigOutputFormat.java:95)
> =09at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(Map=
Task.java:658)
> =09at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(T=
askInputOutputContextImpl.java:89)
> =09at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(Wra=
ppedMapper.java:112)
> =09at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMap=
Only$Map.collect(PigMapOnly.java:48)
> =09at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGen=
ericMapBase.map(PigGenericMapBase.java:260)
> =09at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGen=
ericMapBase.map(PigGenericMapBase.java:64)
> =09at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
> =09at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
> =09at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> =09at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
> =09at java.security.AccessController.doPrivileged(Native Method)
> =09at javax.security.auth.Subject.doAs(Subject.java:422)
> =09at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInfor=
mation.java:1657)
> {noformat}


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)