incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Subroto sanyal <subroto.san...@huawei.com>
Subject Data Loding in HCatalog using PIG
Date Tue, 07 Feb 2012 18:54:38 GMT
Hi,

While loading a HCatalog table using PIG script I get this error:
=============================================================
Pig Stack Trace
---------------
ERROR 1000: Error during parsing. Lexical error at line 3, column 87.  Encountered: "t" (116),
after : "\""

org.apache.pig.impl.logicalLayer.parser.TokenMgrError: Lexical error at line 3, column 87.
 Encountered: "t" (116), after : "\""
        at org.apache.pig.impl.logicalLayer.parser.QueryParserTokenManager.getNextToken(QueryParserTokenManager.java:1829)
        at org.apache.pig.impl.logicalLayer.parser.QueryParser.jj_ntk(QueryParser.java:9457)
        at org.apache.pig.impl.logicalLayer.parser.QueryParser.StringList(QueryParser.java:1667)
        at org.apache.pig.impl.logicalLayer.parser.QueryParser.NonEvalFuncSpec(QueryParser.java:5560)
        at org.apache.pig.impl.logicalLayer.parser.QueryParser.StoreClause(QueryParser.java:3968)
        at org.apache.pig.impl.logicalLayer.parser.QueryParser.BaseExpr(QueryParser.java:1501)
        at org.apache.pig.impl.logicalLayer.parser.QueryParser.Expr(QueryParser.java:1013)
        at org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:825)
        at org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:63)
        at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1612)
        at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1562)
        at org.apache.pig.PigServer.registerQuery(PigServer.java:534)
        at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:871)
        at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:388)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:168)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
        at org.apache.pig.Main.run(Main.java:500)
        at org.apache.pig.Main.main(Main.java:107)
=============================================================


The the Hcatalog table structure is:
=============================================================
username        string  from deserializer
description     string  from deserializer
shell   string  from deserializer
test    string
=============================================================

The PIG script use in this context is:
=============================================================
A = load 'hdfs://linux-emzg:9000/subroto/passwd' using PigStorage(':');
B = foreach A generate $0, $4, $6, $7;
store B into 'default.passwdTableAnalysis' using  org.apache.hcatalog.pig.HCatStorer("test=2012");
=============================================================

The sample file which is getting loaded from the PIG script is. The file is available in HDFS
at the correct location:
=============================================================
user1:x:1:1:test user1:myhome1:bash1:20120203
user2:x:1:2:test user2:myhome2:bash2:20120204
user3:x:1:3:test user3:myhome3:bash3:20120205
user3:x:1:4:test user4:myhome4:bash4:20120206
user4:x:1:5:test user5:myhome5:bash5:20120207
user5:x:1:6:test user6:myhome6:bash6:20120208
=============================================================

Request support to resolve this problem.

Regards,
Subroto Sanyal

Mime
View raw message