Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Tue, 8 Aug 2017 22:21:00 +0000 (UTC)
From: "Prasanth Jayachandran (JIRA)" <jira@apache.org>
To: dev@hive.apache.org
Message-ID: <JIRA.13093324.1502230833000.122007.1502230860631@Atlassian.JIRA>
In-Reply-To: <JIRA.13093324.1502230833000@Atlassian.JIRA>
References: <JIRA.13093324.1502230833000@Atlassian.JIRA> <JIRA.13093324.1502230833828@jira-lw-us.apache.org>
Subject: [jira] [Created] (HIVE-17274) RowContainer spills for timestamp
 column throws exception
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 08 Aug 2017 22:21:07 -0000

Prasanth Jayachandran created HIVE-17274:
--------------------------------------------

             Summary: RowContainer spills for timestamp column throws exception
                 Key: HIVE-17274
                 URL: https://issues.apache.org/jira/browse/HIVE-17274
             Project: Hive
          Issue Type: Bug
    Affects Versions: 1.3.0, 3.0.0, 2.4.0
            Reporter: Prasanth Jayachandran


Path names cannot contain ":" (HADOOP-3257)
Join key toString() is used as part of filename.
https://github.com/apache/hive/blob/16bfb9c9405b68a24c7e6c1b13bec00e38bbe213/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/RowContainer.java#L523

If join key is timestamp column then this will throw following exception.
{code}
2017-08-05 23:51:33,631 ERROR [main] org.apache.hadoop.hive.ql.exec.persistence.RowContainer: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: .RowContainer7551143976922371245.[1792453531, 2016-09-02 01:17:43,%202016-09-02%5D.tmp.crc
java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: .RowContainer7551143976922371245.[1792453531, 2016-09-02 01:17:43,%202016-09-02%5D.tmp.crc
        at org.apache.hadoop.fs.Path.initialize(Path.java:205)
        at org.apache.hadoop.fs.Path.<init>(Path.java:171)
        at org.apache.hadoop.fs.Path.<init>(Path.java:93)
        at org.apache.hadoop.fs.ChecksumFileSystem.getChecksumFile(ChecksumFileSystem.java:94)
        at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:404)
        at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:463)
        at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:442)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:926)
        at org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:1137)
        at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:273)
        at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:530)
        at org.apache.hadoop.hive.ql.exec.Utilities.createSequenceWriter(Utilities.java:1643)
        at org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat.getHiveRecordWriter(HiveSequenceFileOutputFormat.java:64)
        at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:243)
        at org.apache.hadoop.hive.ql.exec.persistence.RowContainer.setupWriter(RowContainer.java:538)
        at org.apache.hadoop.hive.ql.exec.persistence.RowContainer.spillBlock(RowContainer.java:299)
        at org.apache.hadoop.hive.ql.exec.persistence.RowContainer.copyToDFSDirecory(RowContainer.java:407)
        at org.apache.hadoop.hive.ql.exec.SkewJoinHandler.endGroup(SkewJoinHandler.java:185)
        at org.apache.hadoop.hive.ql.exec.JoinOperator.endGroup(JoinOperator.java:249)
        at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:195)
        at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.net.URISyntaxException: Relative path in absolute URI: .RowContainer7551143976922371245.[1792453531, 2016-09-02 01:17:43,%202016-09-02%5D.tmp.crc
        at java.net.URI.checkPath(URI.java:1823)
        at java.net.URI.<init>(URI.java:745)
        at org.apache.hadoop.fs.Path.initialize(Path.java:202)
        ... 26 more
{code}


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)