hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4285) partitions file created in user's home directory by importtsv
Date Fri, 15 Mar 2013 19:40:13 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603746#comment-13603746
] 

stack commented on HBASE-4285:
------------------------------

Ugh.  Sorry.  Didn't mean to paste whole log.  I was referring to this piece:

{code}
2013-03-15 12:23:38,438 WARN  [main] mapred.TaskRunner(788): Failed to create symlink: /var/lib/jenkins/workspace/apache-hbase-0.95/0.95/hbase-it/target/test-data/e49db351-12b1-4134-873c-27037d88fd5d/mapred_local/archive/-792904609167752000_1005030081_1870782666/localhost/var/lib/jenkins/workspace/apache-hbase-0.95/0.95/hbase-it/target/test-data/e49db351-12b1-4134-873c-27037d88fd5d/hadoop/mapred-working-dir/partitions_d0e73e1b-528c-481d-bc07-7c829384488a
<- /var/lib/jenkins/workspace/apache-hbase-0.95/0.95/hbase-it/target/test-data/e49db351-12b1-4134-873c-27037d88fd5d/mapred_local/localRunner/_partition.lst
2013-03-15 12:23:38,726 WARN  [Thread-234] mapred.LocalJobRunner$Job(300): job_local_0001
java.lang.IllegalArgumentException: Can't read partitions file
	at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitioner.setConf(TotalOrderPartitioner.java:116)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:677)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:756)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214)
Caused by: java.io.FileNotFoundException: File _partition.lst does not exist.
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:397)
	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251)
	at org.apache.hadoop.fs.FileSystem.getLength(FileSystem.java:796)
	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1479)
	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1474)
	at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitioner.readPartitions(TotalOrderPartitioner.java:301)
	at org.apache.hadoop.mapreduce.lib.partition.TotalOrderPartitioner.setConf(TotalOrderPartitioner.java:88)
	... 6 more
{code}
                
> partitions file created in user's home directory by importtsv
> -------------------------------------------------------------
>
>                 Key: HBASE-4285
>                 URL: https://issues.apache.org/jira/browse/HBASE-4285
>             Project: HBase
>          Issue Type: Sub-task
>          Components: mapreduce
>    Affects Versions: 0.90.4, 0.95.0, 0.98.0
>            Reporter: Wing Yew Poon
>            Assignee: Nick Dimiduk
>             Fix For: 0.95.0, 0.98.0
>
>         Attachments: 0001-HBASE-4285-cleanup-ImportTsv-partitions-file-litter.patch,
0001-HBASE-4285-cleanup-ImportTsv-partitions-file-litter.patch, 0001-HBASE-4285-cleanup-ImportTsv-partitions-file-litter.patch
>
>
> I am using HBase 0.94 from CDH3u1.
> After running importtsv, I find that a temporary partitions_* file is written to my user
home directory in HDFS. This file should really be deleted automatically when it is no longer
needed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message