phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Taylor (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-4161) TableSnapshotReadsMapReduceIT shouldn't need to run its own mini cluster
Date Thu, 07 Sep 2017 02:32:00 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156342#comment-16156342
] 

James Taylor commented on PHOENIX-4161:
---------------------------------------

FYI, not sure if it's related, but [~jmahonin] discovered this over here[1]:
bq. In fixing the above issue, it raised another one, in that JUnit 4.12 doesn't support parallel
test execution using TemporaryFolders. It's fixed in JUnit 4.13 (not yet released)

[1] https://issues.apache.org/jira/browse/PHOENIX-4159?focusedCommentId=16155653&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16155653

> TableSnapshotReadsMapReduceIT shouldn't need to run its own mini cluster
> ------------------------------------------------------------------------
>
>                 Key: PHOENIX-4161
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4161
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Samarth Jain
>            Assignee: Akshita Malhotra
>
> In PHOENIX-4141, I made a few attempts to get TableSnapshotReadsMapReduceIT to pass.
But finally had to resort to running the test in its own mini cluster. I don't see any why
reason we should, though. [~akshita.malhotra] - can you please take a look. 
> Below are the errors I saw in logs:
> {code}
> java.lang.Exception: java.lang.IllegalArgumentException: Filesystems for restore directory
and HBase root directory should be the same
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.lang.IllegalArgumentException: Filesystems for restore directory and
HBase root directory should be the same
> 	at org.apache.hadoop.hbase.snapshot.RestoreSnapshotHelper.copySnapshotForScanner(RestoreSnapshotHelper.java:716)
> 	at org.apache.phoenix.iterate.TableSnapshotResultIterator.init(TableSnapshotResultIterator.java:77)
> 	at org.apache.phoenix.iterate.TableSnapshotResultIterator.<init>(TableSnapshotResultIterator.java:73)
> 	at org.apache.phoenix.mapreduce.PhoenixRecordReader.initialize(PhoenixRecordReader.java:126)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:548)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:786)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}
> {code}
> Caused by: java.lang.IllegalArgumentException: Restore directory cannot be a sub directory
of HBase root directory. RootDir: hdfs://localhost:45485/user/jenkins/test-data/3fe1b641-9d14-4053-b3e6-a811035e34b0,
restoreDir: hdfs://localhost:45485/user/jenkins/test-data/3fe1b641-9d14-4053-b3e6-a811035e34b0/FOO/3eb31efb-b541-4b75-b98f-4558ddf5994e
> 	at org.apache.hadoop.hbase.snapshot.RestoreSnapshotHelper.copySnapshotForScanner(RestoreSnapshotHelper.java:720)
> 	at org.apache.phoenix.iterate.TableSnapshotResultIterator.init(TableSnapshotResultIterator.java:77)
> 	at org.apache.phoenix.iterate.TableSnapshotResultIterator.<init>(TableSnapshotResultIterator.java:73)
> 	at org.apache.phoenix.mapreduce.PhoenixRecordReader.initialize(PhoenixRecordReader.java:126)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:548)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:786)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message