crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chao Shi <stepi...@live.com>
Subject Re: Build failed in Jenkins: Crunch-master-integration #216
Date Sun, 03 Mar 2013 09:51:46 GMT
Sorry for the break.

I think this is related with my patch (which changes the synchronization
mechanism when killing a pipeline). The cause is a racing problem on
CrunchJobControl#runnerState. I will file a JIRA ticket to fix it.

I'm interested in how Jenkins find it. I run "mvn install" to run
intergration tests and do observe the stacktrace, but it doesn't cause
CancelJobsIT to fail. Does anyone know how Jenkins do it?

On Sun, Mar 3, 2013 at 1:35 PM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:

> See <https://builds.apache.org/job/Crunch-master-integration/216/changes>
>
> Changes:
>
> [jwills] CRUNCH-171: Force value ordering in SortByValueIT test so that
> results are consistent in MR1 and MR2. Contributed by Chao Shi.
>
> [jwills] CRUNCH-156: Refactor PipelineExecution interface to provide more
> info/control over running jobs. Contributed by Chao Shi.
>
> ------------------------------------------
> [...truncated 1402 lines...]
> 1088825 [Thread-3318] ERROR
> org.apache.hadoop.security.UserGroupInformation  -
> PriviledgedActionException as:jenkins cause:java.io.FileNotFoundException:
> File
> /tmp/junit4150330479429390324/tmp-crunch.tmp.dir/crunch-1903746161/p3/REDUCE
> does not exist.
> 1088826 [Thread-3318] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Error occurred starting job "org.apache.crunch.CancelJobsIT:
> Text(/tmp/junit4150330479429390324/shakes.txt)+Aggregate.count+GBK+combine+top20map+SeqFile(/tmp/junit4150330479429390324/tmp-crunch.tmp.dir/crunch-1903746161/p1)":
> 1088826 [Thread-3318] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> java.io.FileNotFoundException: File
> /tmp/junit4150330479429390324/tmp-crunch.tmp.dir/crunch-1903746161/p3/REDUCE
> does not exist.
>         at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:397)
>         at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251)
>         at
> org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
>         at
> org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:721)
>         at
> org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:763)
>         at
> org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:655)
>         at
> org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:174)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:865)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>         at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
>         at
> org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchControlledJob.submit(CrunchControlledJob.java:330)
>         at
> org.apache.crunch.impl.mr.exec.CrunchJob.submit(CrunchJob.java:142)
>         at
> org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.startReadyJobs(CrunchJobControl.java:251)
>         at
> org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.run(CrunchJobControl.java:279)
>         at java.lang.Thread.run(Thread.java:662)
>
> 1088828 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit1072561963890979427/cancel
> 1088837 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1088848 [Thread-3320] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1088848 [Thread-3320] ERROR
> org.apache.hadoop.security.UserGroupInformation  -
> PriviledgedActionException as:jenkins cause:java.io.FileNotFoundException:
> File
> /tmp/junit1072561963890979427/tmp-crunch.tmp.dir/crunch-179412790/p2/REDUCE
> does not exist.
> 1088849 [Thread-3320] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Error occurred starting job "org.apache.crunch.CancelJobsIT:
> Text(/tmp/junit1072561963890979427/shakes.txt)+Aggregate.count+GBK+combine+top20map+SeqFile(/tmp/junit1072561963890979427/tmp-crunch.tmp.dir/crunch-179412790/p1)":
> 1088849 [Thread-3320] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> java.io.FileNotFoundException: File
> /tmp/junit1072561963890979427/tmp-crunch.tmp.dir/crunch-179412790/p2/REDUCE
> does not exist.
>         at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:397)
>         at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251)
>         at
> org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
>         at
> org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:721)
>         at
> org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:763)
>         at
> org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:655)
>         at
> org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:174)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:865)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>         at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
>         at
> org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchControlledJob.submit(CrunchControlledJob.java:330)
>         at
> org.apache.crunch.impl.mr.exec.CrunchJob.submit(CrunchJob.java:142)
>         at
> org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.startReadyJobs(CrunchJobControl.java:251)
>         at
> org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.run(CrunchJobControl.java:279)
>         at java.lang.Thread.run(Thread.java:662)
>
> 1088853 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit6196549393139691485/cancel
> 1088860 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1088868 [Thread-3322] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1088912 [Thread-3322] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1088931 [Thread-3322] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.CancelJobsIT:
> Text(/tmp/junit6196549393139691485/shakes.txt)+Aggregate.count+GBK+combine+top20map+SeqFile(/tmp/junit6196549393139691485/tmp-crunch.tmp.dir/crunch-1436767273/p1)"
> 1088931 [Thread-3322] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1095435 [Thread-3322] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1095476 [Thread-3322] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1095496 [Thread-3322] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.CancelJobsIT:
> SeqFile(/tmp/junit6196549393139691485/tmp-crunch.tmp.dir/crunch-1436767273/p1)+GBK+combine+top20reduce+Text(/tmp/junit6196549393139691485/cancel)"
> 1095497 [Thread-3322] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.096 sec
> Running org.apache.crunch.WordCountIT
> 1102880 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit5883196021441668914/output
> 1102887 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1102895 [Thread-3372] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1102936 [Thread-3372] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1102955 [Thread-3372] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> Text(/tmp/junit5883196021441668914/shakes.txt)+S0+Aggregate.count+GBK+combine+asText+Text(/tmp/junit5883196021441668914/output)"
> 1102958 [Thread-3372] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1109909 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit6055116280429475571/output
> 1109918 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1109920 [Thread-3398] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1109961 [Thread-3398] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1109981 [Thread-3398] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> Text(/tmp/junit6055116280429475571/shakes.txt)+S0+Aggregate.count+GBK+combine+asText+Text(/tmp/junit6055116280429475571/output)"
> 1109981 [Thread-3398] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1116998 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit1954995053866574377/output
> 1116999 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit1954995053866574377/substr
> 1117007 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1117010 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1117013 [Thread-3424] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1117058 [Thread-3424] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1117078 [Thread-3424] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> Text(/tmp/junit1954995053866574377/shakes.txt)+S0+Aggregate.count+GBK+combine+[[asText+Text(/tmp/junit1954995053866574377/output)]/[S1+SeqFile(/tmp/junit1954995053866574377/tmp-crunch.tmp.dir/crunch-2061839745/p1)]]"
> 1117078 [Thread-3424] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1123582 [Thread-3424] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1123623 [Thread-3424] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1123642 [Thread-3424] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> SeqFile(/tmp/junit1954995053866574377/tmp-crunch.tmp.dir/crunch-2061839745/p1)+GBK+combine+asText+Text(/tmp/junit1954995053866574377/substr)"
> 1123642 [Thread-3424] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1131025 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit2995916868245878041/output
> 1131025 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit2995916868245878041/substr
> 1131035 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1131038 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1131041 [Thread-3474] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1131083 [Thread-3474] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1131102 [Thread-3474] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> Text(/tmp/junit2995916868245878041/shakes.txt)+S0+Aggregate.count+GBK+combine+[[Text(/tmp/junit2995916868245878041/output)]/[S1+SeqFile(/tmp/junit2995916868245878041/tmp-crunch.tmp.dir/crunch-582848897/p1)]]"
> 1131103 [Thread-3474] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1137607 [Thread-3474] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1137653 [Thread-3474] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1137673 [Thread-3474] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> SeqFile(/tmp/junit2995916868245878041/tmp-crunch.tmp.dir/crunch-582848897/p1)+GBK+combine+asText+Text(/tmp/junit2995916868245878041/substr)"
> 1137673 [Thread-3474] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1145053 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit4537548702587968815/output
> 1145053 [main] INFO  org.apache.crunch.io.impl.FileTargetImpl  - Will
> write output files to new path: /tmp/junit4537548702587968815/substr
> 1145061 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1145064 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1145067 [Thread-3524] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1145108 [Thread-3524] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1145128 [Thread-3524] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> Text(/tmp/junit4537548702587968815/shakes.txt)+S0+Aggregate.count+GBK+combine+[[S1+Avro(/tmp/junit4537548702587968815/tmp-crunch.tmp.dir/crunch-59872291/p1)]/[asText+Text(/tmp/junit4537548702587968815/output)]]"
> 1145128 [Thread-3524] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1151632 [Thread-3524] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1151672 [Thread-3524] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1151692 [Thread-3524] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> Avro(/tmp/junit4537548702587968815/tmp-crunch.tmp.dir/crunch-59872291/p1)+GBK+combine+asText+Text(/tmp/junit4537548702587968815/substr)"
> 1151693 [Thread-3524] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1159089 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1159095 [Thread-3574] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1159143 [Thread-3574] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1159163 [Thread-3574] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> Text(/tmp/junit2242706444933087954/shakes.txt)+S0+Aggregate.count+GBK+combine+top5map+SeqFile(/tmp/junit2242706444933087954/tmp-crunch.tmp.dir/crunch-1801191970/p2)"
> 1159163 [Thread-3574] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1165666 [Thread-3574] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1165707 [Thread-3574] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1165727 [Thread-3574] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> SeqFile(/tmp/junit2242706444933087954/tmp-crunch.tmp.dir/crunch-1801191970/p2)+GBK+combine+top5reduce+SeqFile(/tmp/junit2242706444933087954/tmp-crunch.tmp.dir/crunch-1801191970/p1)"
> 1165727 [Thread-3574] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1173117 [main] INFO  org.apache.crunch.impl.mr.collect.PGroupedTableImpl
>  - Setting num reduce tasks to 1
> 1173121 [Thread-3624] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1173164 [Thread-3624] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1173184 [Thread-3624] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> Text(/tmp/junit3801867108908033080/shakes.txt)+S0+Aggregate.count+GBK+combine+top5map+Avro(/tmp/junit3801867108908033080/tmp-crunch.tmp.dir/crunch-1914161224/p2)"
> 1173184 [Thread-3624] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1179687 [Thread-3624] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1179728 [Thread-3624] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1179748 [Thread-3624] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.WordCountIT:
> Avro(/tmp/junit3801867108908033080/tmp-crunch.tmp.dir/crunch-1914161224/p2)+GBK+combine+top5reduce+Avro(/tmp/junit3801867108908033080/tmp-crunch.tmp.dir/crunch-1914161224/p1)"
> 1179748 [Thread-3624] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.255 sec
> Running org.apache.crunch.CollectionPObjectIT
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
> Running org.apache.crunch.MapPObjectIT
> 1187180 [Thread-3678] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1187195 [Thread-3678] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1187210 [Thread-3678] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.MaterializeToMapIT:
> Text(/tmp/junit2223227315665338337/set1.txt)+S0+SeqFile(/tmp/junit2223227315665338337/tmp-crunch.tmp.dir/crunch-353307672/p1)"
> 1187211 [Thread-3678] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> 1191192 [Thread-3689] WARN  org.apache.hadoop.mapred.JobClient  - Use
> GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 1191206 [Thread-3689] WARN  org.apache.hadoop.mapred.JobClient  - No job
> jar file set.  User classes may not be found. See JobConf(Class) or
> JobConf#setJar(String).
> 1191220 [Thread-3689] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Running job "org.apache.crunch.MaterializeToMapIT:
> Text(/tmp/junit5613465995941856636/set1.txt)+S0+SeqFile(/tmp/junit5613465995941856636/tmp-crunch.tmp.dir/crunch-376718122/p1)"
> 1191220 [Thread-3689] INFO  org.apache.crunch.impl.mr.exec.CrunchJob  -
> Job status available at: http://localhost:8080/
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.014 sec
>
> Results :
>
> Tests run: 161, Failures: 0, Errors: 0, Skipped: 1
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Crunch ..................................... SUCCESS
> [28.032s]
> [INFO] Apache Crunch Test ................................ SUCCESS
> [16.622s]
> [INFO] Apache Crunch Core ................................ FAILURE
> [20:14.588s]
> [INFO] Apache Crunch HBase Support ....................... SKIPPED
> [INFO] Apache Crunch Contrib ............................. SKIPPED
> [INFO] Apache Crunch Examples ............................ SKIPPED
> [INFO] Apache Crunch Archetype ........................... SKIPPED
> [INFO] Apache Crunch for Scala ........................... SKIPPED
> [INFO] Apache Crunch Distribution ........................ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 21:02.804s
> [INFO] Finished at: Sun Mar 03 05:35:28 UTC 2013
> [INFO] Final Memory: 23M/153M
> [INFO]
> ------------------------------------------------------------------------
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch-dist/pom.xml>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-dist/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-dist/0.6.0-SNAPSHOT/crunch-dist-0.6.0-SNAPSHOT.pom
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch-hbase/pom.xml>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-hbase/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-hbase/0.6.0-SNAPSHOT/crunch-hbase-0.6.0-SNAPSHOT.pom
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch-scrunch/pom.xml>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-scrunch/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-scrunch/0.6.0-SNAPSHOT/crunch-scrunch-0.6.0-SNAPSHOT.pom
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch/pom.xml>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch/0.6.0-SNAPSHOT/crunch-0.6.0-SNAPSHOT.pom
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch/target/crunch-0.6.0-SNAPSHOT.jar>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch/0.6.0-SNAPSHOT/crunch-0.6.0-SNAPSHOT.jar
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch-contrib/pom.xml>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-contrib/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-contrib/0.6.0-SNAPSHOT/crunch-contrib-0.6.0-SNAPSHOT.pom
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch-archetype/pom.xml>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-archetype/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-archetype/0.6.0-SNAPSHOT/crunch-archetype-0.6.0-SNAPSHOT.pom
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/pom.xml> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-parent/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-parent/0.6.0-SNAPSHOT/crunch-parent-0.6.0-SNAPSHOT.pom
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/target/crunch-parent-0.6.0-SNAPSHOT-site.xml>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-parent/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-parent/0.6.0-SNAPSHOT/crunch-parent-0.6.0-SNAPSHOT-site.xml
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch-examples/pom.xml>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-examples/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-examples/0.6.0-SNAPSHOT/crunch-examples-0.6.0-SNAPSHOT.pom
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch-test/pom.xml>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-test/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-test/0.6.0-SNAPSHOT/crunch-test-0.6.0-SNAPSHOT.pom
> [JENKINS] Archiving <
> https://builds.apache.org/job/Crunch-master-integration/ws/crunch-test/target/crunch-test-0.6.0-SNAPSHOT.jar>
> to
> /home/hudson/hudson/jobs/Crunch-master-integration/modules/org.apache.crunch$crunch-test/builds/2013-03-03_05-14-09/archive/org.apache.crunch/crunch-test/0.6.0-SNAPSHOT/crunch-test-0.6.0-SNAPSHOT.jar
> Waiting for Jenkins to finish collecting data
> mavenExecutionResult exceptions not empty
> message : Internal error: java.lang.reflect.UndeclaredThrowableException
> cause : null
> Stack trace :
> org.apache.maven.InternalErrorException: Internal error:
> java.lang.reflect.UndeclaredThrowableException
>         at
> org.apache.maven.lifecycle.internal.BuilderCommon.handleBuildError(BuilderCommon.java:128)
>         at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:95)
>         at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>         at
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>         at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>         at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>         at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>         at
> org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329)
>         at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239)
>         at
> org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:158)
>         at hudson.maven.Maven3Builder.call(Maven3Builder.java:100)
>         at hudson.maven.Maven3Builder.call(Maven3Builder.java:66)
>         at hudson.remoting.UserRequest.perform(UserRequest.java:118)
>         at hudson.remoting.UserRequest.perform(UserRequest.java:48)
>         at hudson.remoting.Request$2.run(Request.java:326)
>         at
> hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.reflect.UndeclaredThrowableException
>         at $Proxy2.setExecutedMojos(Unknown Source)
>         at
> hudson.maven.MavenBuildProxy$Filter.setExecutedMojos(MavenBuildProxy.java:243)
>         at
> hudson.maven.Maven3Builder$MavenExecutionListener.recordMojoEnded(Maven3Builder.java:439)
>         at
> hudson.maven.Maven3Builder$MavenExecutionListener.mojoSucceeded(Maven3Builder.java:425)
>         at
> org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:87)
>         at
> org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:42)
>         at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:228)
>         at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>         at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>         at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>         ... 24 more
> Caused by: java.io.UTFDataFormatException
>         at
> java.io.ObjectInputStream$BlockDataInputStream.readUTFSpan(ObjectInputStream.java:3086)
>         at
> java.io.ObjectInputStream$BlockDataInputStream.readUTFBody(ObjectInputStream.java:3030)
>         at
> java.io.ObjectInputStream$BlockDataInputStream.readUTF(ObjectInputStream.java:2843)
>         at java.io.ObjectInputStream.readUTF(ObjectInputStream.java:1069)
>         at
> java.io.ObjectStreamClass.readNonProxy(ObjectStreamClass.java:691)
>         at
> java.io.ObjectInputStream.readClassDescriptor(ObjectInputStream.java:827)
>         at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1583)
>         at
> java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514)
>         at java.io.ObjectInputStream.readArray(ObjectInputStream.java:1642)
>         at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1341)
>         at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1970)
>         at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1894)
>         at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1777)
>         at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347)
>         at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369)
>         at hudson.remoting.UserRequest.deserialize(UserRequest.java:182)
>         at hudson.remoting.UserRequest.perform(UserRequest.java:98)
>         at hudson.remoting.UserRequest.perform(UserRequest.java:48)
>         at hudson.remoting.Request$2.run(Request.java:326)
>         at
> hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:722)
> channel stopped
> [locks-and-latches] Releasing all the locks
> [locks-and-latches] All the locks released
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message