hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron T. Myers (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HADOOP-7819) java.lang.ClassCastException: org.apache.hadoop.mapreduce.ReduceContext$ValueIterable cannot be cast to java.util.Iterator
Date Mon, 14 Nov 2011 02:15:51 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aaron T. Myers resolved HADOOP-7819.
------------------------------------

    Resolution: Not A Problem
    
> java.lang.ClassCastException: org.apache.hadoop.mapreduce.ReduceContext$ValueIterable
cannot be cast to java.util.Iterator
> --------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7819
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7819
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.20.2
>         Environment: Linux calculate 2.6.39-pf4 #15 SMP PREEMPT Sat Nov 5 18:14:51 GST
2011 x86_64 Intel(R) Core(TM) i3 CPU M 330 @ 2.13GHz GenuineIntel GNU/Linux
> java version "1.6.0_26"
> Java(TM) SE Runtime Environment (build 1.6.0_26-b03)
> Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02, mixed mode)
>            Reporter: Eldar Abdrazakov
>
> 11/11/13 22:07:26 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker,
sessionId=
> WARNING: partition-by already refers to: #'clojure.core/partition-by in namespace: hadoop1,
being replaced by: #'clojure.contrib.seq-utils/partition-by
> WARNING: frequencies already refers to: #'clojure.core/frequencies in namespace: hadoop1,
being replaced by: #'clojure.contrib.seq-utils/frequencies
> WARNING: shuffle already refers to: #'clojure.core/shuffle in namespace: hadoop1, being
replaced by: #'clojure.contrib.seq-utils/shuffle
> WARNING: reductions already refers to: #'clojure.core/reductions in namespace: hadoop1,
being replaced by: #'clojure.contrib.seq-utils/reductions
> WARNING: partition-all already refers to: #'clojure.core/partition-all in namespace:
hadoop1, being replaced by: #'clojure.contrib.seq-utils/partition-all
> WARNING: group-by already refers to: #'clojure.core/group-by in namespace: hadoop1, being
replaced by: #'clojure.contrib.seq-utils/group-by
> WARNING: flatten already refers to: #'clojure.core/flatten in namespace: hadoop1, being
replaced by: #'clojure.contrib.seq-utils/flatten
> 11/11/13 22:07:26 INFO input.FileInputFormat: Total input paths to process : 1
> 11/11/13 22:07:26 INFO mapred.JobClient: Running job: job_local_0001
> 11/11/13 22:07:26 INFO input.FileInputFormat: Total input paths to process : 1
> 11/11/13 22:07:26 INFO mapred.MapTask: io.sort.mb = 100
> 11/11/13 22:07:27 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/11/13 22:07:27 INFO mapred.MapTask: record buffer = 262144/327680
> 11/11/13 22:07:27 INFO mapred.JobClient:  map 0% reduce 0%
> 11/11/13 22:07:30 INFO mapred.MapTask: Spilling map output: record full = true
> 11/11/13 22:07:30 INFO mapred.MapTask: bufstart = 0; bufend = 2097400; bufvoid = 99614720
> 11/11/13 22:07:30 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680
> 11/11/13 22:07:31 INFO mapred.MapTask: Finished spill 0
> 11/11/13 22:07:32 INFO mapred.LocalJobRunner: 
> 11/11/13 22:07:33 INFO mapred.MapTask: Spilling map output: record full = true
> 11/11/13 22:07:33 INFO mapred.MapTask: bufstart = 2097400; bufend = 4194707; bufvoid
= 99614720
> 11/11/13 22:07:33 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680
> 11/11/13 22:07:33 INFO mapred.JobClient:  map 75% reduce 0%
> 11/11/13 22:07:34 INFO mapred.MapTask: Finished spill 1
> 11/11/13 22:07:34 INFO mapred.MapTask: Starting flush of map output
> 11/11/13 22:07:34 INFO mapred.MapTask: Finished spill 2
> 11/11/13 22:07:34 INFO mapred.Merger: Merging 3 sorted segments
> 11/11/13 22:07:34 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left
of total size: 6276350 bytes
> 11/11/13 22:07:35 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000000_0 is done.
And is in the process of commiting
> 11/11/13 22:07:35 INFO mapred.LocalJobRunner: 
> 11/11/13 22:07:35 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000000_0' done.
> 11/11/13 22:07:35 INFO mapred.LocalJobRunner: 
> 11/11/13 22:07:35 INFO mapred.Merger: Merging 1 sorted segments
> 11/11/13 22:07:35 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left
of total size: 6276346 bytes
> 11/11/13 22:07:35 INFO mapred.LocalJobRunner: 
> 11/11/13 22:07:35 WARN mapred.LocalJobRunner: job_local_0001
> java.lang.ClassCastException: org.apache.hadoop.mapreduce.ReduceContext$ValueIterable
cannot be cast to java.util.Iterator
>         at clojure.core$iterator_seq.invoke(core.clj:4561)
>         at hadoop1$string_long_reduce_reader$fn__214.invoke(hadoop1.clj:40)
>         at hadoop1$my_reduce.invoke(hadoop1.clj:31)
>         at clojure.lang.AFn.applyToHelper(AFn.java:165)
>         at clojure.lang.AFn.applyTo(AFn.java:151)
>         at clojure.core$apply.invoke(core.clj:540)
>         at clojure_hadoop.wrap$wrap_reduce$fn__178.invoke(wrap.clj:92)
>         at clojure_hadoop.job_reducer.reduce(Unknown Source)
>         at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
>         at clojure_hadoop.job_reducer.run(Unknown Source)
>         at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:566)
>         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
> 11/11/13 22:07:35 INFO mapred.JobClient:  map 100% reduce 0%
> 11/11/13 22:07:35 INFO mapred.JobClient: Job complete: job_local_0001
> 11/11/13 22:07:35 INFO mapred.JobClient: Counters: 12
> 11/11/13 22:07:35 INFO mapred.JobClient:   FileSystemCounters
> 11/11/13 22:07:35 INFO mapred.JobClient:     FILE_BYTES_READ=22930784
> 11/11/13 22:07:35 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=28672002
> 11/11/13 22:07:35 INFO mapred.JobClient:   Map-Reduce Framework
> 11/11/13 22:07:35 INFO mapred.JobClient:     Reduce input groups=0
> 11/11/13 22:07:35 INFO mapred.JobClient:     Combine output records=0
> 11/11/13 22:07:35 INFO mapred.JobClient:     Map input records=12760
> 11/11/13 22:07:35 INFO mapred.JobClient:     Reduce shuffle bytes=0
> 11/11/13 22:07:35 INFO mapred.JobClient:     Reduce output records=0
> 11/11/13 22:07:35 INFO mapred.JobClient:     Spilled Records=1255180
> 11/11/13 22:07:35 INFO mapred.JobClient:     Map output bytes=5021164
> 11/11/13 22:07:35 INFO mapred.JobClient:     Combine input records=0
> 11/11/13 22:07:35 INFO mapred.JobClient:     Map output records=627590
> 11/11/13 22:07:35 INFO mapred.JobClient:     Reduce input records=0

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message