hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: reduce no response
Date Wed, 01 Feb 2012 10:54:19 GMT
Jinyan,

Am not sure what your problem here seems to be - the client hanging or
the job itself hanging. Could you provide us some more information on
what state the job is hung in, or expand on the job client hang?
Having a jstack also helps whenever you run into a JVM hang.

On Wed, Feb 1, 2012 at 3:46 PM, Jinyan Xu <Jinyan.Xu@exar.com> wrote:
> Hi all,
>
> Do terasort use 4 reduce 8 map , when all maps finish reduce no response.
>
> Debug messages like:
>
> 12/02/02 01:42:47 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop sending #7126
> 12/02/02 01:42:47 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop got value #7126
> 12/02/02 01:42:47 DEBUG ipc.RPC: Call: getJobStatus 1
> 12/02/02 01:42:48 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop sending #7127
> 12/02/02 01:42:48 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop got value #7127
> 12/02/02 01:42:48 DEBUG ipc.RPC: Call: getTaskCompletionEvents 0
> 12/02/02 01:42:48 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop sending #7128
> 12/02/02 01:42:48 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop got value #7128
> 12/02/02 01:42:48 DEBUG ipc.RPC: Call: getJobStatus 1
> 12/02/02 01:42:49 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop sending #7129
> 12/02/02 01:42:49 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop got value #7129
> 12/02/02 01:42:49 DEBUG ipc.RPC: Call: getTaskCompletionEvents 0
> 12/02/02 01:42:49 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop sending #7130
> 12/02/02 01:42:49 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop got value #7130
> 12/02/02 01:42:49 DEBUG ipc.RPC: Call: getJobStatus 1
> 12/02/02 01:42:50 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop sending #7131
> 12/02/02 01:42:50 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop got value #7131
> 12/02/02 01:42:50 DEBUG ipc.RPC: Call: getTaskCompletionEvents 1
> 12/02/02 01:42:50 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop sending #7132
> 12/02/02 01:42:50 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop got value #7132
> 12/02/02 01:42:50 DEBUG ipc.RPC: Call: getJobStatus 0
> 12/02/02 01:42:51 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop sending #7133
> 12/02/02 01:42:51 DEBUG ipc.Client: IPC Client (47) connection to localhost/127.0.0.1:9001
from hadoop got value #7133
>
>
> ________________________________
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged. The message is
> intended solely for the addressee(s). If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful. If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.



-- 
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about

Mime
View raw message