hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7358) Clients may get stuck waiting when using ByteArrayManager
Date Wed, 05 Nov 2014 23:20:35 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199334#comment-14199334
] 

stack commented on HDFS-7358:
-----------------------------

Better but still an odd skip: 28, 68...

{code}
2014-11-05 15:15:45,573 DEBUG [main] hdfs.DFSClient: Waiting for ack for: 0
2014-11-05 15:15:46,263 DEBUG [main] hdfs.DFSClient: Waiting for ack for: 1
2014-11-05 15:15:48,680 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 1
2014-11-05 15:15:48,684 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 2
2014-11-05 15:15:48,685 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 3
2014-11-05 15:15:48,685 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 4
2014-11-05 15:15:48,687 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 5
2014-11-05 15:15:48,688 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 6
2014-11-05 15:15:48,690 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 7
2014-11-05 15:15:48,690 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 8
2014-11-05 15:15:48,691 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 9
2014-11-05 15:15:48,693 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 10
2014-11-05 15:15:48,693 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 11
2014-11-05 15:15:48,695 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 12
2014-11-05 15:15:48,695 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 13
2014-11-05 15:15:48,697 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 14
2014-11-05 15:15:48,697 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 14
2014-11-05 15:15:48,698 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 16
2014-11-05 15:15:48,698 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 17
2014-11-05 15:15:48,702 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 18
2014-11-05 15:15:48,703 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 19
2014-11-05 15:15:48,704 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 20
2014-11-05 15:15:48,704 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 21
2014-11-05 15:15:48,705 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 22
2014-11-05 15:15:48,706 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 23
2014-11-05 15:15:48,707 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 24
2014-11-05 15:15:48,708 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 25
2014-11-05 15:15:48,708 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 26
2014-11-05 15:15:48,709 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 27
2014-11-05 15:15:48,710 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 28
2014-11-05 15:15:48,710 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 28
2014-11-05 15:15:48,711 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 30
2014-11-05 15:15:48,712 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 31
2014-11-05 15:15:48,713 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 32
2014-11-05 15:15:48,713 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 33
2014-11-05 15:15:48,714 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 34
2014-11-05 15:15:48,715 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 35
2014-11-05 15:15:48,716 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 36
2014-11-05 15:15:48,717 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 37
2014-11-05 15:15:48,717 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 38
2014-11-05 15:15:48,718 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 39
2014-11-05 15:15:48,718 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 40
2014-11-05 15:15:48,720 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 41
2014-11-05 15:15:48,721 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 42
2014-11-05 15:15:48,723 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 43
2014-11-05 15:15:48,724 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 44
2014-11-05 15:15:48,724 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 44
2014-11-05 15:15:48,726 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 46
2014-11-05 15:15:48,727 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 47
2014-11-05 15:15:48,727 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 48
2014-11-05 15:15:48,728 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 49
2014-11-05 15:15:48,730 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 50
2014-11-05 15:15:48,731 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 51
2014-11-05 15:15:48,731 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 52
2014-11-05 15:15:48,733 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 53
2014-11-05 15:15:48,734 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 54
2014-11-05 15:15:48,734 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 55
2014-11-05 15:15:48,736 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 56
2014-11-05 15:15:48,737 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 57
2014-11-05 15:15:48,737 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 58
2014-11-05 15:15:48,738 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 59
2014-11-05 15:15:48,739 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 60
2014-11-05 15:15:48,739 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 61
2014-11-05 15:15:48,740 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 62
2014-11-05 15:15:48,741 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 63
2014-11-05 15:15:48,741 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 64
2014-11-05 15:15:48,742 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 65
2014-11-05 15:15:48,742 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 66
2014-11-05 15:15:48,743 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 67
2014-11-05 15:15:48,744 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 68
2014-11-05 15:15:48,744 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 68
2014-11-05 15:15:48,744 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 70
2014-11-05 15:15:48,745 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 71
2014-11-05 15:15:48,747 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 72
2014-11-05 15:15:48,748 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 73
2014-11-05 15:15:48,749 DEBUG [sync.3] hdfs.DFSClient: Waiting for ack for: 74
2014-11-05 15:15:48,749 DEBUG [sync.4] hdfs.DFSClient: Waiting for ack for: 75
2014-11-05 15:15:48,750 DEBUG [sync.0] hdfs.DFSClient: Waiting for ack for: 76
2014-11-05 15:15:48,751 DEBUG [sync.1] hdfs.DFSClient: Waiting for ack for: 77
2014-11-05 15:15:48,751 DEBUG [sync.2] hdfs.DFSClient: Waiting for ack for: 78
...
{code}

> Clients may get stuck waiting when using ByteArrayManager
> ---------------------------------------------------------
>
>                 Key: HDFS-7358
>                 URL: https://issues.apache.org/jira/browse/HDFS-7358
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs-client
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>         Attachments: h7358_20141104.patch, h7358_20141104_wait_timeout.patch, h7358_20141105.patch
>
>
> [~stack] reported that clients might get stuck waiting when using ByteArrayManager; see
[his comments|https://issues.apache.org/jira/browse/HDFS-7276?focusedCommentId=14197036&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14197036].



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message