hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3863) Use a thread-local rather than static ENCODER/DECODER variables in Text for synchronization
Date Wed, 30 Jul 2008 22:58:31 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12618545#action_12618545
] 

Tsz Wo (Nicholas), SZE commented on HADOOP-3863:
------------------------------------------------

> The test failure (org.apache.hadoop.hdfs.TestFileAppend2.testComplexAppend) is unrelated.


I am not sure whether it is unrelated since this patch changes a core class and this is the
first time that TestFileAppend2.testComplexAppend fails.  TestFileAppend2.testComplexAppend
create a number of threads appending files concurrently.  It seems to me that it might be
related.  Could we try Hudson one more time?

> Use a thread-local rather than static ENCODER/DECODER variables in Text for synchronization
> -------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3863
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3863
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.18.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>            Priority: Critical
>             Fix For: 0.19.0
>
>         Attachments: HADOOP-3863_0_20080730.patch, HADOOP-3863_1_20080730.patch
>
>
> Text.{ENCODER|DECODER} are static variables which need to be synchronized in Text.{read|write}String;
given that lots of RPC code calls Text.{read|write}String the contention for this lock shows
up very significantly on large clusters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message