hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6099) Allow configuring the IPC module to send pings
Date Fri, 10 Jul 2009 06:14:15 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12729537#action_12729537
] 

dhruba borthakur commented on HADOOP-6099:
------------------------------------------

Hudson is stuck, so I ran the tests myself:

{quote}
run-test-core:
    [mkdir] Created dir: /mnt/vol/devrs004.snc1/dhruba/raincommon/build/test/data
    [mkdir] Created dir: /mnt/vol/devrs004.snc1/dhruba/raincommon/build/test/logs
     [copy] Copying 1 file to /mnt/vol/devrs004.snc1/dhruba/raincommon/build/test/extraconf
    [junit] Running org.apache.hadoop.cli.TestCLI
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.095 sec
    [junit] Running org.apache.hadoop.conf.TestConfiguration
    [junit] Tests run: 12, Failures: 0, Errors: 0, Time elapsed: 0.364 sec
    [junit] Running org.apache.hadoop.conf.TestConfigurationSubclass
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.192 sec
    [junit] Running org.apache.hadoop.conf.TestGetInstances
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.146 sec
    [junit] Running org.apache.hadoop.filecache.TestDistributedCache
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.39 sec
    [junit] Running org.apache.hadoop.fs.TestBlockLocation
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.095 sec
    [junit] Running org.apache.hadoop.fs.TestChecksumFileSystem
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.263 sec
    [junit] Running org.apache.hadoop.fs.TestDFVariations
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.192 sec
    [junit] Running org.apache.hadoop.fs.TestDU
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.125 sec
    [junit] Running org.apache.hadoop.fs.TestGetFileBlockLocations
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.45 sec
    [junit] Running org.apache.hadoop.fs.TestGlobExpander
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.018 sec
    [junit] Running org.apache.hadoop.fs.TestLocalDirAllocator
    [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.158 sec
    [junit] Running org.apache.hadoop.fs.TestLocalFileSystem
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.51 sec
    [junit] Running org.apache.hadoop.fs.TestLocalFileSystemPermission
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.415 sec
    [junit] Running org.apache.hadoop.fs.TestPath
    [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 0.03 sec
    [junit] Running org.apache.hadoop.fs.TestTrash
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.511 sec
    [junit] Running org.apache.hadoop.fs.TestTruncatedInputBug
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.256 sec
    [junit] Running org.apache.hadoop.fs.kfs.TestKosmosFileSystem
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.348 sec
    [junit] Running org.apache.hadoop.fs.permission.TestFsPermission
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.036 sec
    [junit] Running org.apache.hadoop.fs.s3.TestINode
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.019 sec
    [junit] Running org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract
    [junit] Tests run: 29, Failures: 0, Errors: 0, Time elapsed: 0.621 sec
    [junit] Running org.apache.hadoop.fs.s3.TestS3Credentials
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.096 sec
    [junit] Running org.apache.hadoop.fs.s3.TestS3FileSystem
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.112 sec
    [junit] Running org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract
    [junit] Tests run: 35, Failures: 0, Errors: 0, Time elapsed: 0.655 sec
    [junit] Running org.apache.hadoop.http.TestGlobalFilter
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.704 sec
    [junit] Running org.apache.hadoop.http.TestServletFilter
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.729 sec
    [junit] Running org.apache.hadoop.io.TestArrayFile
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 3.057 sec
    [junit] Running org.apache.hadoop.io.TestArrayWritable
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.099 sec
    [junit] Running org.apache.hadoop.io.TestBloomMapFile
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.358 sec
    [junit] Running org.apache.hadoop.io.TestBytesWritable
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.081 sec
    [junit] Running org.apache.hadoop.io.TestDefaultStringifier
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.157 sec
    [junit] Running org.apache.hadoop.io.TestEnumSetWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.093 sec
    [junit] Running org.apache.hadoop.io.TestGenericWritable
    [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.24 sec
    [junit] Running org.apache.hadoop.io.TestMD5Hash
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.03 sec
    [junit] Running org.apache.hadoop.io.TestMapFile
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.31 sec
    [junit] Running org.apache.hadoop.io.TestMapWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.121 sec
    [junit] Running org.apache.hadoop.io.TestSequenceFileSerialization
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.312 sec
    [junit] Running org.apache.hadoop.io.TestSetFile
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.978 sec
    [junit] Running org.apache.hadoop.io.TestSortedMapWritable
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.107 sec
    [junit] Running org.apache.hadoop.io.TestText
    [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 0.569 sec
    [junit] Running org.apache.hadoop.io.TestTextNonUTF8
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.019 sec
    [junit] Running org.apache.hadoop.io.TestUTF8
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.097 sec
    [junit] Running org.apache.hadoop.io.TestVersionedWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.028 sec
    [junit] Running org.apache.hadoop.io.TestWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.027 sec
    [junit] Running org.apache.hadoop.io.TestWritableName
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.098 sec
    [junit] Running org.apache.hadoop.io.TestWritableUtils
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.016 sec
    [junit] Running org.apache.hadoop.io.compress.TestCodec
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 8.667 sec
    [junit] Running org.apache.hadoop.io.compress.TestCodecFactory
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.205 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFile
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.074 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 2.378 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileComparators
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.261 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 2.327 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 0.069 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsStreams
    [junit] Tests run: 19, Failures: 0, Errors: 0, Time elapsed: 0.08 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 1.154 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsJClassComparatorByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 1.137 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsStreams
    [junit] Tests run: 19, Failures: 0, Errors: 0, Time elapsed: 1.36 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileSeek
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.536 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileSeqFileComparison
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 10.179 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileSplit
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.519 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileStreams
    [junit] Tests run: 19, Failures: 0, Errors: 0, Time elapsed: 1.355 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileUnsortedByteArrays
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.366 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestVLong
    [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 1.749 sec
    [junit] Running org.apache.hadoop.io.retry.TestRetryProxy
    [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 0.18 sec
    [junit] Running org.apache.hadoop.io.serializer.TestWritableSerialization
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.038 sec
    [junit] Running org.apache.hadoop.ipc.TestIPC
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 12.743 sec
    [junit] Running org.apache.hadoop.ipc.TestIPCServerResponder
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 11.831 sec
    [junit] Running org.apache.hadoop.ipc.TestRPC
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 32.536 sec
    [junit] Running org.apache.hadoop.log.TestLogLevel
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.675 sec
    [junit] Running org.apache.hadoop.metrics.TestMetricsServlet
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.048 sec
    [junit] Running org.apache.hadoop.metrics.spi.TestOutputRecord
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.017 sec
    [junit] Running org.apache.hadoop.net.TestDNS
    [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 0.156 sec
    [junit] Running org.apache.hadoop.net.TestScriptBasedMapping
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.388 sec
    [junit] Running org.apache.hadoop.net.TestSocketIOWithTimeout
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.032 sec
    [junit] Running org.apache.hadoop.record.TestBuffer
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.018 sec
    [junit] Running org.apache.hadoop.record.TestRecordIO
    [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.073 sec
    [junit] Running org.apache.hadoop.record.TestRecordVersioning
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.052 sec
    [junit] Running org.apache.hadoop.security.TestAccessControlList
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.019 sec
    [junit] Running org.apache.hadoop.security.TestAccessToken
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.54 sec
    [junit] Running org.apache.hadoop.security.TestUnixUserGroupInformation
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.279 sec
    [junit] Running org.apache.hadoop.security.authorize.TestConfiguredPolicy
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.18 sec
    [junit] Running org.apache.hadoop.util.TestCyclicIteration
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.021 sec
    [junit] Running org.apache.hadoop.util.TestGenericsUtil
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.116 sec
    [junit] Running org.apache.hadoop.util.TestIndexedSort
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.716 sec
    [junit] Running org.apache.hadoop.util.TestProcfsBasedProcessTree
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 7.54 sec
    [junit] Running org.apache.hadoop.util.TestShell
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.13 sec
    [junit] Running org.apache.hadoop.util.TestStringUtils
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.025 sec

     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
warnings.
     [exec] 
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec] 
     [exec]     -1 release audit.  The applied patch generated 265 release audit warnings
(more than the trunk's current 263 warnings
{quote}



> Allow configuring the IPC module to send pings
> ----------------------------------------------
>
>                 Key: HADOOP-6099
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6099
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: ipc
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>             Fix For: 0.21.0
>
>         Attachments: ipcPing.txt, ipcPing2.txt
>
>
> The IPC Client sets a socketTimeout for the time period specified by the pingInterval
and then sends a ping every pingInterval. This means that if a RPC server does not respond
to a RPC client, then the RPC client blocks forever. This is a problem for applications that
wants to switch quickly from one un-responsive HDFS cluster  to a good one. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message