hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boris Shkolnik (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-124) Namenode slowed down when many files with same filename were moved to Trash
Date Thu, 06 Aug 2009 20:21:15 GMT

    [ https://issues.apache.org/jira/browse/HDFS-124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12740237#action_12740237
] 

Boris Shkolnik commented on HDFS-124:
-------------------------------------

ant test-patch
+1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
warnings.
     [exec] 
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec] 
     [exec]     +1 release audit.  The applied patch does not increase the total number of
release audit warnings.
     [exec] 

ant test

run-test-core:
    [mkdir] Created dir: /home/borya/work/hadoop/hadoop-common/build/test/data
    [mkdir] Created dir: /home/borya/work/hadoop/hadoop-common/build/test/logs
     [copy] Copying 1 file to /home/borya/work/hadoop/hadoop-common/build/test/extraconf
    [junit] Running org.apache.hadoop.cli.TestCLI
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.292 sec
    [junit] Running org.apache.hadoop.conf.TestConfiguration
    [junit] Tests run: 13, Failures: 0, Errors: 0, Time elapsed: 1.198 sec
    [junit] Running org.apache.hadoop.conf.TestConfigurationSubclass
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.419 sec
    [junit] Running org.apache.hadoop.conf.TestGetInstances
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.381 sec
    [junit] Running org.apache.hadoop.filecache.TestDistributedCache
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.198 sec
    [junit] Running org.apache.hadoop.fs.TestBlockLocation
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.229 sec
    [junit] Running org.apache.hadoop.fs.TestChecksumFileSystem
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.561 sec
    [junit] Running org.apache.hadoop.fs.TestDFVariations
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.375 sec
    [junit] Running org.apache.hadoop.fs.TestDU
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.497 sec
    [junit] Running org.apache.hadoop.fs.TestGetFileBlockLocations
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.278 sec
    [junit] Running org.apache.hadoop.fs.TestGlobExpander
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.055 sec
    [junit] Running org.apache.hadoop.fs.TestLocalDirAllocator
    [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 1.106 sec
    [junit] Running org.apache.hadoop.fs.TestLocalFileSystem
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 1.096 sec
    [junit] Running org.apache.hadoop.fs.TestLocalFileSystemPermission
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.584 sec
    [junit] Running org.apache.hadoop.fs.TestPath
    [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 0.084 sec
    [junit] Running org.apache.hadoop.fs.TestTrash
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 2.506 sec
    [junit] Running org.apache.hadoop.fs.TestTruncatedInputBug
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.531 sec
    [junit] Running org.apache.hadoop.fs.kfs.TestKosmosFileSystem
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.824 sec
    [junit] Running org.apache.hadoop.fs.permission.TestFsPermission
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.1 sec
    [junit] Running org.apache.hadoop.fs.s3.TestINode
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.076 sec
    [junit] Running org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract
    [junit] Tests run: 29, Failures: 0, Errors: 0, Time elapsed: 2.437 sec
    [junit] Running org.apache.hadoop.fs.s3.TestS3Credentials
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.195 sec
    [junit] Running org.apache.hadoop.fs.s3.TestS3FileSystem
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.237 sec
    [junit] Running org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract
    [junit] Tests run: 35, Failures: 0, Errors: 0, Time elapsed: 2.031 sec
    [junit] Running org.apache.hadoop.http.TestGlobalFilter
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.535 sec
    [junit] Running org.apache.hadoop.http.TestServletFilter
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.826 sec
    [junit] Running org.apache.hadoop.io.TestArrayFile
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 6.627 sec
    [junit] Running org.apache.hadoop.io.TestArrayWritable
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.213 sec
    [junit] Running org.apache.hadoop.io.TestBloomMapFile
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.766 sec
    [junit] Running org.apache.hadoop.io.TestBytesWritable
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.186 sec
    [junit] Running org.apache.hadoop.io.TestDefaultStringifier
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.341 sec
    [junit] Running org.apache.hadoop.io.TestEnumSetWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.2 sec
    [junit] Running org.apache.hadoop.io.TestGenericWritable
    [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.527 sec
    [junit] Running org.apache.hadoop.io.TestMD5Hash
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.088 sec
    [junit] Running org.apache.hadoop.io.TestMapFile
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.861 sec
    [junit] Running org.apache.hadoop.io.TestMapWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.289 sec
    [junit] Running org.apache.hadoop.io.TestSequenceFileSerialization
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.672 sec
    [junit] Running org.apache.hadoop.io.TestSetFile
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 6.44 sec
    [junit] Running org.apache.hadoop.io.TestSortedMapWritable
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.263 sec
    [junit] Running org.apache.hadoop.io.TestText
    [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 1.092 sec
    [junit] Running org.apache.hadoop.io.TestTextNonUTF8
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.046 sec
    [junit] Running org.apache.hadoop.io.TestUTF8
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.223 sec
    [junit] Running org.apache.hadoop.io.TestVersionedWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.075 sec
    [junit] Running org.apache.hadoop.io.TestWritable
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.079 sec
    [junit] Running org.apache.hadoop.io.TestWritableName
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.231 sec
    [junit] Running org.apache.hadoop.io.TestWritableUtils
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.036 sec
    [junit] Running org.apache.hadoop.io.compress.TestCodec
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 20.625 sec
    [junit] Running org.apache.hadoop.io.compress.TestCodecFactory
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.453 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFile
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 2.756 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 6.188 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileComparators
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.555 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 6.104 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 0.207 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsStreams
    [junit] Tests run: 19, Failures: 0, Errors: 0, Time elapsed: 0.201 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 3.298 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsJClassComparatorByteArrays
    [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 3.378 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsStreams
    [junit] Tests run: 19, Failures: 0, Errors: 0, Time elapsed: 3.224 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileSeek
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 6.468 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileSeqFileComparison
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 23.683 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileSplit
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 11.542 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileStreams
    [junit] Tests run: 19, Failures: 0, Errors: 0, Time elapsed: 3.893 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestTFileUnsortedByteArrays
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.875 sec
    [junit] Running org.apache.hadoop.io.file.tfile.TestVLong
    [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 4.215 sec
    [junit] Running org.apache.hadoop.io.retry.TestRetryProxy
    [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 0.417 sec
    [junit] Running org.apache.hadoop.io.serializer.TestWritableSerialization
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.264 sec
    [junit] Running org.apache.hadoop.io.serializer.avro.TestAvroSerialization
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.677 sec
    [junit] Running org.apache.hadoop.ipc.TestIPC
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 15.459 sec
    [junit] Running org.apache.hadoop.ipc.TestIPCServerResponder
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 11.274 sec
    [junit] Running org.apache.hadoop.ipc.TestRPC
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 34.832 sec
    [junit] Running org.apache.hadoop.log.TestLogLevel
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.407 sec
    [junit] Running org.apache.hadoop.metrics.TestMetricsServlet
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.142 sec
    [junit] Running org.apache.hadoop.metrics.spi.TestOutputRecord
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.048 sec
    [junit] Running org.apache.hadoop.net.TestDNS
    [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 0.107 sec
    [junit] Running org.apache.hadoop.net.TestScriptBasedMapping
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.489 sec
    [junit] Running org.apache.hadoop.net.TestSocketIOWithTimeout
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.091 sec
    [junit] Running org.apache.hadoop.record.TestBuffer
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.069 sec
    [junit] Running org.apache.hadoop.record.TestRecordIO
    [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.209 sec
    [junit] Running org.apache.hadoop.record.TestRecordVersioning
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.143 sec
    [junit] Running org.apache.hadoop.security.TestAccessControlList
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.047 sec
    [junit] Running org.apache.hadoop.security.TestAccessToken
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.029 sec
    [junit] Running org.apache.hadoop.security.TestUnixUserGroupInformation
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.534 sec
    [junit] Running org.apache.hadoop.security.authorize.TestConfiguredPolicy
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.401 sec
    [junit] Running org.apache.hadoop.util.TestCyclicIteration
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.049 sec
    [junit] Running org.apache.hadoop.util.TestGenericsUtil
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.247 sec
    [junit] Running org.apache.hadoop.util.TestIndexedSort
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 2.097 sec
    [junit] Running org.apache.hadoop.util.TestProcfsBasedProcessTree
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 7.739 sec
    [junit] Running org.apache.hadoop.util.TestPureJavaCrc32
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.372 sec
    [junit] Running org.apache.hadoop.util.TestShell
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.265 sec
    [junit] Running org.apache.hadoop.util.TestStringUtils
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.071 sec




> Namenode slowed down when many files with same filename were moved to Trash
> ---------------------------------------------------------------------------
>
>                 Key: HDFS-124
>                 URL: https://issues.apache.org/jira/browse/HDFS-124
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Koji Noguchi
>            Assignee: Boris Shkolnik
>            Priority: Minor
>         Attachments: COMMON-124.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message