hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravi Prakash <ravihad...@gmail.com>
Subject Re: Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64
Date Thu, 03 Aug 2017 19:05:22 GMT
It would have been nice if MSDN had a windows image that I could spin up on
my favorite Linux distro :-) But I haven't been able to find it yet :(

On Thu, Aug 3, 2017 at 3:23 AM, Steve Loughran <stevel@hortonworks.com>
wrote:

> wow, a lot of failures.
>
> some appear to be test timeouts, some native library availability (
> https://builds.apache.org/job/hadoop-trunk-win/146/
> testReport/junit/org.apache.hadoop.util/TestNativeCodeLoader/
> testNativeCodeLoaded/), but I think many (most?) are due to them getting
> paths wrong once there's a drive prefix there, e.g.
> https://builds.apache.org/job/hadoop-trunk-win/146/
> testReport/junit/org.apache.hadoop.fs/TestFsShellList/testList/
>
> including those which think that file:// + file.getAbsolutePath is a valid
> URI
>
> https://builds.apache.org/job/hadoop-trunk-win/146/
> testReport/junit/org.apache.hadoop.conf/TestConfiguration/
>
> I think the way to deal with this is going to be some form of bug bash.
> Who out there wants to spend a day doing windows builds? It's not *too*
> bad...setting up the VM is the hard part.
>
>
> On 3 Aug 2017, at 05:45, Allen Wittenauer <aw@effectivemachines.com<
> mailto:aw@effectivemachines.com>> wrote:
>
> For more details, see https://builds.apache.org/job/hadoop-trunk-win/146/
>
> [Aug 2, 2017 4:25:19 PM] (yufei) YARN-6895. [FairScheduler] Preemption
> reservation may cause regular
>
>
>
>
> -1 overall
>
>
> The following subsystems voted -1:
>   unit
>
>
> The following subsystems are considered long running:
> (runtime bigger than 1h 00m 00s)
>   unit
>
>
> Specific tests:
>
>   Failed CTEST tests :
>
>      test_test_libhdfs_threaded_hdfs_static
>
>   Failed junit tests :
>
>      hadoop.conf.TestConfiguration
>      hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec
>      hadoop.fs.contract.rawlocal.TestRawlocalContractAppend
>      hadoop.fs.TestFsShellCopy
>      hadoop.fs.TestFsShellList
>      hadoop.fs.TestLocalFileSystem
>      hadoop.io.nativeio.TestNativeIO
>      hadoop.io.TestSequenceFileAppend
>      hadoop.ipc.TestIPC
>      hadoop.ipc.TestSocketFactory
>      hadoop.metrics2.impl.TestStatsDMetrics
>      hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal
>      hadoop.security.TestShellBasedUnixGroupsMapping
>      hadoop.security.token.TestDtUtilShell
>      hadoop.util.TestNativeCodeLoader
>      hadoop.fs.TestWebHdfsFileContextMainOperations
>      hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy
>      hadoop.hdfs.qjournal.client.TestQuorumJournalManager
>      hadoop.hdfs.security.TestDelegationTokenForProxyUser
>      hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
>      hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
>      hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
>      hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
>      hadoop.hdfs.server.datanode.fsdataset.impl.
> TestLazyPersistLockedMemory
>      hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
>      hadoop.hdfs.server.datanode.fsdataset.impl.
> TestLazyPersistReplicaPlacement
>      hadoop.hdfs.server.datanode.fsdataset.impl.
> TestLazyPersistReplicaRecovery
>      hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
>      hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
>      hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage
>      hadoop.hdfs.server.datanode.TestBlockScanner
>      hadoop.hdfs.server.datanode.TestDataNodeFaultInjector
>      hadoop.hdfs.server.datanode.TestDataNodeUUID
>      hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
>      hadoop.hdfs.server.datanode.TestDirectoryScanner
>      hadoop.hdfs.server.datanode.TestHSync
>      hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame
>      hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand
>      hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC
>      hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
>      hadoop.hdfs.server.namenode.ha.TestHAAppend
>      hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
>      hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
>      hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
>      hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands
>      hadoop.hdfs.server.namenode.TestEditLogRace
>      hadoop.hdfs.server.namenode.TestFileTruncate
>      hadoop.hdfs.server.namenode.TestFsck
>      hadoop.hdfs.server.namenode.TestNameNodeMXBean
>      hadoop.hdfs.server.namenode.TestNestedEncryptionZones
>      hadoop.hdfs.server.namenode.TestQuotaByStorageType
>      hadoop.hdfs.server.namenode.TestStartup
>      hadoop.hdfs.TestBlockStoragePolicy
>      hadoop.hdfs.TestDatanodeRegistration
>      hadoop.hdfs.TestDFSOutputStream
>      hadoop.hdfs.TestDFSShell
>      hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy
>      hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030
>      hadoop.hdfs.TestDFSStripedOutputStreamWithFailure050
>      hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080
>      hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100
>      hadoop.hdfs.TestDFSStripedOutputStreamWithFailure140
>      hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
>      hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy
>      hadoop.hdfs.TestFetchImage
>      hadoop.hdfs.TestFileAppend
>      hadoop.hdfs.TestFileCreation
>      hadoop.hdfs.TestHDFSFileSystemContract
>      hadoop.hdfs.TestHDFSServerPorts
>      hadoop.hdfs.TestHDFSTrash
>      hadoop.hdfs.TestLocalDFS
>      hadoop.hdfs.TestMiniDFSCluster
>      hadoop.hdfs.TestQuota
>      hadoop.hdfs.TestReadStripedFileWithMissingBlocks
>      hadoop.hdfs.TestReconstructStripedFile
>      hadoop.hdfs.TestSecureEncryptionZoneWithKMS
>      hadoop.hdfs.TestTrashWithSecureEncryptionZones
>      hadoop.hdfs.tools.TestDebugAdmin
>      hadoop.hdfs.tools.TestDFSAdmin
>      hadoop.hdfs.web.TestWebHdfsFileSystemContract
>      hadoop.fs.http.server.TestHttpFSServerWebServer
>      hadoop.yarn.logaggregation.TestAggregatedLogFormat
>      hadoop.yarn.server.nodemanager.containermanager.
> launcher.TestContainerLaunch
>      hadoop.yarn.server.nodemanager.containermanager.linux.privileged.
> TestPrivilegedOperationExecutor
>      hadoop.yarn.server.nodemanager.containermanager.linux.resources.
> TestCGroupsHandlerImpl
>      hadoop.yarn.server.nodemanager.containermanager.linux.runtime.
> TestDockerContainerRuntime
>      hadoop.yarn.server.nodemanager.containermanager.linux.runtime.
> TestJavaSandboxLinuxContainerRuntime
>      hadoop.yarn.server.nodemanager.containermanager.logaggregation.
> TestAppLogAggregatorImpl
>      hadoop.yarn.server.nodemanager.containermanager.logaggregation.
> TestLogAggregationService
>      hadoop.yarn.server.nodemanager.containermanager.
> monitor.TestContainersMonitor
>      hadoop.yarn.server.nodemanager.containermanager.TestContainerManager
>      hadoop.yarn.server.nodemanager.containermanager.
> TestContainerManagerRecovery
>      hadoop.yarn.server.nodemanager.nodelabels.
> TestScriptBasedNodeLabelsProvider
>      hadoop.yarn.server.nodemanager.recovery.
> TestNMLeveldbStateStoreService
>      hadoop.yarn.server.nodemanager.TestContainerExecutor
>      hadoop.yarn.server.nodemanager.TestLocalDirsHandlerService
>      hadoop.yarn.server.nodemanager.TestNodeManagerResync
>      hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore
>      hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore
>      hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore
>      hadoop.yarn.server.resourcemanager.TestResourceTrackerService
>      hadoop.yarn.server.resourcemanager.TestRMAdminService
>      hadoop.yarn.client.api.impl.TestAMRMClient
>      hadoop.yarn.client.api.impl.TestNMClient
>      hadoop.yarn.client.cli.TestLogsCLI
>      hadoop.yarn.client.TestFederationRMFailoverProxyProvider
>      hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore
>      hadoop.yarn.server.timeline.TestLogInfo
>      hadoop.yarn.server.timelineservice.reader.
> TestTimelineReaderWebServicesHBaseStorage
>      hadoop.yarn.server.timelineservice.storage.flow.
> TestHBaseStorageFlowActivity
>      hadoop.yarn.server.timelineservice.storage.flow.
> TestHBaseStorageFlowRun
>      hadoop.yarn.server.timelineservice.storage.flow.
> TestHBaseStorageFlowRunCompaction
>      hadoop.yarn.server.timelineservice.storage.
> TestHBaseTimelineStorageApps
>      hadoop.yarn.server.timelineservice.storage.
> TestHBaseTimelineStorageEntities
>      hadoop.yarn.server.router.webapp.TestRouterWebServicesREST
>      hadoop.yarn.applications.distributedshell.TestDistributedShell
>      hadoop.mapreduce.filecache.TestClientDistributedCacheManager
>      hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter
>      hadoop.mapreduce.lib.output.TestFileOutputCommitter
>      hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
>      hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
>      hadoop.mapreduce.v2.app.job.impl.TestJobImpl
>      hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
>      hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
>      hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
>      hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
>      hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
>      hadoop.mapreduce.v2.app.rm.TestRMContainerAllocator
>      hadoop.mapreduce.v2.app.TestAMInfos
>      hadoop.mapreduce.v2.app.TestFail
>      hadoop.mapreduce.v2.app.TestFetchFailure
>      hadoop.mapreduce.v2.app.TestJobEndNotifier
>      hadoop.mapreduce.v2.app.TestKill
>      hadoop.mapreduce.v2.app.TestMRApp
>      hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
>      hadoop.mapreduce.v2.app.TestMRAppMaster
>      hadoop.mapreduce.v2.app.TestMRClientService
>      hadoop.mapreduce.v2.app.TestRecovery
>      hadoop.mapreduce.v2.app.TestStagingCleanup
>      hadoop.mapreduce.v2.app.webapp.TestAMWebApp
>      hadoop.mapreduce.v2.hs.TestHistoryServerFileSystemStateStoreService
>      hadoop.mapreduce.v2.hs.TestJobHistoryEntities
>      hadoop.mapreduce.v2.hs.TestJobHistoryEvents
>      hadoop.mapreduce.v2.hs.TestJobHistoryParsing
>      hadoop.mapreduce.v2.hs.TestJobHistoryServer
>      hadoop.mapreduce.v2.hs.TestUnnecessaryBlockingOnHistoryFileInfo
>      hadoop.mapreduce.v2.hs.webapp.dao.TestJobInfo
>      hadoop.mapreduce.v2.hs.webapp.TestHSWebApp
>      hadoop.conf.TestNoDefaultsJobConf
>      hadoop.fs.TestDFSIO
>      hadoop.mapred.join.TestDatamerge
>      hadoop.mapred.lib.TestDelegatingInputFormat
>      hadoop.mapred.TestClusterMapReduceTestCase
>      hadoop.mapred.TestJavaSerialization
>      hadoop.mapred.TestJobName
>      hadoop.mapred.TestJobSysDirWithDFS
>      hadoop.mapred.TestLazyOutput
>      hadoop.mapred.TestLocalJobSubmission
>      hadoop.mapred.TestMerge
>      hadoop.mapred.TestMiniMRChildTask
>      hadoop.mapred.TestMiniMRClasspath
>      hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers
>      hadoop.mapred.TestMRCJCFileInputFormat
>      hadoop.mapred.TestMRIntermediateDataEncryption
>      hadoop.mapred.TestMROpportunisticMaps
>      hadoop.mapred.TestMRTimelineEventHandling
>      hadoop.mapred.TestReduceFetch
>      hadoop.mapred.TestReduceFetchFromPartialMem
>      hadoop.mapred.TestSpecialCharactersInOutputPath
>      hadoop.mapreduce.lib.input.TestCombineFileInputFormat
>      hadoop.mapreduce.lib.input.TestDelegatingInputFormat
>      hadoop.mapreduce.lib.join.TestJoinDatamerge
>      hadoop.mapreduce.lib.join.TestJoinProperties
>      hadoop.mapreduce.security.ssl.TestEncryptedShuffle
>      hadoop.mapreduce.security.TestBinaryTokenFile
>      hadoop.mapreduce.security.TestMRCredentials
>      hadoop.mapreduce.TestMapReduceLazyOutput
>      hadoop.mapreduce.TestMRJobClient
>      hadoop.mapreduce.v2.TestMiniMRProxyUser
>      hadoop.mapreduce.v2.TestMRJobs
>      hadoop.mapreduce.v2.TestNonExistentJob
>      hadoop.mapreduce.v2.TestUberAM
>      hadoop.mapred.nativetask.handlers.TestNativeCollectorOnlyHandler
>      hadoop.tools.TestDistCpSystem
>      hadoop.tools.TestDistCpViewFs
>      hadoop.tools.TestIntegration
>      hadoop.tools.TestHadoopArchiveLogs
>      hadoop.yarn.sls.TestReservationSystemInvariants
>      hadoop.yarn.sls.TestSLSRunner
>      hadoop.fs.adl.TestGetFileStatus
>
>   Timed out junit tests :
>
>      org.apache.hadoop.hdfs.tools.offlineImageViewer.
> TestOfflineImageViewer
>      org.apache.hadoop.mapreduce.v2.hs.TestJobHistory
>      org.apache.hadoop.mapred.pipes.TestPipeApplication
>
>
>  CTEST:
>
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt  [28K]
>
>  unit:
>
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-common-project_hadoop-common.txt  [268K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt  [1.6M]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt  [88K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-httpfs.txt  [16K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
> [36K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-
> yarn-server_hadoop-yarn-server-nodemanager.txt  [160K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-
> yarn-server_hadoop-yarn-server-applicationhistoryservice.txt  [36K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-
> yarn-server_hadoop-yarn-server-resourcemanager.txt  [80K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
> [24K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-
> yarn-server_hadoop-yarn-server-timeline-pluginstorage.txt  [20K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-
> yarn-server_hadoop-yarn-server-timelineservice-hbase-tests.txt  [12K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-
> yarn-server_hadoop-yarn-server-router.txt  [456K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-
> yarn-applications_hadoop-yarn-applications-distributedshell.txt  [464K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-
> mapreduce-client-core.txt  [112K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-
> mapreduce-client-app.txt  [348K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-
> mapreduce-client-hs.txt  [564K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-
> mapreduce-client-jobclient.txt  [228K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-
> mapreduce-client-nativetask.txt  [12K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-tools_hadoop-distcp.txt  [32K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-tools_hadoop-archive-logs.txt  [16K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-tools_hadoop-aws.txt  [20K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-tools_hadoop-sls.txt  [12K]
>      https://builds.apache.org/job/hadoop-trunk-win/146/artifact/
> out/patch-unit-hadoop-tools_hadoop-azure-datalake.txt  [16K]
>
> Powered by Apache Yetus 0.6.0-SNAPSHOT   http://yetus.apache.org
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org<mailto:
> common-dev-unsubscribe@hadoop.apache.org>
> For additional commands, e-mail: common-dev-help@hadoop.apache.org<mailto:
> common-dev-help@hadoop.apache.org>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message