hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Wang <andrew.w...@cloudera.com>
Subject Re: Best Linux version for hadoop development
Date Sat, 14 Jun 2014 05:40:41 GMT
This is probably https://issues.apache.org/jira/browse/HADOOP-10510

I'd like to fix this (since I wrote some of this code), but I've been
wholly unsuccessful in reproducing it myself. I'm also on Ubuntu 12.04, and
I've checked a few different JDK versions, so I'm really at a loss as to
why this happens. If you can spend time tracing it down, it'd really be
appreciated.

Thanks,
Andrew


On Fri, Jun 13, 2014 at 11:50 AM, Alexander Pivovarov <apivovarov@gmail.com>
wrote:

> I recommend CentOS 6.5 64-bit
> UI on Ubunty is slow.  CentOS uses old good Gnome 2.28.2
>
> I switched from Ubuntu to CentOS a year ago. Everything working fine. I
> like yum. Never had problem with finding packages. Never had packages
> conflict situation.
>
>
> On Fri, Jun 13, 2014 at 11:33 AM, Arpit Agarwal <aagarwal@hortonworks.com>
> wrote:
>
> > Can you please file a Jira and post the logs/stack traces?
> >
> > I cannot repro any of those test failures on either trunk or branch-2.4
> (on
> > Centos 6.5). Don't have an Ubuntu installation to verify.
> >
> > Thanks, Arpit
> >
> > On Fri, Jun 13, 2014 at 4:04 AM, Malcolm <malcolm.kavalsky@gmail.com>
> > wrote:
> >
> > > Running tests on hadoop 2.4, both native and java result in failures on
> > > Ubuntu 14.04.
> > >
> > > I understand that for patches to be accepted, the minimum criteria is
> > that
> > > all tests pass, however the vanilla release itself fails quite quickly.
> > >
> > > Is this a well known issue ?
> > >
> > > Should I be using a different Linux version.
> > >
> > > BTW, even on 2.2,  not all tests passed successfully ( on Ubuntu
> 12.04).
> > >
> > > Thanks,
> > > Malcolm
> > >
> > >
> > > Extract from the test log (running with -fae flag to keep going):
> > >
> > > Failed tests:
> > >   TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToFile:244
> > null
> > >   TestSymlinkLocalFSFileContext>SymlinkBaseTest.testStatLinkToDir:286
> > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301
> > > null
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDirectory:627
> > > null
> > >
> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkViaLink:679
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkViaSymlink:897
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063
> > > null
> > >   TestSymlinkLocalFSFileContext>SymlinkBaseTest.testRenameSymlink:1134
> > null
> > >   TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToFile:244
> > null
> > >   TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testStatLinkToDir:286
> null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingRelPaths:447->SymlinkBaseTest.checkLink:381
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingAbsPaths:472->SymlinkBaseTest.checkLink:381
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkUsingFullyQualPaths:503->SymlinkBaseTest.checkLink:381
> > > null
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDirectory:627
> > > null
> > >
> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkViaLink:679
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkViaSymlink:897
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkNonExistantDest:1036
> > > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlinkToExistingFile:1063
> > > null
> > >   TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testRenameSymlink:1134
> > null
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testStatDanglingLink:115->SymlinkBaseTest.testStatDanglingLink:301
> > > null
> > >
> > > Tests in error:
> > >
> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testDanglingLink:163 »
> > > IO Pat...
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201
> > > » IO
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileContext>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822
> > > » IO
> > >   TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testDanglingLink:163
> »
> > IO
> > > Path...
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>TestSymlinkLocalFS.testGetLinkStatusPartQualTarget:201
> > > » IO
> > >
> > >
> > >
> >
> TestSymlinkLocalFSFileSystem>SymlinkBaseTest.testCreateLinkToDotDotPrefix:822
> > > » IO
> > >
> > > Tests run: 2285, Failures: 24, Errors: 6, Skipped: 41
> > > [INFO] Apache Hadoop Main ................................ SUCCESS
> > [0.266s]
> > > [INFO] Apache Hadoop Project POM ......................... SUCCESS
> > [0.402s]
> > > [INFO] Apache Hadoop Annotations ......................... SUCCESS
> > [0.462s]
> > > [INFO] Apache Hadoop Project Dist POM .................... SUCCESS
> > [0.123s]
> > > [INFO] Apache Hadoop Assemblies .......................... SUCCESS
> > [0.124s]
> > > [INFO] Apache Hadoop Maven Plugins ....................... SUCCESS
> > [1.263s]
> > > [INFO] Apache Hadoop MiniKDC ............................. SUCCESS
> > > [50.558s]
> > > [INFO] Apache Hadoop Auth ................................ SUCCESS
> > > [4:39.256s]
> > > [INFO] Apache Hadoop Auth Examples ....................... SUCCESS
> > [0.106s]
> > > [INFO] Apache Hadoop Common .............................. FAILURE
> > > [13:57.764s]
> > > [INFO] Apache Hadoop NFS ................................. SKIPPED
> > > [INFO] Apache Hadoop Common Project ...................... SUCCESS
> > [0.026s]
> > > [INFO] Apache Hadoop HDFS ................................ SKIPPED
> > > [INFO] Apache Hadoop HttpFS .............................. SKIPPED
> > > [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED
> > > [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED
> > > [INFO] Apache Hadoop HDFS Project ........................ SUCCESS
> > [0.027s]
> > > [INFO] hadoop-yarn ....................................... SUCCESS
> > [0.027s]
> > > [INFO] hadoop-yarn-api ................................... SKIPPED
> > > [INFO] hadoop-yarn-common ................................ SKIPPED
> > > [INFO] hadoop-yarn-server ................................ SUCCESS
> > [0.026s]
> > > [INFO] hadoop-yarn-server-common ......................... SKIPPED
> > > [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
> > > [INFO] hadoop-yarn-server-web-proxy ...................... SKIPPED
> > > [INFO] hadoop-yarn-server-applicationhistoryservice ...... SKIPPED
> > > [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
> > > [INFO] hadoop-yarn-server-tests .......................... SKIPPED
> > > [INFO] hadoop-yarn-client ................................ SKIPPED
> > > [INFO] hadoop-yarn-applications .......................... SUCCESS
> > [0.027s]
> > > [INFO] hadoop-yarn-applications-distributedshell ......... SKIPPED
> > > [INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SKIPPED
> > > [INFO] hadoop-yarn-site .................................. SUCCESS
> > [0.026s]
> > > [INFO] hadoop-yarn-project ............................... SKIPPED
> > > [INFO] hadoop-mapreduce-client ........................... SKIPPED
> > > [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
> > > [INFO] hadoop-mapreduce-client-common .................... SKIPPED
> > > [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
> > > [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
> > > [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> > > [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> > > [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> > > [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> > > [INFO] hadoop-mapreduce .................................. SKIPPED
> > > [INFO] Apache Hadoop MapReduce Streaming ................. SKIPPED
> > > [INFO] Apache Hadoop Distributed Copy .................... SKIPPED
> > > [INFO] Apache Hadoop Archives ............................ SKIPPED
> > > [INFO] Apache Hadoop Rumen ............................... SKIPPED
> > > [INFO] Apache Hadoop Gridmix ............................. SKIPPED
> > > [INFO] Apache Hadoop Data Join ........................... SKIPPED
> > > [INFO] Apache Hadoop Extras .............................. SKIPPED
> > > [INFO] Apache Hadoop Pipes ............................... SUCCESS
> > [0.024s]
> > > [INFO] Apache Hadoop OpenStack support ................... SKIPPED
> > > [INFO] Apache Hadoop Client .............................. SKIPPED
> > > [INFO] Apache Hadoop Mini-Cluster ........................ SKIPPED
> > > [INFO] Apache Hadoop Scheduler Load Simulator ............ SKIPPED
> > > [INFO] Apache Hadoop Tools Dist .......................... SKIPPED
> > > [INFO] Apache Hadoop Tools ............................... SUCCESS
> > [0.024s]
> > > [INFO] Apache Hadoop Distribution ........................ SKIPPED
> > > [INFO]
> > >
> ------------------------------------------------------------------------
> > > [INFO] BUILD FAILURE
> > > [INFO]
> > >
> ------------------------------------------------------------------------
> > > [INFO] Total time: 19:32.423s
> > > [INFO] Finished at: Thu Jun 12 21:20:25 IDT 2014
> > > [INFO] Final Memory: 36M/345M
> > > [INFO]
> > >
> ------------------------------------------------------------------------
> > >
> > > T
> > >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message