Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EF239104C6 for ; Mon, 8 Dec 2014 14:58:51 +0000 (UTC) Received: (qmail 2645 invoked by uid 500); 8 Dec 2014 14:58:40 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 2304 invoked by uid 500); 8 Dec 2014 14:58:40 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 2205 invoked by uid 99); 8 Dec 2014 14:58:40 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Dec 2014 14:58:40 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.160.172 as permitted sender) Received: from [209.85.160.172] (HELO mail-yk0-f172.google.com) (209.85.160.172) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Dec 2014 14:58:35 +0000 Received: by mail-yk0-f172.google.com with SMTP id 131so2301749ykp.3 for ; Mon, 08 Dec 2014 06:58:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=xQd+jLhe1kh+Xs/86jKOqdwicAHq/USZ0EvPpNkGRHs=; b=yX6kFXG0wcqEYSZpQ7Y7kJdKrW3Y9iqJdiQM+fq5dnI45Id47n3CPzNhE74vXVcdzm cCog+R6cF7R+Hd7kWtz7j+TFW3SHP9t60wACfU9jHTpRfUBXAegpEBZuN9Ik59DYgJhx 8CSr+SH7w8e6f3iNssUHHQD83/PdVX2Lw571CkFhbQI/zO2Zk1BFLtTn2BuqC5bPH5SJ 55rIgdEeq8WbbgecU3daqdMQHv/P5ZKP+z6guFZp9QvsKTUQwGYYJVZadYqd5Eb79GG9 7oy0tk/HbPcSUr4GO+dPN10Qesu1FSaH2Gt6xPsFN0KOczsjSb1iOk0zdSRivsVwBO/w qSpQ== MIME-Version: 1.0 X-Received: by 10.236.220.194 with SMTP id o62mr30335030yhp.32.1418050694765; Mon, 08 Dec 2014 06:58:14 -0800 (PST) Received: by 10.170.145.67 with HTTP; Mon, 8 Dec 2014 06:58:14 -0800 (PST) In-Reply-To: References: <29E398CA-871B-4AE4-953A-1B76DB4F75F5@hortonworks.com> Date: Mon, 8 Dec 2014 06:58:14 -0800 Message-ID: Subject: Re: Switching to Java 7 From: Ted Yu To: "common-dev@hadoop.apache.org" Cc: "mapreduce-dev@hadoop.apache.org" , "hdfs-dev@hadoop.apache.org" , "yarn-dev@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a11c22f9cef63110509b5a74f X-Virus-Checked: Checked by ClamAV on apache.org --001a11c22f9cef63110509b5a74f Content-Type: text/plain; charset=UTF-8 Looks like there was still OutOfMemoryError : https://builds.apache.org/job/Hadoop-Hdfs-trunk/1964/testReport/junit/org.apache.hadoop.hdfs.server.namenode.snapshot/TestRenameWithSnapshots/testRenameDirAcrossSnapshottableDirs/ FYI On Mon, Dec 8, 2014 at 2:42 AM, Steve Loughran wrote: > yes, bumped them up to > > export MAVEN_OPTS="-Xmx3072m -XX:MaxPermSize=768m" > export ANT_OPTS=$MAVEN_OPTS > > also extended test runs times. > > > > On 8 December 2014 at 00:58, Ted Yu wrote: > > > Looking at the test failures of > > https://builds.apache.org/job/Hadoop-Hdfs-trunk/1963/ which uses jdk > 1.7: > > > > e.g. > > > > > https://builds.apache.org/job/Hadoop-Hdfs-trunk/1963/testReport/junit/org.apache.hadoop.hdfs.server.namenode.snapshot/TestRenameWithSnapshots/testRenameFileAndDeleteSnapshot/ > > > > java.lang.OutOfMemoryError: Java heap space > > at > sun.nio.ch.EPollArrayWrapper.(EPollArrayWrapper.java:120) > > at sun.nio.ch.EPollSelectorImpl.(EPollSelectorImpl.java:68) > > at > > > sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:36) > > at > > io.netty.channel.nio.NioEventLoop.openSelector(NioEventLoop.java:126) > > at > io.netty.channel.nio.NioEventLoop.(NioEventLoop.java:120) > > at > > > io.netty.channel.nio.NioEventLoopGroup.newChild(NioEventLoopGroup.java:87) > > at > > > io.netty.util.concurrent.MultithreadEventExecutorGroup.(MultithreadEventExecutorGroup.java:64) > > > > > > Should more heap be given to the tests ? > > > > > > Cheers > > > > > > On Sun, Dec 7, 2014 at 2:09 PM, Steve Loughran > > wrote: > > > > > The latest migration status: > > > > > > if the jenkins builds are happy then the patch will go in -I do that > > > monday morning 10:00 UTC > > > > > > https://builds.apache.org/view/H-L/view/Hadoop/ > > > > > > Getting jenkins to work has been "surprisingly difficult"...it turns > out > > > that those builds which we thought were java7 or java8 weren't, as > > setting > > > export JAVA_HOME=${TOOLS_HOME}/java/latest > > > > > > meant that they picked up a java 6 machine > > > > > > Now the trunk precommit/postcommit and scheduled branches should have > > > export JAVA_HOME=${TOOLS_HOME}/java/jdk1.7.0_55 > > > > > > the Java 8 builds have more changes > > > > > > export JAVA_HOME=${TOOLS_HOME}/java/jdk1.8.0 > > > export MAVEN_OPTS="-Xmx3072m -XX:MaxPermSize=768m" > > > and -Dmaven.javadoc.skip=true on the mvn builds > > > > > > without these javadocs fails and test runs OOM. > > > > > > We need to have something resembling the nightly build env setup again, > > > git/Svn stored file with something for java8 alongside the normal env > > vars. > > > > > > -- > > > CONFIDENTIALITY NOTICE > > > NOTICE: This message is intended for the use of the individual or > entity > > to > > > which it is addressed and may contain information that is confidential, > > > privileged and exempt from disclosure under applicable law. If the > reader > > > of this message is not the intended recipient, you are hereby notified > > that > > > any printing, copying, dissemination, distribution, disclosure or > > > forwarding of this communication is strictly prohibited. If you have > > > received this communication in error, please contact the sender > > immediately > > > and delete it from your system. Thank You. > > > > > > > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. > --001a11c22f9cef63110509b5a74f--