Return-Path: X-Original-To: apmail-drill-dev-archive@www.apache.org Delivered-To: apmail-drill-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C2EDC1889E for ; Tue, 10 Nov 2015 00:13:30 +0000 (UTC) Received: (qmail 11234 invoked by uid 500); 10 Nov 2015 00:13:30 -0000 Delivered-To: apmail-drill-dev-archive@drill.apache.org Received: (qmail 11178 invoked by uid 500); 10 Nov 2015 00:13:30 -0000 Mailing-List: contact dev-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list dev@drill.apache.org Received: (qmail 11162 invoked by uid 99); 10 Nov 2015 00:13:30 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Nov 2015 00:13:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id B06AF1A0CF1 for ; Tue, 10 Nov 2015 00:13:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.901 X-Spam-Level: ** X-Spam-Status: No, score=2.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id Ci3mZ5VA8vnh for ; Tue, 10 Nov 2015 00:13:15 +0000 (UTC) Received: from mail-io0-f169.google.com (mail-io0-f169.google.com [209.85.223.169]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id D96AC2303F for ; Tue, 10 Nov 2015 00:13:14 +0000 (UTC) Received: by iody8 with SMTP id y8so203567963iod.1 for ; Mon, 09 Nov 2015 16:13:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=lOr3I2uc35EtRTBu4jNNIrJNYFZumImmya2FOi1PAA0=; b=jABwePw7QaeIkvbWieCr5NjZRh0naYGYQbTybk9a489OjVudspHR/SAjzAsqbbrwv2 X1eKuoMGnPN+hGk1W/dV1+NhNSqc6YnuvTV5gFW3J3LkaodOtoD+/M+mKnjiPJdJqmKh /s0UUdgu0VatannCrUnGVD4QxXu9jrLBgbqtU6dJ5y0xbNXGxWTrGhBEtnPBAjRKVbq3 26TQJamQp+l7ScskXEk5aIPWkNQZBhbRlfuYwMsfBlcwZEOYoodB0ui8ohhJEc65CUR0 8BcxvkK5ruD2hgX/wPUMhpsx5Lrkq2gzv1va6/GImsVKIo+NurrPfJFpRxFwIgbDiQ5y xBpA== MIME-Version: 1.0 X-Received: by 10.107.129.144 with SMTP id l16mr1087121ioi.174.1447114394128; Mon, 09 Nov 2015 16:13:14 -0800 (PST) Received: by 10.79.13.81 with HTTP; Mon, 9 Nov 2015 16:13:13 -0800 (PST) In-Reply-To: References: Date: Mon, 9 Nov 2015 16:13:13 -0800 Message-ID: Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1) From: Amit Hadke To: dev@drill.apache.org Content-Type: multipart/alternative; boundary=001a113f9bcc69579605242493a3 --001a113f9bcc69579605242493a3 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Unfortunately, yes I changed them at OS level. I agree that making OS level changes to run tests is not something we should advocate. It was just an observation that tests seem to pass on linux with default settings but on mac behavior is irregular. ~ Amit. On Mon, Nov 9, 2015 at 3:48 PM, Jason Altekruse wrote: > Amit, > > Did you change these at the OS level? I would hope that we wouldn't have = to > make people jump through such hoops to run the build, was there a thread = I > missed where we discussed this something that we should be expecting > everyone to do? I did see the threads about increasing the maven permgen > and did so accordingly, but I think adjusting something like the system > ulimit is something we really should try to avoid. > > On Mon, Nov 9, 2015 at 3:44 PM, Abdel Hakim Deneche > > wrote: > > > I just tried with the default forkCount and got similar failures. I'm > > running the tests on a linux machine with the default maven options > > > > Thanks > > > > On Mon, Nov 9, 2015 at 3:21 PM, Jacques Nadeau > wrote: > > > > > So you're changing the forkCount from the default? What happens when > you > > > run with the default? > > > > > > Also, did you guys run with extra permgen or the default? Also, can y= ou > > > confirm what type of machine you are running on? > > > > > > Want to figure out why things are different. > > > > > > thanks, > > > Jacques > > > > > > -- > > > Jacques Nadeau > > > CTO and Co-Founder, Dremio > > > > > > On Mon, Nov 9, 2015 at 2:23 PM, Abdel Hakim Deneche < > > adeneche@maprtech.com > > > > > > > wrote: > > > > > > > Saw similar failures when running unit tests with forkCount =3D 1: > > > > > > > > Tests in error: > > > > > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView =C2=BB > > > > > UserRemote > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMa= xUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:2= 36->BaseTestQuery.updateClient:213 > > > > > =C2=BB Rpc > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:21= 9->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTest= Query.updateClient:213 > > > > > =C2=BB IllegalState > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestIm= personation.createView:186->BaseTestQuery.updateClient:222->BaseTestQuery.u= pdateClient:236->BaseTestQuery.updateClient:213 > > > > > =C2=BB IllegalState > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:= 186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTe= stQuery.updateClient:213 > > > > > =C2=BB IllegalState > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->B= aseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTestQuer= y.updateClient:213 > > > > > =C2=BB IllegalState > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:21= 0->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient:236->BaseTest= Query.updateClient:213 > > > > > =C2=BB IllegalState > > > > > TestCountDownLatchInjection.latchInjected:146 NullPointer > > > > > TestMergingReceiver.testMultipleProvidersMixedSizes:115 =C2=BB > > > > > IllegalReferenceCount > > > > > Tests run: 1482, Failures: 0, Errors: 9, Skipped: 118 > > > > > > > > > > > > Unfortunately I'm changing my vote to -1 > > > > > > > > > > > > On Mon, Nov 9, 2015 at 2:21 PM, Hanifi Gunes > > > wrote: > > > > > > > > > -1 (binding) > > > > > > > > > > 5/5 consecutive runs I get the following consistently with > forkCount > > > set > > > > to > > > > > 1 on build. > > > > > > > > > > Tests in error: > > > > > > TestImpersonationQueries.sequenceFileChainedImpersonationWithView =C2=BB > > > > > UserRemote > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testMultiLevelImpersonationJoinEachSideReachesMa= xUserHops:233->BaseTestQuery.updateClient:222->BaseTestQuery. > > > > > updateClient:236->BaseTestQuery.updateClient:213 =C2=BB Illega= lState > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testMultiLevelImpersonationExceedsMaxUserHops:21= 9->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient: > > > > > 236->BaseTestQuery.updateClient:213 =C2=BB IllegalState > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.avroChainedImpersonationWithView:280->BaseTestIm= personation.createView:186->BaseTestQuery.updateClient:222- > > > > > > >BaseTestQuery.updateClient:236->BaseTestQuery.updateClient:213 > > =C2=BB > > > > > IllegalState > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testDirectImpersonation_HasGroupReadPermissions:= 186->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient: > > > > > 236->BaseTestQuery.updateClient:213 =C2=BB IllegalState > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testDirectImpersonation_NoReadPermissions:196->B= aseTestQuery.updateClient:222->BaseTestQuery.updateClient:236- > > > > > >BaseTestQuery.updateClient:213 =C2=BB IllegalState > > > > > > > > > > > > > > > > > > > > TestImpersonationQueries.testMultiLevelImpersonationEqualToMaxUserHops:21= 0->BaseTestQuery.updateClient:222->BaseTestQuery.updateClient: > > > > > 236->BaseTestQuery.updateClient:213 =C2=BB IllegalState > > > > > > > > > > > > > > > On Mon, Nov 9, 2015 at 2:19 PM, Stef=C3=A1n Baxter < > > > stefan@activitystream.com > > > > > > > > > > wrote: > > > > > > > > > > > Hi, > > > > > > > > > > > > I'm not a committer and not voting but I want to point out that > the > > > > UDFs > > > > > > that we are using and run with 1.1 and 1.2 do not, for some > reason, > > > run > > > > > > with 1.3. > > > > > > > > > > > > I'm inclined to insist that it's something we are doing wrong b= ut > > if > > > > this > > > > > > counts as a test then it's failing. > > > > > > > > > > > > Regards, > > > > > > -Stefan > > > > > > > > > > > > On Mon, Nov 9, 2015 at 10:09 PM, Norris Lee > > > wrote: > > > > > > > > > > > > > +1 Non-binding. > > > > > > > > > > > > > > Built from source on Linux, tested ODBC against various data > > > sources > > > > > > > (Hive, DFS-csv, tsv, parquet, json) > > > > > > > > > > > > > > Norris > > > > > > > > > > > > > > -----Original Message----- > > > > > > > From: Abdel Hakim Deneche [mailto:adeneche@maprtech.com] > > > > > > > Sent: Monday, November 09, 2015 10:16 AM > > > > > > > To: dev@drill.apache.org > > > > > > > Subject: Re: [VOTE] Release Apache Drill 1.3.0 (rc1) > > > > > > > > > > > > > > +1 > > > > > > > > > > > > > > Checked checksum files and gpg signature for all 3 files. Bui= lt > > > from > > > > > > > source, deployed on a 4 nodes cluster then run several window > > > > function > > > > > > > queries on TPCDS SF100. Looks great. > > > > > > > > > > > > > > On Mon, Nov 9, 2015 at 8:14 AM, Jacques Nadeau < > > jacques@dremio.com > > > > > > > > > > wrote: > > > > > > > > > > > > > > > I've seen another instance of DRILL-4041. Since it is > > exceedingly > > > > > > > > rare, I don't think it is a release stopper. I will spend > some > > > more > > > > > > > > time reviewing it. > > > > > > > > > > > > > > > > -- > > > > > > > > Jacques Nadeau > > > > > > > > CTO and Co-Founder, Dremio > > > > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 7:34 PM, Amit Hadke < > > amit.hadke@gmail.com > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > +1, non-binding > > > > > > > > > Downloaded tarball, mvn clean install Ran join queries,, > was > > > able > > > > > to > > > > > > > > > run queries on json, parquet and sequence files. > > > > > > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 10:01 AM, Abhijit Pol < > > > abhijit@dremio.com > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > resending the vote with details > > > > > > > > > > > > > > > > > > > > +1, non-binding > > > > > > > > > > > > > > > > > > > > ran maven tests, installed on Mac, ran drill in embedde= d > > > mode, > > > > > > > > > > verified > > > > > > > > > Web > > > > > > > > > > UI for CSV header config changes, ran few queries on CS= V > > > files > > > > > > > > > > with and without header, ran few queries against large > CSV > > > > files > > > > > > > > > > with header in > > > > > > > > > HDFS > > > > > > > > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 9:07 AM, Hsuan Yi Chu < > > > > > hyichu@maprtech.com> > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > +1 > > > > > > > > > > > mvn clean install on mac and linux > > > > > > > > > > > > > > > > > > > > > > tried a few queries on distributed mode. > > > > > > > > > > > > > > > > > > > > > > Things looked fine > > > > > > > > > > > > > > > > > > > > > > On Sun, Nov 8, 2015 at 8:16 AM, Aman Sinha < > > > > > asinha@maprtech.com> > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > +1. > > > > > > > > > > > > Downloaded the binary tar ball and installed on Mac= . > > Ran > > > > > > > > > > > > Drill in > > > > > > > > > > > embedded > > > > > > > > > > > > mode. Tested a few join, aggregation and limit > queries > > > > > > > > > > > > against > > > > > > > > > parquet > > > > > > > > > > > > data with and without metadata cache. Tested > > > cancellation > > > > > for > > > > > > > > couple > > > > > > > > > > of > > > > > > > > > > > > queries. Looked at query profiles on the WebUI. > > Looks > > > > > good. > > > > > > > > > > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 11:53 PM, Abhijit Pol > > > > > > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > +1 > > > > > > > > > > > > > > > > > > > > > > > > > > On Sat, Nov 7, 2015 at 9:41 PM, andrew < > > > > andrew@primer.org> > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > +1 (non-binding, non-comitter) > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Nov 6, 2015, at 10:15 PM, Jacques Nadeau < > > > > > > > > > jacques@dremio.com> > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hey Everybody, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > I'd like to propose a new release candidate o= f > > > Apache > > > > > > > > > > > > > > > Drill, > > > > > > > > > > > version > > > > > > > > > > > > > > > 1.3.0. This is the second release candidate > > (rc1). > > > > > > > > > > > > > > > This > > > > > > > > > > addresses > > > > > > > > > > > > > some > > > > > > > > > > > > > > > issues identified in the first release > candidate > > > > > > > > > > > > > > > including > > > > > > > > some > > > > > > > > > > > test > > > > > > > > > > > > > > > threading issues, Parquet dictionary read iss= ue > > > with > > > > > > > > > > > > > > > binary > > > > > > > > > > values, > > > > > > > > > > > > > Joda > > > > > > > > > > > > > > > upgrade to avoid a concurrency bug and a coup= le > > > other > > > > > > > > > > > > > > > small > > > > > > > > > > things. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > The tarball artifacts are hosted at [2] and t= he > > > maven > > > > > > > > artifacts > > > > > > > > > > are > > > > > > > > > > > > > > hosted > > > > > > > > > > > > > > > at [3]. This release candidate is based on > commit > > > > > > > > > > > > > > > f17ebd2fbf2bf5ba201a635f5b6ec3615afe2305 > located > > at > > > > > [4]. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > The vote will be open for 72 hours ending at > 10PM > > > > > > > > > > > > > > > Pacific, > > > > > > > > > > November > > > > > > > > > > > > 9, > > > > > > > > > > > > > > 2015. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > [ ] +1 > > > > > > > > > > > > > > > [ ] +0 > > > > > > > > > > > > > > > [ ] -1 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > thanks, > > > > > > > > > > > > > > > Jacques > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > [1] > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=3D1231= 3 > > > > > > > > 820&version=3D12332946[2] > > > > > > > > > > > > > > > > > > > > http://people.apache.org/~jacques/apache-drill-1.3.0.rc1 > > > > > > > > > > > > > > > / > > > > > > > > > > > > > > > [3] > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://repository.apache.org/content/repositories/orgapachedrill-1014 > > > > > > > > / > > > > > > > > > > > > > > > [4] > > > > > > > > > > > > > > > > > > > > https://github.com/jacques-n/drill/tree/drill-1.3.0-rc1 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > > Jacques Nadeau > > > > > > > > > > > > > > > CTO and Co-Founder, Dremio > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > Abdelhakim Deneche > > > > > > > > > > > > > > Software Engineer > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Now Available - Free Hadoop On-Demand Training < > > > > > > > > > > > > > > > > > > > > > > > > > > > > http://www.mapr.com/training?utm_source=3DEmail&utm_medium=3DSignature&ut= m_campaign=3DFree%20available > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > Abdelhakim Deneche > > > > > > > > Software Engineer > > > > > > > > > > > > > > > > > > > > Now Available - Free Hadoop On-Demand Training > > > > < > > > > > > > > > > http://www.mapr.com/training?utm_source=3DEmail&utm_medium=3DSignature&ut= m_campaign=3DFree%20available > > > > > > > > > > > > > > > > > > > > -- > > > > Abdelhakim Deneche > > > > Software Engineer > > > > > > > > > > Now Available - Free Hadoop On-Demand Training > > < > > > http://www.mapr.com/training?utm_source=3DEmail&utm_medium=3DSignature&ut= m_campaign=3DFree%20available > > > > > > --001a113f9bcc69579605242493a3--