Return-Path: X-Original-To: apmail-spark-dev-archive@minotaur.apache.org Delivered-To: apmail-spark-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B08AC1923C for ; Mon, 4 Apr 2016 13:58:42 +0000 (UTC) Received: (qmail 38601 invoked by uid 500); 4 Apr 2016 13:58:38 -0000 Delivered-To: apmail-spark-dev-archive@spark.apache.org Received: (qmail 38499 invoked by uid 500); 4 Apr 2016 13:58:38 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 38487 invoked by uid 99); 4 Apr 2016 13:58:37 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2016 13:58:37 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 329B3C7771 for ; Mon, 4 Apr 2016 13:58:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id vvshYi13zo3t for ; Mon, 4 Apr 2016 13:58:35 +0000 (UTC) Received: from mail-ob0-f169.google.com (mail-ob0-f169.google.com [209.85.214.169]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 9F1085FBE8 for ; Mon, 4 Apr 2016 13:58:34 +0000 (UTC) Received: by mail-ob0-f169.google.com with SMTP id bg3so33609109obb.1 for ; Mon, 04 Apr 2016 06:58:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=/Rkm9vnj8DQUzozKF2zOeHbCiLzrg/QcIPMt/lD6Ob0=; b=UXoRhRdIdAyDarDDzc1ofzUONvm5PFX7jNP+xtVouXwwkl4Ofsnk7VAkBp6iIRZHVI r9bwyfvIYE7JFMWEmR3jtL5GlL/twT3hAB5FS0d9/aAQasJ0svT1yPg3RkXPGHiXtwU9 shgbaVdDdKY+ewSK97Go2UuU/bRzLyKKTQ4Nf3yQNOeKMkWjzMkC+b9HT2sYJUkvpJ2T hiD4XMZ2CrN1oOo67wz1NmWuQbdIlIatDfRlcN+5xVCdHWrPZGAXkzqApLq6QzGCy7z3 mMl2ZH/+CFH0Jzr8+ltHPysIeJAl6+iVftLZajOmU5pTLllr7crWOboP8mDLzMOoq7Qk J1Eg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=/Rkm9vnj8DQUzozKF2zOeHbCiLzrg/QcIPMt/lD6Ob0=; b=g3QubKASgFafSvu1mRB9UUrG91dPVKKUNAvYhobDQ62JQFvY0qp7IEz5dNUEpefdPA kvBrx+JAuLZVWrdeA1Q4f25Mc4QE6t1UctYG1076S4nlgpQujO7jLPwPT34G9m+Tjx5I lXKW6ei83vpVBii/6z5tlKus9ZHXusPYwNPguJHvfg432L3DQ/Xa+GwDW4d8EUUbU4LD w+quLyJSMXH+6XQHUXmLKRWKO21WuF2BPyZgOMA9G+u+kFsneJJLt2Y9U5NRVt9YSoYI JqPCoGfwAU36E8MbLXS42g9w6jiieLkEy26WkfemmSUhyvkaRZmq8Ful81HmC3W6eeTs Xf5w== X-Gm-Message-State: AD7BkJIAYUYXBygs7P2ry7wR69eUkZJ3jNuxQCz2ArfIdzHrIIEPYLlV2cxxEywuuyY4gVCgrri+sBtxyAkE5w== X-Received: by 10.60.94.41 with SMTP id cz9mr10426123oeb.18.1459778313522; Mon, 04 Apr 2016 06:58:33 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Nicholas Chammas Date: Mon, 04 Apr 2016 13:58:23 +0000 Message-ID: Subject: Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt? To: Michael Armbrust Cc: Jakob Odersky , Ted Yu , "dev@spark.apache.org" , Patrick Wendell Content-Type: multipart/alternative; boundary=089e011848aed4158c052fa91f84 --089e011848aed4158c052fa91f84 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable This is still an issue. The Spark 1.6.1 packages on S3 are corrupt. Is anyone looking into this issue? Is there anything contributors can do to help solve this problem? Nick On Sun, Mar 27, 2016 at 8:49 PM Nicholas Chammas wrote: > Pingity-ping-pong since this is still a problem. > > > On Thu, Mar 24, 2016 at 4:08 PM Michael Armbrust > wrote: > >> Patrick is investigating. >> >> On Thu, Mar 24, 2016 at 7:25 AM, Nicholas Chammas < >> nicholas.chammas@gmail.com> wrote: >> >>> Just checking in on this again as the builds on S3 are still broken. :/ >>> >>> Could it have something to do with us moving release-build.sh >>> >>> ? >>> =E2=80=8B >>> >>> On Mon, Mar 21, 2016 at 1:43 PM Nicholas Chammas < >>> nicholas.chammas@gmail.com> wrote: >>> >>>> Is someone going to retry fixing these packages? It's still a problem. >>>> >>>> Also, it would be good to understand why this is happening. >>>> >>>> On Fri, Mar 18, 2016 at 6:49 PM Jakob Odersky >>>> wrote: >>>> >>>>> I just realized you're using a different download site. Sorry for the >>>>> confusion, the link I get for a direct download of Spark 1.6.1 / >>>>> Hadoop 2.6 is >>>>> http://d3kbcqa49mib13.cloudfront.net/spark-1.6.1-bin-hadoop2.6.tgz >>>>> >>>>> On Fri, Mar 18, 2016 at 3:20 PM, Nicholas Chammas >>>>> wrote: >>>>> > I just retried the Spark 1.6.1 / Hadoop 2.6 download and got a >>>>> corrupt ZIP >>>>> > file. >>>>> > >>>>> > Jakob, are you sure the ZIP unpacks correctly for you? Is it the >>>>> same Spark >>>>> > 1.6.1/Hadoop 2.6 package you had a success with? >>>>> > >>>>> > On Fri, Mar 18, 2016 at 6:11 PM Jakob Odersky >>>>> wrote: >>>>> >> >>>>> >> I just experienced the issue, however retrying the download a seco= nd >>>>> >> time worked. Could it be that there is some load balancer/cache in >>>>> >> front of the archive and some nodes still serve the corrupt >>>>> packages? >>>>> >> >>>>> >> On Fri, Mar 18, 2016 at 8:00 AM, Nicholas Chammas >>>>> >> wrote: >>>>> >> > I'm seeing the same. :( >>>>> >> > >>>>> >> > On Fri, Mar 18, 2016 at 10:57 AM Ted Yu >>>>> wrote: >>>>> >> >> >>>>> >> >> I tried again this morning : >>>>> >> >> >>>>> >> >> $ wget >>>>> >> >> >>>>> >> >> >>>>> https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoo= p2.6.tgz >>>>> >> >> --2016-03-18 07:55:30-- >>>>> >> >> >>>>> >> >> >>>>> https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoo= p2.6.tgz >>>>> >> >> Resolving s3.amazonaws.com... 54.231.19.163 >>>>> >> >> ... >>>>> >> >> $ tar zxf spark-1.6.1-bin-hadoop2.6.tgz >>>>> >> >> >>>>> >> >> gzip: stdin: unexpected end of file >>>>> >> >> tar: Unexpected EOF in archive >>>>> >> >> tar: Unexpected EOF in archive >>>>> >> >> tar: Error is not recoverable: exiting now >>>>> >> >> >>>>> >> >> On Thu, Mar 17, 2016 at 8:57 AM, Michael Armbrust >>>>> >> >> >>>>> >> >> wrote: >>>>> >> >>> >>>>> >> >>> Patrick reuploaded the artifacts, so it should be fixed now. >>>>> >> >>> >>>>> >> >>> On Mar 16, 2016 5:48 PM, "Nicholas Chammas" >>>>> >> >>> >>>>> >> >>> wrote: >>>>> >> >>>> >>>>> >> >>>> Looks like the other packages may also be corrupt. I=E2=80=99= m getting >>>>> the >>>>> >> >>>> same >>>>> >> >>>> error for the Spark 1.6.1 / Hadoop 2.4 package. >>>>> >> >>>> >>>>> >> >>>> >>>>> >> >>>> >>>>> >> >>>> >>>>> https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoo= p2.4.tgz >>>>> >> >>>> >>>>> >> >>>> Nick >>>>> >> >>>> >>>>> >> >>>> >>>>> >> >>>> On Wed, Mar 16, 2016 at 8:28 PM Ted Yu >>>>> wrote: >>>>> >> >>>>> >>>>> >> >>>>> On Linux, I got: >>>>> >> >>>>> >>>>> >> >>>>> $ tar zxf spark-1.6.1-bin-hadoop2.6.tgz >>>>> >> >>>>> >>>>> >> >>>>> gzip: stdin: unexpected end of file >>>>> >> >>>>> tar: Unexpected EOF in archive >>>>> >> >>>>> tar: Unexpected EOF in archive >>>>> >> >>>>> tar: Error is not recoverable: exiting now >>>>> >> >>>>> >>>>> >> >>>>> On Wed, Mar 16, 2016 at 5:15 PM, Nicholas Chammas >>>>> >> >>>>> wrote: >>>>> >> >>>>>> >>>>> >> >>>>>> >>>>> >> >>>>>> >>>>> >> >>>>>> >>>>> https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoo= p2.6.tgz >>>>> >> >>>>>> >>>>> >> >>>>>> Does anyone else have trouble unzipping this? How did this >>>>> happen? >>>>> >> >>>>>> >>>>> >> >>>>>> What I get is: >>>>> >> >>>>>> >>>>> >> >>>>>> $ gzip -t spark-1.6.1-bin-hadoop2.6.tgz >>>>> >> >>>>>> gzip: spark-1.6.1-bin-hadoop2.6.tgz: unexpected end of file >>>>> >> >>>>>> gzip: spark-1.6.1-bin-hadoop2.6.tgz: uncompress failed >>>>> >> >>>>>> >>>>> >> >>>>>> Seems like a strange type of problem to come across. >>>>> >> >>>>>> >>>>> >> >>>>>> Nick >>>>> >> >>>>> >>>>> >> >>>>> >>>>> >> >> >>>>> >> > >>>>> >>>> >> --089e011848aed4158c052fa91f84 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
This is still an issue. The Spark 1.6.1 packages on S3 are= corrupt.

Is anyone looking into this issue? Is there an= ything contributors can do to help solve this problem?

=
Nick

On Sun= , Mar 27, 2016 at 8:49 PM Nicholas Chammas <nicholas.chammas@gmail.com> wrote:
Pingity-ping-pong since this is s= till a problem.


On Thu, Mar 24, 2016 at 4:08 PM Michael Armbrust <michael@databricks.com= > wrote:
Pa= trick is investigating.

On Thu, Mar 24, 2016 at 7:25 AM, Nicholas Chammas <ni= cholas.chammas@gmail.com> wrote:

Jus= t checking in on this again as the builds on S3 are still broken. :/

Could it have something to do w= ith us moving releas= e-build.sh?

=E2=80=8B

O= n Mon, Mar 21, 2016 at 1:43 PM Nicholas Chammas <nicholas.chammas@gmail.com>= wrote:
Is someone= going to retry fixing these packages? It's still a problem.

Also, it would be good to understand why this is happening.
<= /div>
On Fri, Mar 18, 2016 a= t 6:49 PM Jakob Odersky <jakob@odersky.com> wrote:
I just realized you're using a different download site. Sorry for= the
confusion, the link I get for a direct download of Spark 1.6.1 /
Hadoop 2.6 is http://d3kbcqa49mib1= 3.cloudfront.net/spark-1.6.1-bin-hadoop2.6.tgz

On Fri, Mar 18, 2016 at 3:20 PM, Nicholas Chammas
<nichola= s.chammas@gmail.com> wrote:
> I just retried the Spark 1.6.1 / Hadoop 2.6 download and got a corrupt= ZIP
> file.
>
> Jakob, are you sure the ZIP unpacks correctly for you? Is it the same = Spark
> 1.6.1/Hadoop 2.6 package you had a success with?
>
> On Fri, Mar 18, 2016 at 6:11 PM Jakob Odersky <jakob@odersky.com> wrote:
>>
>> I just experienced the issue, however retrying the download a seco= nd
>> time worked. Could it be that there is some load balancer/cache in=
>> front of the archive and some nodes still serve the corrupt packag= es?
>>
>> On Fri, Mar 18, 2016 at 8:00 AM, Nicholas Chammas
>> <nicholas.chammas@gmail.com> wrote:
>> > I'm seeing the same. :(
>> >
>> > On Fri, Mar 18, 2016 at 10:57 AM Ted Yu <yuzhihong@gmail.com> wrote:<= br> >> >>
>> >> I tried again this morning :
>> >>
>> >> $ wget
>> >>
>> >> https= ://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoop2.6.tgz
>> >> --2016-03-18 07:55:30--
>> >>
>> >> https= ://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoop2.6.tgz
>> >> Resolving s3.amazonaws.com... 54.231.19.163
>> >> ...
>> >> $ tar zxf spark-1.6.1-bin-hadoop2.6.tgz
>> >>
>> >> gzip: stdin: unexpected end of file
>> >> tar: Unexpected EOF in archive
>> >> tar: Unexpected EOF in archive
>> >> tar: Error is not recoverable: exiting now
>> >>
>> >> On Thu, Mar 17, 2016 at 8:57 AM, Michael Armbrust
>> >> <michael@databricks.com>
>> >> wrote:
>> >>>
>> >>> Patrick reuploaded the artifacts, so it should be fix= ed now.
>> >>>
>> >>> On Mar 16, 2016 5:48 PM, "Nicholas Chammas"=
>> >>> <nicholas.chammas@gmail.com>
>> >>> wrote:
>> >>>>
>> >>>> Looks like the other packages may also be corrupt= . I=E2=80=99m getting the
>> >>>> same
>> >>>> error for the Spark 1.6.1 / Hadoop 2.4 package. >> >>>>
>> >>>>
>> >>>>
>> >>>> https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoop2.= 4.tgz
>> >>>>
>> >>>> Nick
>> >>>>
>> >>>>
>> >>>> On Wed, Mar 16, 2016 at 8:28 PM Ted Yu <yuzhihong@gmail.com&= gt; wrote:
>> >>>>>
>> >>>>> On Linux, I got:
>> >>>>>
>> >>>>> $ tar zxf spark-1.6.1-bin-hadoop2.6.tgz
>> >>>>>
>> >>>>> gzip: stdin: unexpected end of file
>> >>>>> tar: Unexpected EOF in archive
>> >>>>> tar: Unexpected EOF in archive
>> >>>>> tar: Error is not recoverable: exiting now >> >>>>>
>> >>>>> On Wed, Mar 16, 2016 at 5:15 PM, Nicholas Cha= mmas
>> >>>>> <nicholas.chammas@gmail.com> wrote:
>> >>>>>>
>> >>>>>>
>> >>>>>>
>> >>>>>> https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin= -hadoop2.6.tgz
>> >>>>>>
>> >>>>>> Does anyone else have trouble unzipping t= his? How did this happen?
>> >>>>>>
>> >>>>>> What I get is:
>> >>>>>>
>> >>>>>> $ gzip -t spark-1.6.1-bin-hadoop2.6.tgz >> >>>>>> gzip: spark-1.6.1-bin-hadoop2.6.tgz: unex= pected end of file
>> >>>>>> gzip: spark-1.6.1-bin-hadoop2.6.tgz: unco= mpress failed
>> >>>>>>
>> >>>>>> Seems like a strange type of problem to c= ome across.
>> >>>>>>
>> >>>>>> Nick
>> >>>>>
>> >>>>>
>> >>
>> >

--089e011848aed4158c052fa91f84--