Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAOmV22vdGn5jhVnmXOXoBLN07O+JQcTXrvNZnJvyARJ_rPVu1w@mail.gmail.com>
References: 
 <CAHfHakGh=MZDwip5xGyfJcxh-xEih0p74Mt_C72+UGTS6004Hg@mail.gmail.com>
	<CADx-ob0AzpevE77jEDL=114eP-MxXke6uhrFXKfpGTTQB+EOpw@mail.gmail.com>
	<CAOmV22scHhhpbhuZRPRqay=8k4tN+==GBHgzMjnV8PzqVbqrSQ@mail.gmail.com>
	<CAOmV22v1STyuRvdJQcqG7koLwqQrgrPRx4xHpCQwfOfG6JGaPg@mail.gmail.com>
	<CAHfHakGdbaFRYpTU0sW3-vvRPgy3T161fc4KaXqqZkCD+v0hdg@mail.gmail.com>
	<CAOmV22vdGn5jhVnmXOXoBLN07O+JQcTXrvNZnJvyARJ_rPVu1w@mail.gmail.com>
Date: Fri, 6 Nov 2015 09:36:12 -0800
Message-ID: 
 <CAOmV22sCGhD20NfpyZ1OhyGzYdhx_VpOOecwJ-hXVsVfh25tSg@mail.gmail.com>
Subject: Re: file too large -
 itests/thirdparty/spark-1.2.0-bin-hadoop2-without-hive.tgz
From: Jimmy Xiang <jxiang@cloudera.com>
To: "dev@hive.apache.org" <dev@hive.apache.org>
Content-Type: multipart/alternative; boundary=001a11c2641604fb9c0523e2ae58

--001a11c2641604fb9c0523e2ae58
Content-Type: text/plain; charset=UTF-8

Done. Branch master-fixed is clean now. What should we do next?

On Fri, Nov 6, 2015 at 9:26 AM, Jimmy Xiang <jxiang@cloudera.com> wrote:

> Let me do that.
>
> On Fri, Nov 6, 2015 at 9:24 AM, Owen O'Malley <omalley@apache.org> wrote:
>
>> Can someone push a fixed master history to "master-fixed"? Then we can
>> start a discussion with infra about replacing master with master-fixed.
>>
>> .. Owen
>>
>> On Fri, Nov 6, 2015 at 9:04 AM, Jimmy Xiang <jxiang@cloudera.com> wrote:
>>
>> > Right. The file is not in source control any more. But it was there at
>> some
>> > moment. That's why it is in the git history. So we need to clean up the
>> git
>> > history.
>> >
>> > To push to a branch other than master, for example, hive-11890, as a
>> > work-around, you can try https://rtyley.github.io/bfg-repo-cleaner/ to
>> do
>> > the clean up first, then push.
>> >
>> > On Fri, Nov 6, 2015 at 9:00 AM, Jimmy Xiang <jxiang@cloudera.com>
>> wrote:
>> >
>> > > I ran into the same problem too. What we need to do is to clean up the
>> > git
>> > > history. However, the master branch can't be force-pushed. I was
>> > wondering
>> > > if this is something the infra team can help.
>> > >
>> > > On Fri, Nov 6, 2015 at 8:54 AM, Xuefu Zhang <xzhang@cloudera.com>
>> wrote:
>> > >
>> > >> I don't quite follow. That file is not in source control, but only
>> > >> downloaded when running test. Why a git push will mass with that
>> file?
>> > >>
>> > >>
>> > >> On Fri, Nov 6, 2015 at 7:44 AM, Owen O'Malley <omalley@apache.org>
>> > wrote:
>> > >>
>> > >> > Github apparently has a limit on pushes to personal accounts that
>> no
>> > >> file
>> > >> > may be larger than 100mb. When I try to push a branch to my
>> personal
>> > >> clone
>> > >> > of hive, I get:
>> > >> >
>> > >> > rockfleet:hive owen$ git push omalley master:hive-11890
>> > >> > > Counting objects: 21159, done.
>> > >> > > Delta compression using up to 4 threads.
>> > >> > > Compressing objects: 100% (6561/6561), done.
>> > >> > > Writing objects: 100% (21159/21159), 110.16 MiB | 3.19 MiB/s,
>> done.
>> > >> > > Total 21159 (delta 11142), reused 18555 (delta 9014)
>> > >> > > remote: error: GH001: Large files detected. You may want to try
>> Git
>> > >> Large
>> > >> > > File Storage - https://git-lfs.github.com.
>> > >> > > remote: error: Trace: 5cfe5408835563c7f661c3086c84930a
>> > >> > > remote: error: See http://git.io/iEPt8g for more information.
>> > >> > > remote: error: File
>> > >> > > itests/thirdparty/spark-1.2.0-bin-hadoop2-without-hive.tgz is
>> 103.62
>> > >> MB;
>> > >> > > this exceeds GitHub's file size limit of 100.00 MB
>> > >> > > To git@github.com:omalley/hive.git
>> > >> > >  ! [remote rejected] master -> hive-11890 (pre-receive hook
>> > declined)
>> > >> > > error: failed to push some refs to 'git@github.com:
>> > omalley/hive.git'
>> > >> >
>> > >> >
>> > >> > This makes it very difficult to work with. Can we do something else
>> > with
>> > >> > the file? If not, can we store it with the git large file storage
>> as
>> > >> > suggested in the error message?
>> > >> >
>> > >> > .. Owen
>> > >> >
>> > >>
>> > >
>> > >
>> >
>>
>
>

--001a11c2641604fb9c0523e2ae58--