Mailing-List: contact user-help@kudu.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@kudu.apache.org
MIME-Version: 1.0
In-Reply-To: <64BEE379-017C-42D6-AE4D-B9E6F5FC56C0@gmail.com>
References: <CADY20s7PdZ=hQfztvXNA7S-NMBrJc_v7aJgxNo-Sk8YeGPiY+A@mail.gmail.com>
 <64BEE379-017C-42D6-AE4D-B9E6F5FC56C0@gmail.com>
From: Todd Lipcon <todd@cloudera.com>
Date: Tue, 20 Sep 2016 12:00:03 -0700
Message-ID: <CADY20s6TBkD2iGMYCHVTjDZkH1z9xescijp7VGQTzMWK_Paq7A@mail.gmail.com>
Subject: Re: [ANNOUNCE] Apache Kudu 1.0.0 release
To: user@kudu.apache.org
Cc: dev <dev@kudu.apache.org>
Content-Type: multipart/alternative; boundary=001a114435cc83029e053cf50a57
archived-at: Tue, 20 Sep 2016 19:00:36 -0000

--001a114435cc83029e053cf50a57
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

-announce


On Tue, Sep 20, 2016 at 11:34 AM, Benjamin Kim <bbuild11@gmail.com> wrote:

> This is awesome!!! Great!!!
>
> Do you know if any improvements were also made to the Spark plugin jar?
>

Looks like a few changes based on the git log:
https://gist.github.com/4fa3ccc3b9be787227fed89c1bd42837

as well as a number of changes to the Java client (which gets pulled into
the Spark jar):
https://gist.github.com/e2a8ca78e51773fabb70aae34207199f


In particular, I think the partition pruning work in the Java client should
reduce the number of Spark partitions if you have predicates on your data
frames. (though I haven't personally verified it)

-Todd


> On Sep 20, 2016, at 12:11 AM, Todd Lipcon <todd@apache.org> wrote:
>
> The Apache Kudu team is happy to announce the release of Kudu 1.0.0!
>
> Kudu is an open source storage engine for structured data which supports
> low-latency random access together with efficient analytical access
> patterns. It is designed within the context of the Apache Hadoop ecosyste=
m
> and supports many integrations with other data analytics projects both
> inside and outside of the Apache Software Foundation.
>
> This latest version adds several new features, including:
>
> - Removal of multiversion concurrency control (MVCC) history is now
> supported. This allows Kudu to reclaim disk space, where previously Kudu
> would keep a full history of all changes made to a given table since the
> beginning of time.
>
> - Most of Kudu=E2=80=99s command line tools have been consolidated under =
a new
> top-level "kudu" tool. This reduces the number of large binaries
> distributed with Kudu and also includes much-improved help output.
>
> - Administrative tools including "kudu cluster ksck" now support running
> against multi-master Kudu clusters.
>
> - The C++ client API now supports writing data in AUTO_FLUSH_BACKGROUND
> mode. This can provide higher throughput for ingest workloads.
>
> This release also includes many bug fixes, optimizations, and other
> improvements, detailed in the release notes available at:
> http://kudu.apache.org/releases/1.0.0/docs/release_notes.html
>
> Download the source release here:
> http://kudu.apache.org/releases/1.0.0/
>
> Convenience binary artifacts for the Java client and various Java
> integrations (eg Spark, Flume) are also now available via the ASF Maven
> repository.
>
> Enjoy the new release!
>
> - The Apache Kudu team
>
>
>


--=20
Todd Lipcon
Software Engineer, Cloudera

--001a114435cc83029e053cf50a57
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">-announce<div><br></div><div class=3D"gmail_extra"><br><di=
v class=3D"gmail_quote">On Tue, Sep 20, 2016 at 11:34 AM, Benjamin Kim <spa=
n dir=3D"ltr">&lt;<a href=3D"mailto:bbuild11@gmail.com" target=3D"_blank">b=
build11@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote=
" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color=
:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div style=3D"w=
ord-wrap:break-word">This is awesome!!! Great!!!<div><br></div><div>Do you =
know if any improvements were also made to the Spark plugin jar?</div></div=
></blockquote><div><br></div><div>Looks like a few changes based on the git=
 log:</div><div><a href=3D"https://gist.github.com/4fa3ccc3b9be787227fed89c=
1bd42837">https://gist.github.com/4fa3ccc3b9be787227fed89c1bd42837</a></div=
><div><br></div><div>as well as a number of changes to the Java client (whi=
ch gets pulled into the Spark jar):=C2=A0<br></div><div><a href=3D"https://=
gist.github.com/e2a8ca78e51773fabb70aae34207199f">https://gist.github.com/e=
2a8ca78e51773fabb70aae34207199f</a><br></div><div><br></div><div><br></div>=
<div>In particular, I think the partition pruning work in the Java client s=
hould reduce the number of Spark partitions if you have predicates on your =
data frames. (though I haven&#39;t personally verified it)</div><div><br></=
div><div>-Todd</div><div><br></div><div><br></div><blockquote class=3D"gmai=
l_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-lef=
t-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div sty=
le=3D"word-wrap:break-word"><div><div><div class=3D"gmail-h5">
<br><div><blockquote type=3D"cite"><div>On Sep 20, 2016, at 12:11 AM, Todd =
Lipcon &lt;<a href=3D"mailto:todd@apache.org" target=3D"_blank">todd@apache=
.org</a>&gt; wrote:</div><br><div><div dir=3D"ltr">The Apache Kudu team is =
happy to announce the release of Kudu 1.0.0!<br><br>Kudu is an open source =
storage engine for structured data which supports low-latency random access=
 together with efficient analytical access patterns. It is designed within =
the context of the Apache Hadoop ecosystem and supports many integrations w=
ith other data analytics projects both inside and outside of the Apache Sof=
tware Foundation.<br><br>This latest version adds several new features, inc=
luding:<br><br>- Removal of multiversion concurrency control (MVCC) history=
 is now supported. This allows Kudu to reclaim disk space, where previously=
 Kudu would keep a full history of all changes made to a given table since =
the beginning of time.<br><br>- Most of Kudu=E2=80=99s command line tools h=
ave been consolidated under a new top-level &quot;kudu&quot; tool. This red=
uces the number of large binaries distributed with Kudu and also includes m=
uch-improved help output.<br><br>- Administrative tools including &quot;kud=
u cluster ksck&quot; now support running against multi-master Kudu clusters=
.<br><br>- The C++ client API now supports writing data in AUTO_FLUSH_BACKG=
ROUND mode. This can provide higher throughput for ingest workloads.<br><br=
>This release also includes many bug fixes, optimizations, and other improv=
ements, detailed in the release notes available at:<br><a href=3D"http://ku=
du.apache.org/releases/1.0.0/docs/release_notes.html" target=3D"_blank">htt=
p://kudu.apache.org/release<wbr>s/1.0.0/docs/release_notes.<wbr>html</a><br=
><br>Download the source release here:<br><a href=3D"http://kudu.apache.org=
/releases/1.0.0/" target=3D"_blank">http://kudu.apache.org/release<wbr>s/1.=
0.0/</a><div><br></div><div>Convenience binary artifacts for the Java clien=
t and various Java integrations (eg Spark, Flume) are also now available vi=
a the ASF Maven repository.<br><br></div><div>Enjoy the new release!</div><=
div><br></div><div>- The Apache Kudu team<br></div></div>
</div></blockquote></div><br></div></div></div></div></blockquote></div><br=
><br clear=3D"all"><div><br></div>-- <br><div class=3D"gmail_signature">Tod=
d Lipcon<br>Software Engineer, Cloudera</div>
</div></div>

--001a114435cc83029e053cf50a57--