Mailing-List: contact user-help@orc.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@orc.apache.org
Content-Type: multipart/alternative;
 boundary="----sinikael-?=_1-14948654246150.9710781829347008"
From: Ben Johnson <ben@timber.io>
To: user@orc.apache.org
Subject: Adding columns to an existing table creates exceptions for queries
 that previously worked
Message-Id: <f9adef79-e23e-9f2f-12cb-c1c4336f6d52@mixmax.com>
Date: Mon, 15 May 2017 16:23:44 +0000
MIME-Version: 1.0
archived-at: Mon, 15 May 2017 16:23:52 -0000

------sinikael-?=_1-14948654246150.9710781829347008
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Hi, we're using Hive 2.1.1. We have an external table defined that points =
to
ORC files living on S3. When we add a column to that table hive queries =
that
previously worked throw this exception. If we remove the column, the =
query works
fine.
This seems exceptionally brittle. I have a feeling this =
is my fault, but I
cannot pinpoint what I'm doing wrong. Is this a known =
issue, or os there a
setting I'm missing?

Oddly, when attempting to issue =
these queries in Presto using the same Hive
metastore, the queries work =
fine.
Any ideas what might be happening?
Thanks for your help.


BenTimber.io=C2=A0-Blog=C2=A0-Github=C2=A0-Twitter
------sinikael-?=_1-14948654246150.9710781829347008
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable

 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www=
.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns=3D"http://www.=
w3.org/1999/xhtml" xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office"> <head> <meta =
name=3D"viewport" content=3D"width=3Ddevice-width,initial-scale=3D1"> <!=
--[if gte mso 9]>
    <xml>
      <o:OfficeDocumentSettings>
        <o:AllowPNG/>
        <o:PixelsPerInch>96</o:PixelsPerInch>
     </o:OfficeDocumentSettings>
    </xml>
    <![endif]--> <style =
type=3D"text/css">* a:hover{cursor:pointer;}</style> <style>body =
{-webkit-animation:bugfix infinite 1s;}@-webkit-keyframes bugfix {from =
{position:relative;}to {position:relative;}}</style> </head> <body =
style=3D"word-wrap:normal;word-break:break-word"> <style>a =
{word-wrap:normal;word-break:break-word;}.background-contain =
{background-size:contain;}@media only screen and (max-width:600px) {.=
container {-webkit-text-size-adjust:none !important;}.container,.=
palm-one-whole {width:100% !important;min-width:100% !important;}.=
palm-one-half {width:50% !important;min-width:50% !important;box-sizing:bor=
der-box;}blockquote .container,blockquote .container div,blockquote .=
container table {width:auto !important;min-width:0 !=
important;position:relative !important;}img {max-width:100%;}.border-outer,=
.border-middle,.border-inner,.inner,[title=3D"separator"] {width:100% !=
important;}.innercell {padding:8px !important;}.palm-block {display:block !=
important;}td.palm-one-whole {display:inline-block !important;padding:0;}td=
.palm-one-whole:first-child:not(:only-child) {margin-bottom:16px;}td.=
hostname {padding-top:3px !important;}}@media only screen and =
(min-width:601px) {.preview-card {max-width:600px !important;}}@media only =
screen and (min-device-width :320px) and (max-device-width :568px),only =
screen and (min-device-width :768px) and (max-device-width :1024px),only =
screen and (max-device-width:640px),only screen and =
(max-device-width:667px),only screen and (max-width:480px){.container =
{width:100% !important;min-width:100% !important;}.p,.small,li,=
font[size=3D"2"],font[size=3D"3"] {font-size:1em !important;}}@media only =
screen and (min-device-width :320px) and (max-device-width :568px),only =
screen and (min-device-width :768px) and (max-device-width :1024px),only =
screen and (min-device-width :1224px)  {.message-wrapper {padding-top:6px;}=
.apple-only[style] {display:block !important;max-height:none !=
important;line-height:normal !important;overflow:visible !=
important;height:auto !important;width:100% !important;position:relative !=
important;}.no-apple {display:none !important;}form =
{font-size:inherit;}input[type=3D"text"] {height:43px;padding-left:4px !=
important;}button:hover {cursor:pointer;}}@media only screen and =
(min-device-width :1224px)  {.apple-mail-form {display:block !=
important;background-color:white !important;}}* [office365] .=
outlook-com-hidden {display:none !important;}* [office365] .=
outlook-com-button {display:block;}* [office365] .outlook-com-only =
{display:block !important;max-height:none !important;line-height:normal !=
important;overflow:visible !important;height:auto !important;width:100% !=
important;position:relative !important;}.ExternalClass {width:100%;}.=
ExternalClass .outlook-com-button {display:block;}.ExternalClass button =
{height:auto;}.ExternalClass .outlook-com-hidden {display:none !important;}=
.ExternalClass .outlook-com-only {display:block !important;max-height:none =
!important;line-height:normal !important;overflow:visible !=
important;height:auto !important;width:100% !important;position:relative !=
important;}.ExternalClass .ecxlabels {display:none !important;}.=
ExternalClass .ecxlabels {display:none !important;}.ExternalClass .ecxarrow=
 {display:none !important;}.ExternalClass cite >div + div {padding:0 0 4px =
0;}.ExternalClass .h1 {padding-bottom:5px;}.ExternalClass .h2 =
{padding-bottom:5px;}.ExternalClass .h3 {padding-bottom:5px;}.ExternalClass=
 [lang=3D"brand-pinterest"] {width:280px !important;}</style> <!--[if (gte =
mso 9)|(IE)]>
   =20
    <style>
      a, body {
        font-family: =
'Calibri', Arial, sans-serif;
      }
   =20
      img {
        border: none !important;
        -ms-interpolation-mode:bicubic;
      }
   =20
      td {
        mso-line-height-rule:exactly !important;
      }
   =20
      .mso-card-inner table {
        border-collapse: =
collapse !important;
        mso-table-lspace:0pt;
        =
mso-table-rspace:0pt;
        vertical-align: top;
      }
   =20
      .outlook-com-only {
        display: none !important;
        font-size: 0 !important;
      }
   =20
      #mso-one-whole {
        width: 100% !important;
      }
   =20
   =20
   =20
        .border-outer,
        .border-middle,
        .border-inner {
          border: none !important;
        }
   =20
        .border-middle,
        .border-inner {
          width: 100% !important;
        }
   =20
        .mso-border-outer,
        .mso-border-middle,
        .mso-border-inner {
          padding: 1px;
        }
   =20
        .mso-border-outer { background-color: rgb(245, 255, 255); }
        .mso-border-middle { background-color: rgb(223, 246, 255); }
        .mso-border-inner { background-color: rgb(153, 176, 225); }
   =20
    </style>
   =20
    <![endif]--> <table class=3D"container" =
lang=3D"container" dir=3D"ltr" border=3D"0" cellpadding=3D"0" =
cellspacing=3D"0" valign=3D"top" style=3D"width:100%;margin-top:6px"> <tr> =
<td valign=3D"top" class=3D"message-wrapper" style=3D"line-height:1.=
31;color:#222;font-family:arial,sans-serif"> <!--[if mso]><table  =
border=3D"0" cellpadding=3D"0" cellspacing=3D"0" valign=3D"top" =
style=3D"border-collapse:separate;"><tr><td valign=3D"top"><![endif]--> =
<div>Hi, we're using Hive 2.1.1. We have an external table defined that =
points to ORC files living on S3. When we add a column to that table hive =
queries that previously worked throw <a href=3D"https://gist.github.=
com/binarylogic/cc2a021f18afe994c907e7e847862a6d">this exception</a>. If we=
 remove the column, the query works fine.</div><div><br></div><div>This =
seems exceptionally brittle. I have a feeling this is my fault, but I =
cannot pinpoint what I'm doing wrong. Is this a known issue, or os there a =
setting I'm missing?<br></div><div><br></div><div>Oddly, when attempting to=
 issue these queries in Presto using the same Hive metastore, the queries =
work fine.</div><div><br></div><div>Any ideas what might be happening?=
</div><div><br></div><div>Thanks for your help.</div><div><br></div><div><b=
r></div><div><br></div><div class=3D"mixmax_signature"><div><font =
face=3D"&quot;Helvetica Neue&quot;, Helvetica, Arial, sans-serif" =
color=3D"#212121" style=3D"background-color:rgb(255,255,=
255)">Ben</font></div><div><a href=3D"https://timber.io/">Timber.=
io</a>=C2=A0-=C2=A0<a href=3D"http://blog.timber.io/">Blog</a>=C2=A0-=C2=A0=
<a href=3D"https://github.com/timberio">Github</a>=C2=A0-=C2=A0<a =
href=3D"https://twitter.com/timberdotio">Twitter</a></div></div><img =
align=3D"left" width=3D"0" height=3D"0" style=3D"border:0;width:0px;height:=
0px" src=3D"https://track.mixmax.com/api/track/v2/Z2qwtCvYZ2BbtI5Uz/i8WauIX=
Zi1Wa0BkblJmI/icmcv5SZoNWYwFmLjJ3bAJXZzVnI" alt=3D""> <!--[if =
mso]></td></tr></table><![endif]--> </td> </tr> </table> </body> =
</html>=20
------sinikael-?=_1-14948654246150.9710781829347008--