Mailing-List: contact user-help@kylin.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@kylin.apache.org
MIME-Version: 1.0
From: Ruslan Dautkhanov <dautkhanov@gmail.com>
Date: Tue, 2 Jan 2018 12:52:09 -0700
Message-ID: <CACdThQ2MAQvRPOi7zgav3UvwQp5uamDn+=gMUj-o7jJwVkVrFg@mail.gmail.com>
Subject: Cube build fails on Step 3 "Extract Fact Table Distinct Columns"
To: user@kylin.apache.org
Content-Type: multipart/alternative; boundary="001a113ce1a86224340561d070b6"
archived-at: Tue, 02 Jan 2018 19:52:37 -0000

--001a113ce1a86224340561d070b6
Content-Type: text/plain; charset="UTF-8"

Happy New Year !

Bouncing at the users list if this is a known issue to someone:

Cube build consistently fails on Step 3 "Extract Fact Table Distinct
Columns".
First two steps complete just fine.
Mappers work fine, it only the reducers that fail - many of them with the
same error [1].
Also [2] shows stdout/stderr from one of the reducers attempts.

CDH 5.12.1.
Kylin 2.2.

Has anyone seen this issue?


[1]

Exception from container-launch.
> Container id: container_e181_1512700237856_1192_01_001227
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:601)
> at org.apache.hadoop.util.Shell.run(Shell.java:504)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786)
> at
> org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:373)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Shell output: main : command provided 1 main :
> run as user is rdautkha main : requested yarn user is rdautkha
> Writing to tmp file
> /hdfs02/yarn/nm/nmPrivate/application_1512700237856_1192/container_e181_1512700237856_1192_01_001227/container_e181_1512700237856_1192_01_001227.pid.tmp
> Container exited with a non-zero exit code 1


[2]

Log Type: stderr
> Log Upload Time: Tue Jan 02 12:34:51 -0700 2018
> Log Length: 46
> Error: Could not find or load main class 8192


Log Type: stdout
> Log Upload Time: Tue Jan 02 12:34:51 -0700 2018
> Log Length: 0

--001a113ce1a86224340561d070b6
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Happy New Year !<div><br></div><div>Bouncing at the users =
list if this is a known issue to someone:</div><div><br></div><div>Cube bui=
ld consistently fails on Step 3 &quot;Extract Fact Table Distinct Columns&q=
uot;.<div>First two steps complete just fine.</div><div>Mappers work fine, =
it only the reducers that fail - many of them with the same error [1].</div=
><div>Also [2] shows stdout/stderr from one of the reducers attempts.</div>=
<div><br></div><div>CDH 5.12.1.</div><div>Kylin 2.2.</div><div><br></div><d=
iv>Has anyone seen this issue?</div><div><div><div class=3D"gmail_signature=
"><div dir=3D"ltr"><div><div dir=3D"ltr"><br></div><div dir=3D"ltr"><br></d=
iv></div><div dir=3D"ltr">[1]</div><div dir=3D"ltr"><br></div><div dir=3D"l=
tr"><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bor=
der-left:1px solid rgb(204,204,204);padding-left:1ex">Exception from contai=
ner-launch.=C2=A0<br>Container id: container_e181_1512700237856_1192_01_001=
227=C2=A0<br>Exit code: 1=C2=A0<br>Stack trace: ExitCodeException exitCode=
=3D1:=C2=A0<br>at org.apache.hadoop.util.Shell.runCommand(Shell.java:601)=
=C2=A0<br>at org.apache.hadoop.util.Shell.run(Shell.java:504)=C2=A0<br>at o=
rg.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786)=C2=
=A0<br>at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.=
launchContainer(LinuxContainerExecutor.java:373)=C2=A0<br>at org.apache.had=
oop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(=
ContainerLaunch.java:302)=C2=A0<br>at org.apache.hadoop.yarn.server.nodeman=
ager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82=
)=C2=A0<br>at java.util.concurrent.FutureTask.run(FutureTask.java:266)=C2=
=A0<br>at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecu=
tor.java:1149)=C2=A0<br>at java.util.concurrent.ThreadPoolExecutor$Worker.r=
un(ThreadPoolExecutor.java:624)=C2=A0<br>at java.lang.Thread.run(Thread.jav=
a:748)=C2=A0<br>Shell output: main : command provided 1 main :=C2=A0<br>run=
 as user is rdautkha main : requested yarn user is rdautkha=C2=A0<br>Writin=
g to tmp file /hdfs02/yarn/nm/nmPrivate/application_1512700237856_1192/cont=
ainer_e181_1512700237856_1192_01_001227/container_e181_1512700237856_1192_0=
1_001227.pid.tmp=C2=A0<br>Container exited with a non-zero exit code 1</blo=
ckquote><div dir=3D"ltr"><br></div><div dir=3D"ltr"><br></div><div dir=3D"l=
tr">[2]</div><div dir=3D"ltr"><br></div><div dir=3D"ltr"><blockquote class=
=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rg=
b(204,204,204);padding-left:1ex">Log Type: stderr<br>Log Upload Time: Tue J=
an 02 12:34:51 -0700 2018<br>Log Length: 46<br>Error: Could not find or loa=
d main class 8192</blockquote><div dir=3D"ltr"><br></div><blockquote class=
=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rg=
b(204,204,204);padding-left:1ex">Log Type: stdout<br>Log Upload Time: Tue J=
an 02 12:34:51 -0700 2018<br>Log Length: 0</blockquote><div><br></div></div=
></div></div></div></div>
</div></div></div>

--001a113ce1a86224340561d070b6--