impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Philip Zeyliger <phi...@cloudera.com>
Subject Re: Error while executing bootstrap_development.sh
Date Sun, 05 Nov 2017 15:06:54 GMT
Hello!

Welcome to the Impala dev community!

Based on your log, you're most likely out of disk space. The "could only be
replicated to 0 nodes" error is coming from HDFS, whose datanodes are
reporting there's not enough space for more blocks. You could go into the
HDFS web UI (port 5070, if I'm not mistaken) to see what it thinks of its
datanodes.

Cheers,

-- Philip

Root cause: RemoteException: File
> /test-warehouse/tpch.lineitem_parquet/_impala_insert_staging/5a462fd1784b386b_9a482c4000000000/.5a462fd1784b386b-9a482c4000000000_1022957176_dir/5a462fd1784b386b-9a482c4000000000_2059436732_data.0.parq
> could only be replicated to 0 nodes instead of minReplication (=1).  There
> are 3 datanode(s) running and no node(s) are excluded in this operation.
> at
> org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1720)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3439)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:686)
> at


On Sun, Nov 5, 2017 at 5:19 AM, yash jain <ydjainopensource@gmail.com>
wrote:

> Hi
>
> I am a newbie I was trying to setup my development environment I was using
> a fresh docker container. I tried to follow the instruction given here
> <https://cwiki.apache.org/confluence/display/IMPALA/Docker+for+Impala+Developers>
>
> I get the following error after around 5 or 6 hours of processing
>
>     Background task Loading TPC-H data (pid 9663) failed.
>     Error in /home/impdev/Impala/testdata/bin/create-load-data.sh at line
> 85: ;;
>
> I have tried setting up a VMWare Workstation VM too but it also gave me
> the same error
>
> My host PC config is
>
> Intel i7-6700K processor
> 16 GB RAM @3000MHz
> 1 TB SATA drive
> Ubuntu 16.04 x64
>
> The partition for docker was completely empty when the process began and
> currently has around 85 Gb data filled out of a max of 155 Gb .
>
> The complete on screen output is attached below.
>
> Thanks
>
>
>
>
>
>
>
>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message