hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jasper Knulst <>
Subject Re: Data loading from Datanode
Date Thu, 08 Dec 2011 08:39:25 GMT
Hi Keshav,
What you want is not possible I guess. You can't submit anything into HDFS
without the namenode. Datanodes reports their local blocks into the
namenode. If the namenode does not know them it will instruct the datanode
to delete them.

But whats the point? If you submit local files to HDFS (via the namenode )
from a datanode, the nn will assign to first block placement directly on
that dn (provided there is room etc.) and start replicating from there.

Cheers Jasper
 Op 8 dec. 2011 08:24 schreef "Savant, Keshav" <> het volgende:

> Hi All,****
> ** **
> Is it possible to load data (in HDFS) using Hive Load data query from any
> of the Datanode?****
> ** **
> So that means can we insert files into datanode directly (or from hive
> installed on datanode) and then the master node syncs with datanodes later.
> ****
> ** **
> Keshav C Savant****
>  _____________
> The information contained in this message is proprietary and/or
> confidential. If you are not the intended recipient, please: (i) delete the
> message and all copies; (ii) do not disclose, distribute or use the message
> in any manner; and (iii) notify the sender immediately. In addition, please
> be aware that any message addressed to our domain is subject to archiving
> and review by persons other than the intended recipient. Thank you.

View raw message