hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <>
Subject Re: Difference between -put command and Hive Load command?
Date Wed, 13 Feb 2013 05:47:34 GMT
Please send Hive-relevant questions to the Hive's user community lists
( instead of me directly. For more details read I've added the list
in my response here, please carry forward discussions on the lists :-)

Neither is faster than the other, and both use the same underlying FS

What -put does is a copy from local FS to HDFS. This would almost be
what Hive's "LOAD DATA [LOCAL]" command does as well. If your data is
already on HDFS, then "LOAD DATA"'s operation would be akin to doing a
"fs -mv" operation, which is what may have led you to believe it is
"faster" in comparison.

On Wed, Feb 13, 2013 at 11:02 AM,  <> wrote:
> Hi Harsha,
> What is the difference between hadoop fs -put command and Hive 'LOAD DATA' command, because
i tried to create external table and loaded data using "hadoop fs -put" command and tried
using "LOAD DATA" command in Hive.
> It seems hive "LOAD DATA" command is much much faster than "-Put" command.
> can you please give what is the reason for this?
> Thanks
> Shreehari

Harsh J

View raw message