hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shashi Vishwakarma <shashi.vish...@gmail.com>
Subject Performance impact of curl command on linux server
Date Fri, 04 Sep 2015 15:36:09 GMT

I have been using curl command for ingesting data into HDFS using WebHDFS.
Admins are saying that resource utilization for curl is very high which is
hampering server performance.

I would like to know if curl can use so much of resource which could lead
to performance issue.

Just to give more idea , I have been ingesting around 25Gb of data into
HDFS. Not to sure if curl can cause so much of issue with such a small data

Any suggestion would be a great help.



View raw message