hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Lewis <lordjoe2...@gmail.com>
Subject How do I diagnose a really slow copy
Date Fri, 04 Nov 2011 15:20:40 GMT
I have been finding a that my cluster is running abnormally slowly
A typical reduce task reports
reduce > copy (113 of 431 at 0.07 MB/s)
70 kb / second is a truely dreadful rate and tasks are running much slower
under hadoop than the
same code on a the same operations on a single box -
Where do I look to find why IO operations might  be so slow??

Steven M. Lewis PhD

View raw message