hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitry Pushkarev" <u...@stanford.edu>
Subject task assignment managemens.
Date Sun, 07 Sep 2008 21:57:02 GMT
Dear Hadoop users,


Is it possible without using java manage task assignment to implement some
simple rules?  Like do not launch more that 1 instance of crawling task  on
a machine, and do not run data intensive tasks on remote machines, and do
not run computationally intensive tasks on single-core machines:etc.


Now it's done by failing tasks that decided to run on a wrong machine, but I
hope to find some solution on jobtracker side..




  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message