hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ArunKumar <arunk...@gmail.com>
Subject How is data of each job assigned in Mumak ?
Date Tue, 15 Nov 2011 07:36:30 GMT
Hi guys !

Q> How can i assign data of each job in mumak nodes and what else i need to
do ?
In genreral how can i use the pluggable block-placement for HDFS in Mumak ?
Meaning in my context i am using 19-jobs-trace json file and modified
topology json file consisting of say 4 nodes. Since the number of tasks(map
& reduce) are fixed for these jobs i want to assign the input data( with
their replication) of each job to some particular nodes, so that i can use
this info in my scheduler . Does the code for "ObtainLocalMapTask" /
"ObtainNonlocalMaptask" in Scheduler need to be changed if i have to use
this data placement info ?

Q>If i have to add some fields to jobs in job trace file , how do i add it
to job trace and access in my scheduler code for scheduling in Mumak.
Which classes do i need to modify for this?


View this message in context: http://lucene.472066.n3.nabble.com/How-is-data-of-each-job-assigned-in-Mumak-tp3508919p3508919.html
Sent from the Hadoop lucene-users mailing list archive at Nabble.com.

View raw message