hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinay Kumar Thota (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-2081) [GridMix3] Implement functionality for get the list of job traces which has different intervals.
Date Mon, 04 Oct 2010 10:54:33 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917555#action_12917555
] 

Vinay Kumar Thota commented on MAPREDUCE-2081:
----------------------------------------------

bq. In getMRTraces(), do you think it makes sense to validate that the text between "_" and
"{d,h,m}.json.gz" is actually a number?

It make sense, I need the number for creating the keys for each trace path.

bq. Is the consumer of these methods supposed to know the desired time-period up front? (As
in Give me all traces that run for 10 minutes.)\

Added functionality in the patch.

bq. I think the listMRTraces() methods are not needed as they can be subsumed by a call to
Map.values() on the returned Map from the getMRTraces() methods.

It method should require,because it fetch all the traces in the path irrespective of time
interval. 





> [GridMix3] Implement functionality for get the list of job traces which has different
intervals.
> ------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2081
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2081
>             Project: Hadoop Map/Reduce
>          Issue Type: Test
>          Components: contrib/gridmix
>            Reporter: Vinay Kumar Thota
>            Assignee: Vinay Kumar Thota
>         Attachments: 2081-ydist.patch
>
>
> Girdmix system tests should require different job traces with different time intervals
for generate and submit the gridmix jobs. So, implement a functionaliy for getting the job
traces and arrange them in hash table with time interval as key.Also getting the list of traces
from resource location irrespective of time. The following methods needs to implement.
> Method signature:
> public static Map <String, String> getMRTraces(Configuration conf)  throws IOException;
- it get the traces with time intervals from resources default location.
> public static Map <String, String> getMRTraces(Configuration conf,Path path)  throws
IOException; - it get the traces with time intervals from user specified resource location.
> public static List<String> listMRTraces(Configuration conf) throws IOException
 -it list all the traces from resource default location irrespective of time interval.
> public static List<String> listMRTraces(Configuration conf, Path tracesPath) throws
IOException - it list all the traces from user specified user location irrespective of  time
interval.
> public static List<String> listMRTracesByTime(Configuration conf, String timeInterval)
throws IOException - it list all traces of a given time interval from default resource location.
> public static List<String> listMRTracesByTime(Configuration conf, String timeInterval,Path
path) throws IOException - it list all traces of a given time interval from a given resources
location.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message