hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ranjit Mathew (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-2095) Gridmix unable to run for compressed traces(.gz format).
Date Mon, 04 Oct 2010 06:23:33 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ranjit Mathew updated MAPREDUCE-2095:
-------------------------------------

    Status: Patch Available  (was: Open)

The updated patch includes a unit-test that produces the following (snipped) results with
"ant test":
{quote}
test:
     [echo] contrib: gridmix
   [delete] Deleting directory /home/ranjit/src/Hadoop/Apache/mapred_trunk/build/contrib/gridmix/test/logs
    [mkdir] Created dir: /home/ranjit/src/Hadoop/Apache/mapred_trunk/build/contrib/gridmix/test/logs
    [junit] WARNING: multiple versions of ant detected in path for junit 
    [junit]          jar:file:/home/ranjit/apps/ant/lib/ant.jar!/org/apache/tools/ant/Project.class
    [junit]      and jar:file:/home/ranjit/.ivy2/cache/ant/ant/jars/ant-1.6.5.jar!/org/apache/tools/ant/Project.class
    [junit] Running org.apache.hadoop.mapred.gridmix.TestFilePool
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.294 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestFileQueue
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.449 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestGridmixRecord
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.262 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestGridmixSubmission
    [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 414.348 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestRandomAlgorithm
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.243 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestRecordFactory
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.242 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestSleepJob
    [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 570.155 sec
    [junit] Running org.apache.hadoop.mapred.gridmix.TestUserResolve
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.457 sec
{quote}

The relevant extract from {{TEST-org.apache.hadoop.mapred.gridmix.TestGridmixSubmission.txt}}:
{quote}
Verifying JobStory from compressed trace...
Verifying JobStory from uncompressed trace...
Verifying JobStory from trace in standard input...
{quote}

> Gridmix unable to run for compressed traces(.gz format).
> --------------------------------------------------------
>
>                 Key: MAPREDUCE-2095
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2095
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/gridmix
>    Affects Versions: 0.20.1
>            Reporter: Vinay Kumar Thota
>            Assignee: Ranjit Mathew
>         Attachments: MAPREDUCE-2095.patch, MAPREDUCE-2095_v2.patch, wordcount.json.gz
>
>
> I was trying to run gridmix with compressed trace file.However, it throws a JsonParseException
and exit.
> exception details:
> ==================
> org.codehaus.jackson.JsonParseException: Illegal character ((CTRL-CHAR, code 31)): only
regular white space (\r, \n,
> \t) is allowed between tokens
>  at [Source: org.apache.hadoop.fs.FSDataInputStream@17ba38f; line: 1, column: 2]
>         at org.codehaus.jackson.impl.JsonParserBase._constructError(JsonParserBase.java:651)
>         at org.codehaus.jackson.impl.JsonParserBase._reportError(JsonParserBase.java:635)
>         at org.codehaus.jackson.impl.JsonParserBase._throwInvalidSpace(JsonParserBase.java:596)
>         at org.codehaus.jackson.impl.Utf8StreamParser._skipWSOrEnd(Utf8StreamParser.java:981)
>         at org.codehaus.jackson.impl.Utf8StreamParser.nextToken(Utf8StreamParser.java:77)
>         at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:688)
>         at org.codehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:624)
>         at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:275)
>         at org.apache.hadoop.tools.rumen.JsonObjectMapperParser.getNext(JsonObjectMapperParser.java:84)
>         at org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:117)
>         at org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:29)
>         at org.apache.hadoop.mapred.gridmix.JobFactory.getNextJobFiltered(JobFactory.java:174)
>         at org.apache.hadoop.mapred.gridmix.StressJobFactory$StressReaderThread.run(StressJobFactory.java:166)
> 10/09/23 09:43:17 ERROR gridmix.Gridmix: Error in trace
> org.codehaus.jackson.JsonParseException: Illegal character ((CTRL-CHAR, code 31)): only
regular white space (\r, \n,
> \t) is allowed between tokens
>  at [Source: org.apache.hadoop.fs.FSDataInputStream@17ba38f; line: 1, column: 2]
>         at org.codehaus.jackson.impl.JsonParserBase._constructError(JsonParserBase.java:651)
>         at org.codehaus.jackson.impl.JsonParserBase._reportError(JsonParserBase.java:635)
>         at org.codehaus.jackson.impl.JsonParserBase._throwInvalidSpace(JsonParserBase.java:596)
>         at org.codehaus.jackson.impl.Utf8StreamParser._skipWSOrEnd(Utf8StreamParser.java:981)
>         at org.codehaus.jackson.impl.Utf8StreamParser.nextToken(Utf8StreamParser.java:77)
>         at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:688)
>         at org.codehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:624)
>         at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:275)
>         at org.apache.hadoop.tools.rumen.JsonObjectMapperParser.getNext(JsonObjectMapperParser.java:84)
>         at org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:117)
>         at org.apache.hadoop.tools.rumen.ZombieJobProducer.getNextJob(ZombieJobProducer.java:29)
>         at org.apache.hadoop.mapred.gridmix.JobFactory.getNextJobFiltered(JobFactory.java:174)
>         at org.apache.hadoop.mapred.gridmix.StressJobFactory$StressReaderThread.run(StressJobFactory.java:166)
> 10/09/23 09:43:17 INFO gridmix.Gridmix: Exiting...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message