pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Charlie Groves (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-55) Allow user control over split creation
Date Tue, 01 Apr 2008 18:02:24 GMT

    [ https://issues.apache.org/jira/browse/PIG-55?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584233#action_12584233
] 

Charlie Groves commented on PIG-55:
-----------------------------------

The unit test issue is really straightforward.  In your command, you're using junit.textui.TestRunner
to run the tests.  It's specifically for run subclasses of TestCase and other JUnit 3 style
unit tests.  It fails because TestParser is a JUnit 4 style test and it can't find any of
the old style test cases in it.  You need to switch to the new runner, org.junit.runner.JUnitCore,
to run tests that just use annotations and don't follow the JUnit 3 naming and subclassing
conventions.  If you use that, the test will pass.  It also runs and passes as part of ant
test, so there's no need to run it directly anyway.

> Allow user control over split creation
> --------------------------------------
>
>                 Key: PIG-55
>                 URL: https://issues.apache.org/jira/browse/PIG-55
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.0.0
>            Reporter: Charlie Groves
>             Fix For: 0.1.0
>
>         Attachments: pig_chunker_split.patch, pig_chunker_split_v2.patch, pig_chunker_split_v3.patch,
pig_chunker_split_v4.patch, pig_chunker_split_v5.patch, replaceable_PigSplit.diff, replaceable_PigSplit_v2.diff
>
>
> I have a dataset in HDFS that's stored in a file per column that I'd like to access from
pig.  This means I can't use LoadFunc to get at the data as it only allows the loader access
to a single input stream at a time.  To handle this usage, I've broken the existing split
creation code out into a few classes and interfaces, and allowed user specified load functions
to be used in place of the existing code.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message