hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-950) Pig Loader does not handle unix hidden files ( files starting with dot)
Date Thu, 10 Sep 2009 01:17:57 GMT

    [ https://issues.apache.org/jira/browse/PIG-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12753361#action_12753361
] 

Daniel Dai commented on PIG-950:
--------------------------------

I tried, actually Hadoop will ignore files start with "." while processing a map-reduce job.
So guess we can do nothing, just not name the file starts with ".".

> Pig Loader does not handle unix hidden files ( files starting with dot)
> -----------------------------------------------------------------------
>
>                 Key: PIG-950
>                 URL: https://issues.apache.org/jira/browse/PIG-950
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.4.0
>            Reporter: Jing Huang
>
> I am trying to load .btschema file using pig loader, ( .btschema is not an empty file)
> This is what I did:
> grunt> a = load '.btschema';
> grunt> dump a;
> 2009-09-09 17:41:21,170 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
- MR plan size before optimization: 1
> 2009-09-09 17:41:21,170 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
- MR plan size after optimization: 1
> 2009-09-09 17:41:23,092 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
- Setting up single store job
> 2009-09-09 17:41:23,106 [main] INFO  org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot
initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 2009-09-09 17:41:23,127 [Thread-4] WARN  org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
> 2009-09-09 17:41:23,623 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 0% complete
> 2009-09-09 17:41:28,644 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 100% complete
> 2009-09-09 17:41:28,644 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Successfully stored result in: "file:/tmp/temp1655555972/tmp-527102439"
> 2009-09-09 17:41:28,645 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Records written : 0
> 2009-09-09 17:41:28,645 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Bytes written : 0
> 2009-09-09 17:41:28,645 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Success!
> grunt> 
> =========
> it dumps nothing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message