beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinay (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2298) Java WordCount doesn't work in Window OS for glob expressions or file: prefixed paths
Date Thu, 29 Jun 2017 09:18:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068057#comment-16068057
] 

Vinay commented on BEAM-2298:
-----------------------------

I am also facing issue  while writing the Pcollection to file, Following is the stack trace:

*Exception in thread "main" java.lang.IllegalStateException: Unable to find registrar for
c
	at org.apache.beam.sdk.io.FileSystems.getFileSystemInternal(FileSystems.java:447)
	at org.apache.beam.sdk.io.FileSystems.matchNewResource(FileSystems.java:523)
	at org.apache.beam.sdk.io.FileBasedSink.convertToFileResourceIfPossible(FileBasedSink.java:204)
	at org.apache.beam.sdk.io.TextIO$Write.to(TextIO.java:294)
*

Here is the code I have tried with
{code:java}
.apply(TextIO.write()
                .to("c:/Projects/BeamPOC/"));
{code}


> Java WordCount doesn't work in Window OS for glob expressions or file: prefixed paths
> -------------------------------------------------------------------------------------
>
>                 Key: BEAM-2298
>                 URL: https://issues.apache.org/jira/browse/BEAM-2298
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>            Reporter: Pei He
>            Assignee: Flavio Fiszman
>             Fix For: 2.1.0
>
>
> I am not able to build beam repo in Windows OS, so I copied the jar file from my Mac.
> WordCount failed with the following cmd:
> java -cp beam-examples-java-2.0.0-jar-with-dependencies.jar
>  org.apache.beam.examples.WordCount --inputFile=input.txt --output=counts
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeB
> ytes
> INFO: Filepattern input.txt matched 1 files with total size 0
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.FileBasedSource expandFilePattern
> INFO: Matched 1 files for pattern input.txt
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.FileBasedSource split
> INFO: Splitting filepattern input.txt into bundles of size 0 took 0 ms and produ
> ced 1 files and 0 bundles
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.WriteFiles$2 processElement
> INFO: Finalizing write operation TextWriteOperation{tempDirectory=C:\Users\Pei\D
> esktop\.temp-beam-2017-05-135_13-09-48-1\, windowedWrites=false}.
> May 15, 2017 6:09:48 AM org.apache.beam.sdk.io.WriteFiles$2 processElement
> INFO: Creating 1 empty output shards in addition to 0 written for a total of 1.
> Exception in thread "main" org.apache.beam.sdk.Pipeline$PipelineExecutionExcepti
> on: java.lang.IllegalStateException: Unable to find registrar for c
>         at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.wait
> UntilFinish(DirectRunner.java:322)
>         at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.wait
> UntilFinish(DirectRunner.java:292)
>         at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:200
> )
>         at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:63)
>         at org.apache.beam.sdk.Pipeline.run(Pipeline.java:295)
>         at org.apache.beam.sdk.Pipeline.run(Pipeline.java:281)
>         at org.apache.beam.examples.WordCount.main(WordCount.java:184)
> Caused by: java.lang.IllegalStateException: Unable to find registrar for c
>         at org.apache.beam.sdk.io.FileSystems.getFileSystemInternal(FileSystems.
> java:447)
>         at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:111)
>         at org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:17
> 4)
>         at org.apache.beam.sdk.io.FileSystems.filterMissingFiles(FileSystems.jav
> a:367)
>         at org.apache.beam.sdk.io.FileSystems.copy(FileSystems.java:251)
>         at org.apache.beam.sdk.io.FileBasedSink$WriteOperation.copyToOutputFiles
> (FileBasedSink.java:641)
>         at org.apache.beam.sdk.io.FileBasedSink$WriteOperation.finalize(FileBase
> dSink.java:529)
>         at org.apache.beam.sdk.io.WriteFiles$2.processElement(WriteFiles.java:59
> 2)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message