beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xu Mingmin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (BEAM-2288) support PAssert/TestPipeline for generated pipeline
Date Sun, 14 May 2017 16:40:04 GMT

     [ https://issues.apache.org/jira/browse/BEAM-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xu Mingmin updated BEAM-2288:
-----------------------------
    Description: 
To support to test Beam generated pipeline with Beam standard {{PAssert}}/{{TestPipeline}}.

As part of BEAM-2010, it update the interface to explain SQL query, to link with Pipeline,
so below part is supported:
{code}
//prepare environment of BeamSQL
BeamSQLEnvironment sqlEnv = BeamSQLEnvironment.create();
//register table metadata
sqlEnv.addTableMetadata(String tableName, BeamSqlTable tableMetadata);
//register UDF
sqlEnv.registerUDF(String functionName, Method udfMethod);


//explain a SQL statement, SELECT only, and return as a PCollection;
PCollection<BeamSQLRow> phase1Stream = sqlEnv.explainSQL(pipeline, String sqlStatement);
{code}

  was:To support to test Beam generated pipeline with Beam standard {{PAssert}}/{{TestPipeline}}.


> support PAssert/TestPipeline for generated pipeline
> ---------------------------------------------------
>
>                 Key: BEAM-2288
>                 URL: https://issues.apache.org/jira/browse/BEAM-2288
>             Project: Beam
>          Issue Type: Improvement
>          Components: dsl-sql
>            Reporter: Xu Mingmin
>            Assignee: Xu Mingmin
>
> To support to test Beam generated pipeline with Beam standard {{PAssert}}/{{TestPipeline}}.
> As part of BEAM-2010, it update the interface to explain SQL query, to link with Pipeline,
so below part is supported:
> {code}
> //prepare environment of BeamSQL
> BeamSQLEnvironment sqlEnv = BeamSQLEnvironment.create();
> //register table metadata
> sqlEnv.addTableMetadata(String tableName, BeamSqlTable tableMetadata);
> //register UDF
> sqlEnv.registerUDF(String functionName, Method udfMethod);
> //explain a SQL statement, SELECT only, and return as a PCollection;
> PCollection<BeamSQLRow> phase1Stream = sqlEnv.explainSQL(pipeline, String sqlStatement);
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message