spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bago Amirbekian <b...@databricks.com>
Subject Re: HashingTFModel/IDFModel in Structured Streaming
Date Wed, 01 Nov 2017 23:42:52 GMT
Davis I'm looking into this. If you could include some code that I can use
to reproduce the error & the stack trace it would be really helpful.

On Fri, Oct 20, 2017 at 11:01 AM Joseph Bradley <joseph@databricks.com>
wrote:

> Hi Davis,
> We've started tracking these issues under this umbrella:
> https://issues.apache.org/jira/browse/SPARK-21926
> I'm hoping we can fix some of these for 2.3.
> Thanks,
> Joseph
>
> On Mon, Oct 16, 2017 at 9:23 PM, Davis Varghese <verghesd@gmail.com>
> wrote:
>
>>  I have built a ML pipeline model on a static twitter data for sentiment
>> analysis. When I use the model on a structured stream, it always throws
>> "Queries with streaming sources must be executed with
>> writeStream.start()".
>> This particular model doesn't contain any documented "unsupported"
>> operations. It only calls the transform() method of the stages. Anyone
>> have
>> encountered the issue? if the model doesn't contain
>> HashingTFModel/IDFModel,
>> it works fine, but then I can not create feature vectors from the tweet.
>>
>> Thanks,
>> Davis
>>
>>
>>
>> --
>> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>
>>
>
>
> --
>
> Joseph Bradley
>
> Software Engineer - Machine Learning
>
> Databricks, Inc.
>
> [image: http://databricks.com] <http://databricks.com/>
>

Mime
View raw message