streams-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 宿荣全 (JIRA) <j...@apache.org>
Subject [jira] [Created] (STREAMS-253) Print the specified number of data and handle all of the elements in RDD
Date Wed, 10 Dec 2014 10:34:12 GMT
宿荣全 created STREAMS-253:
---------------------------

             Summary: Print the specified number of data and handle all of the elements in
RDD
                 Key: STREAMS-253
                 URL: https://issues.apache.org/jira/browse/STREAMS-253
             Project: Streams
          Issue Type: New Feature
            Reporter: 宿荣全
            Priority: Minor


Dstream.print function:Print 10 elements and handle 11 elements.
A new function based on Dstream.print function is presented:
the new function:
Print the specified number of data and handle all of the elements in RDD.
there is a work scene:
val dstream = stream.map->filter->mapPartitions->print
the data after filter need update database in mapPartitions,but don't need print each data,only
need to print the top 20 for view the data processing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message