flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Krishnanand Khambadkone <kkhambadk...@yahoo.com>
Subject part files written to HDFS with .pending extension
Date Fri, 01 Sep 2017 23:48:55 GMT
Hi,  I have written a small program that uses a Twitter input stream and a HDFS output sink.
  When the files are written to HDFS each part file in the directory has a .pending extension.
 I am able to cat the file and see the tweet text.  Is this normal for the part files to
have .pending extension.

-rw-r--r--   3 user  supergroup      46399 2017-09-01 16:35 /flinktwitter/2017-09-01--1635/_part-0-95.pending

-rw-r--r--   3 user supergroup      54861 2017-09-01 16:35 /flinktwitter/2017-09-01--1635/_part-0-96.pending

-rw-r--r--   3 user supergroup      41878 2017-09-01 16:35 /flinktwitter/2017-09-01--1635/_part-0-97.pending

-rw-r--r--   3  user supergroup      42813 2017-09-01 16:35 /flinktwitter/2017-09-01--1635/_part-0-98.pending

-rw-r--r--   3  user supergroup      42887 2017-09-01 16:35 /flinktwitter/2017-09-01--1635/_part-0-99.pending


Mime
View raw message