hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravi Shankar <ravishan...@hcl.com>
Subject File Busy or not check. Kindly Help
Date Tue, 01 May 2012 06:09:31 GMT
Hi All,

I am trying to check that if a file is busy ,i.e. it is still being copied into DFS from Local,
the MR Job should not run if it is, otherwise it should. What I have observed is that if the
file is still being written to DFS, and I call the MR job on it, the job runs (which may include
operations to move the file, and it is successful), after the completion of the MR Job, if
the file is missing, i.e it has been moved by the MR job, the file copying operation throws
an exception of "file does not exist".

I need the MR job to wait until the file is completely copied and then the MR job should run
on it.

Kindly help on this.

Thanks & Regards,
Ravi Shankar,
Cross Functional Services - Solution- Cloud
HCL Technologies Ltd. - Infrastructure Services Division
F 8,9 Sec - III, Noida, India - 201301. Cell - +91 9953696666



The contents of this e-mail and any attachment(s) are confidential and intended for the named
recipient(s) only.
E-mail transmission cannot be guaranteed to be secure or error-free as information could be
intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or contain viruses.The e mail and its contents
(with or without referred
errors) shall therefore not attach any liability on the originator or HCL or its affiliates.
Any views or opinions
presented in this email are solely those of the author and may not necessarily reflect the
opinions of HCL or its
affiliates. Any form of reproduction, dissemination, copying, disclosure, Modification, distribution
and/or publication
of this message without the prior written consent of the author of this e-mail is strictly
prohibited. If you have
received this email in error please delete it and notify the sender immediately. Before opening
any mail and attachments
please check them for viruses and defect.


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message