Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of albertoandreotti@gmail.com
 designates 74.125.82.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CACvfG=q_FVxiK5rD9NL0effGjkLBw5pxx=qF0k4RQAu87TuegQ@mail.gmail.com>
References: 
 <CACvfG=p2h21BnQVY7L=9RCPcgB-JKSygxgM1r=f3iuy1u2UWVg@mail.gmail.com>
	<CACvfG=q_FVxiK5rD9NL0effGjkLBw5pxx=qF0k4RQAu87TuegQ@mail.gmail.com>
Date: Thu, 23 Aug 2012 12:40:18 -0300
Message-ID: 
 <CA+GGe6TZ-6YA5=ykh2T+W130RcQR_LDC_LNDPVK9U_t3eVbE7Q@mail.gmail.com>
Subject: Re: Reg: when failures on writing to DB from map\reduce
From: Alberto Andreotti <albertoandreotti@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d041825da29c79504c7f0addb

--f46d041825da29c79504c7f0addb
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

unsubscribe

On 23 August 2012 12:36, Manoj Babu <manoj444@gmail.com> wrote:

>
> Hi All,
>
> In Sqoop:
> When exporting from HDFS to DB, If an export map task fails due to these
> or other reasons, it will cause the export job to fail. The results of a
> failed export are undefined. Each export map task operates in a separate
> transaction. Furthermore, individual map tasks commit their current
> transaction periodically. If a task fails, the current transaction will b=
e
> rolled back. Any previously-committed transactions will remain durable in
> the database, leading to a partially-complete export.
>
> When using DBOutputFormat in custom map\reduce program:
> When emitting from multiple mappers or reducers and if any one of the
> mapper or reducer got failure only the failed transaction will be rolled
> back Any previously-committed transactions will remain durable in the
> database, leading to a partially-complete export.
>
> Is there any way to commit at last to avoid partially-complete?
>
> Cheers!
> Manoj.
>
>
>


--=20
Jos=E9 Pablo Alberto Andreotti.
Tel: 54 351 4730292
M=F3vil: 54351156526363.
MSN: albertoandreotti@gmail.com
Skype: andreottialberto

--f46d041825da29c79504c7f0addb
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

unsubscribe<br><br><div class=3D"gmail_quote">On 23 August 2012 12:36, Mano=
j Babu <span dir=3D"ltr">&lt;<a href=3D"mailto:manoj444@gmail.com" target=
=3D"_blank">manoj444@gmail.com</a>&gt;</span> wrote:<br><blockquote class=
=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd=
ing-left:1ex">

<div class=3D"gmail_quote"><br><div>Hi All,</div><div><br></div><div>In Sqo=
op:</div><div>When exporting from HDFS to DB,=A0If an export map task fails=
 due to these or other reasons, it will cause the export job to fail. The r=
esults of a failed export are undefined. Each export map task operates in a=
 separate transaction. Furthermore, individual map tasks commit their curre=
nt transaction periodically. If a task fails, the current transaction will =
be rolled back. Any previously-committed transactions will remain durable i=
n the database, leading to a partially-complete export.</div>


<div><br></div><div>When using DBOutputFormat in custom map\reduce program:=
</div><div>When=A0emitting from multiple mappers or reducers and if any one=
 of the mapper or reducer got failure=A0only=A0the failed transaction will =
be rolled back=A0Any previously-committed transactions will remain durable =
in the database, leading to a partially-complete export.</div>


<div><br></div><div>Is there any way to commit=A0at last=A0to avoid=A0parti=
ally-complete?</div><br clear=3D"all">Cheers!<span><font color=3D"#888888">=
<span><font color=3D"#888888"><div>Manoj.</div><br>
</font></span></font></span></div><br>
</blockquote></div><br><br clear=3D"all"><br>-- <br>Jos=E9 Pablo Alberto An=
dreotti.<br>Tel: 54 <a href=3D"tel:351%204730292" value=3D"+13514730292" ta=
rget=3D"_blank">351 4730292</a> <br>M=F3vil: 54351156526363.<br>MSN: <a hre=
f=3D"mailto:albertoandreotti@gmail.com" target=3D"_blank">albertoandreotti@=
gmail.com</a><br>
Skype: andreottialberto<br>


--f46d041825da29c79504c7f0addb--