Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates
 209.85.210.41 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAKJYuqGoMM0uDS-8Ep+xFAeAjL3cs-q02egGJi-Uhz=A3_S3Vg@mail.gmail.com>
References: 
 <CAKJYuqGoMM0uDS-8Ep+xFAeAjL3cs-q02egGJi-Uhz=A3_S3Vg@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Tue, 19 Jun 2012 21:43:13 +0530
Message-ID: 
 <CAOcnVr008F5x7FUfnDXkTOp4kDT1KD1cFDFt-8fu_vSCcx4OZA@mail.gmail.com>
Subject: Re: HBase bulk importtsv - Bad lines error
To: user@hbase.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi,

Can you also share how exactly you invoke the import-tsv command?

On Tue, Jun 19, 2012 at 9:02 PM, AnandaVelMurugan Chandra Mohan
<ananthu2050@gmail.com> wrote:
> Hi,
>
> I am trying to use importtsv map-reduce job to load data into HBase.
>
> I am creating TSV file after fetching data from MySQL DB using the
> following java code.
>
> But Hadoop complains that my TSV file has bad lines and no data is being
> imported into HBase
>
> Am i doing something wrong here? Any inputs would be greatly appreciated.
>
> public class MySQLTest {
>
> =A0 =A0public static void main(String[] args) {
>
> =A0 =A0 =A0 =A0String jdbcURL =3D "jdbc:mysql://199.65.32.78/Report";
> =A0 =A0 =A0 =A0String dbClass =3D "org.gjt.mm.mysql.Driver";
> =A0 =A0 =A0 =A0String user=3D"user";
> =A0 =A0 =A0 =A0String passwd=3D"password^";
> =A0 =A0 =A0 =A0String query =3D "Select
> reports.report_ID,reports.report_path,reports.report_time FROM reports";
> =A0 =A0 =A0 =A0try {
> =A0 =A0 =A0 =A0 =A0 =A0File f =3D new File("./XYZ.tsv");
> =A0 =A0 =A0 =A0 =A0 =A0f.createNewFile();
> =A0 =A0 =A0 =A0 =A0 =A0FileOutputStream fos =3D new FileOutputStream(f);
> =A0 =A0 =A0 =A0 =A0 =A0Class.forName(dbClass);
> =A0 =A0 =A0 =A0 =A0 =A0Connection con =3D (Connection) DriverManager.getC=
onnection
> (jdbcURL,user,passwd);
> =A0 =A0 =A0 =A0 =A0 =A0java.sql.Statement stmt =3D con.createStatement();
> =A0 =A0 =A0 =A0 =A0 =A0java.sql.ResultSet rs =3D stmt.executeQuery(query)=
;
> =A0 =A0 =A0 =A0 =A0 =A0while (rs.next()) {
>
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0//report id
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0fos.write(String.valueOf(rs.getInt(1)).get=
Bytes());
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0fos.write("\t".getBytes());
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0System.out.println(rs.getInt(1));
>
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0//report path
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0fos.write(rs.getString(2).getBytes());
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0fos.write("\t".getBytes());
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0System.out.println(rs.getString(2));
>
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0//report time
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0fos.write(rs.getString(3).getBytes());
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0fos.write("\t".getBytes());
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0System.out.println(rs.getString(3));
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0fos.write("\n".getBytes());
>
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0} //end while
> =A0 =A0 =A0 =A0 =A0 =A0fos.close();
> =A0 =A0 =A0 =A0 =A0 =A0con.close();
> =A0 =A0 =A0 =A0} catch (ClassNotFoundException e) {
> =A0 =A0 =A0 =A0 =A0 =A0// TODO Auto-generated catch block
> =A0 =A0 =A0 =A0 =A0 =A0e.printStackTrace();
> =A0 =A0 =A0 =A0} catch (SQLException e) {
> =A0 =A0 =A0 =A0 =A0 =A0// TODO Auto-generated catch block
> =A0 =A0 =A0 =A0 =A0 =A0e.printStackTrace();
> =A0 =A0 =A0 =A0} catch (IOException e) {
> =A0 =A0 =A0 =A0 =A0 =A0// TODO Auto-generated catch block
> =A0 =A0 =A0 =A0 =A0 =A0e.printStackTrace();
> =A0 =A0 =A0 =A0}
>
> =A0 =A0}
> }
> --
> Regards,
> Anand


--=20
Harsh J