hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohammad Tariq <donta...@gmail.com>
Subject Re: Loading data in hdfs
Date Thu, 19 Jul 2012 11:21:53 GMT
By looking at the csv, I would suggest to create an hbase table, say
'IPINFO' with one column family, say 'cf' having 3 columns for
'startip', 'endip' and 'countryname' respectively.

Regards,
    Mohammad Tariq


On Thu, Jul 19, 2012 at 4:44 PM, Mohammad Tariq <dontariq@gmail.com> wrote:
> You have a few options. You can write a java program using Hbase API
> to do that. But you won't be able to exploit the parallelism to its
> fullest. Another option is to write a MapReduce program to do the
> same. You can also use Hive and Pig to serve the purpose. But if you
> are just starting with Hbase, then I would suggest to first get
> yourself familiar with Hbase API first and then go for other things.
>
> Regards,
>     Mohammad Tariq
>
>
> On Thu, Jul 19, 2012 at 4:12 PM, iwannaplay games
> <funnlearnforkids@gmail.com> wrote:
>> PFA the csv file
>>
>> Thanks
>> Prabhjot
>>
>>
>> On 7/19/12, Mohammad Tariq <dontariq@gmail.com> wrote:
>>> Could you show me the structure of your csv, if possible??
>>>
>>> Regards,
>>>     Mohammad Tariq
>>>
>>>
>>> On Thu, Jul 19, 2012 at 4:03 PM, iwannaplay games
>>> <funnlearnforkids@gmail.com> wrote:
>>>> Thanks Tariq
>>>>
>>>> Now i want to convert  this csv file to table.(HBase table with column
>>>> families)
>>>> How can i do that
>>>>
>>>> Regards
>>>> Prabhjot
>>>>
>>>>
>>>> On 7/19/12, Mohammad Tariq <dontariq@gmail.com> wrote:
>>>>> Hi Prabhjot
>>>>>
>>>>>       You can also use :
>>>>> hadoop fs -put <src fs path> <destn hdfs path>
>>>>>
>>>>> Regards,
>>>>>     Mohammad Tariq
>>>>>
>>>>>
>>>>> On Thu, Jul 19, 2012 at 3:52 PM, Bejoy Ks <bejoy.hadoop@gmail.com>
>>>>> wrote:
>>>>>> Hi Prabhjot
>>>>>>
>>>>>> Yes, Just use the filesystem commands
>>>>>> hadoop fs -copyFromLocal <src fs path> <destn hdfs path>
>>>>>>
>>>>>> Regards
>>>>>> Bejoy KS
>>>>>>
>>>>>> On Thu, Jul 19, 2012 at 3:49 PM, iwannaplay games
>>>>>> <funnlearnforkids@gmail.com> wrote:
>>>>>>> Hi,
>>>>>>>
>>>>>>> I am unable to use sqoop and want to load data in hdfs for testing,
>>>>>>> Is there any way by which i can load my csv or text  file to
hadoop
>>>>>>> file system directly without writing code in java
>>>>>>>
>>>>>>> Regards
>>>>>>> Prabhjot
>>>>>
>>>

Mime
View raw message