madlib-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rahul Iyer <rahulri...@gmail.com>
Subject Re: full Python API for MADlib
Date Fri, 23 Dec 2016 23:07:20 GMT
​Hi Fatima,

Thanks for starting this work.
​

> When you get back to work please let me know if you are OK with me forking
> this code base, or if you are thinking to make any important changes.
>
> ​I think forking Pymadlib code and making it work for your use case would
be great first step. I do have thoughts on what Python API for MADlib
should ​achieve and how that can be designed, but that's a bigger
discussion we can have after we've made initial progress.

An important step in building the API is consistency esp. with external
API. For that purpose following scikit-learn's structure would be helpful.
We can go over specifics after initial progress.


> Am also watching the videos so I get more familiar with available
> algorithms.
> In my next available time slot will install it all so am ready to start.
>

​The videos + getting ​Pymadlib to work are the right goals to start with.
Feel free to let this forum know about progress and questions.

Best,
Rahul
​

> 2016-12-22 17:49 GMT-03:00 Fatima Castiglione Maldonado 发 <
> castiglionemaldonado@gmail.com>:
>
>> Great, thanks. We will check it once I read a bit more and then we can
>> talk.
>>
>> 2016-12-22 17:28 GMT-03:00 Frank McQuillan <fmcquillan@pivotal.io>:
>>
>>> This is an early attempt at a Python interface for MADlib
>>> https://github.com/pivotalsoftware/pymadlib
>>> but I would say it is preliminary in nature and we may want to take a
>>> different approach.
>>>
>>> @riyer can provide more details on this.
>>>
>>> Frank
>>>
>>>
>>> On Thu, Dec 22, 2016 at 12:02 PM, Fatima Castiglione Maldonado 发 <
>>> castiglionemaldonado@gmail.com> wrote:
>>>
>>>> I am reading documentation:
>>>>
>>>> Apache MADlib (Incubating)
>>>> Created by Gavin, last modified by Frank McQuillan on Sep 13, 2016
>>>> https://cwiki.apache.org/confluence/pages/viewpage.action?pa
>>>> geId=61319606
>>>>
>>>> and watching videos:
>>>>
>>>> Pivotal Open Source Hub - Watch!
>>>> https://www.youtube.com/channel/UCLQV6NlSaIZBGym1mEczuqQ
>>>>
>>>> This should take me a few days.
>>>> If there is other relevant material please let me know.
>>>>
>>>> Best,
>>>> Fatima
>>>>
>>>>
>>>>
>>>>
>>>> 2016-12-20 23:00 GMT-03:00 Fatima Castiglione Maldonado 发 <
>>>> castiglionemaldonado@gmail.com>:
>>>>
>>>>> Hi Frank,
>>>>>
>>>>> thanks for your kind answer. Yeah, just yesterday night I saw the
>>>>> user's survey results, plus today I read some "top ten python APIs" doc
and
>>>>> MADlib was not there, so two plus two four.
>>>>>
>>>>> I would like to use the python API in a POC. My main expertise is
>>>>> coding, so would probably need some help with architecture design.
>>>>>
>>>>> Best,
>>>>> Fatima
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> 2016-12-20 22:54 GMT-03:00 Frank McQuillan <fmcquillan@pivotal.io>:
>>>>>
>>>>>> Hi Fatima,
>>>>>>
>>>>>> Thank you for your email and offer to participate.
>>>>>>
>>>>>> A Python API for MADlib is something that a lot of people have been
>>>>>> asking for.  In the recent MADlib survey, it was one of the top requests.
>>>>>>
>>>>>> There is already an R interface
>>>>>> https://cran.r-project.org/web/packages/PivotalR/
>>>>>> which could be a model for how to approach the Python interface.
>>>>>>
>>>>>> There have been some prototyping done, but the feature is a new one
>>>>>> for Python API.
>>>>>>
>>>>>> But before we get into details, would you be able to say a little
bit
>>>>>> about your planned use for the Python API.  Also, what aspect would
you be
>>>>>> interested in working on? - architecture, core software development,
>>>>>> testing, etc.
>>>>>>
>>>>>> Regards,
>>>>>> Frank
>>>>>>
>>>>>> On Tue, Dec 20, 2016 at 1:28 PM, Fatima Castiglione Maldonado 发
<
>>>>>> castiglionemaldonado@gmail.com> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> does anybody know how to participate in the "full Python API
for
>>>>>>> MADlib" effort? I would like to give a helping hand.
>>>>>>>
>>>>>>> Best,
>>>>>>> Fatima
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> =================================
>>>>>>> Fátima Castiglione Maldonado
>>>>>>> Singer, Designer, Creative, Artificial Intelligence
>>>>>>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>>>>>>> castiglionemaldonado@gmail.com
>>>>>>>
>>>>>>>                      ____
>>>>>>>                    ,'_   |
>>>>>>>  __________________|__|__|__
>>>>>>> <_____                      )                _.------._
>>>>>>>       `-----------,------.-'              ,-'          `-.
>>>>>>>                  |    |  |              ,'                `.
>>>>>>>                 ,'    |  |            ,'                    `.
>>>>>>>                 |  _,-'  |__         /                      
 \
>>>>>>>               _,'-'    `.   `---.___|_____________          
  \
>>>>>>>           .--'  -----.  | _____________________   `-. ----- 
   |
>>>>>>>           |    ___|  |  |                      \  ,- \      
   |
>>>>>>>           |    ___|  |===========================((|) |     
   |
>>>>>>>           |       |  |  | _____________________/  `- /      
   |
>>>>>>>           `--._ -----'  |        _________________,-' ----- 
   |
>>>>>>>                `.-._   ,' __.---'   |                       
  /
>>>>>>>                 |   `-.  |           \                      
 /
>>>>>>>                 `.    |  |            `.                    ,'
>>>>>>>                  |    |  |              `.                ,'
>>>>>>>  _____,----------`-------`-.              `-._        _,-'
>>>>>>> <___________________________)                 `------'
>>>>>>>                    | _|  |
>>>>>>>                    `.____|
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> =================================
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> =================================
>>>>> Fátima Castiglione Maldonado
>>>>> Singer, Designer, Creative, Artificial Intelligence
>>>>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>>>>> castiglionemaldonado@gmail.com
>>>>>
>>>>>                      ____
>>>>>                    ,'_   |
>>>>>  __________________|__|__|__
>>>>> <_____                      )                _.------._
>>>>>       `-----------,------.-'              ,-'          `-.
>>>>>                  |    |  |              ,'                `.
>>>>>                 ,'    |  |            ,'                    `.
>>>>>                 |  _,-'  |__         /                        \
>>>>>               _,'-'    `.   `---.___|_____________             \
>>>>>           .--'  -----.  | _____________________   `-. -----     |
>>>>>           |    ___|  |  |                      \  ,- \          |
>>>>>           |    ___|  |===========================((|) |         |
>>>>>           |       |  |  | _____________________/  `- /          |
>>>>>           `--._ -----'  |        _________________,-' -----     |
>>>>>                `.-._   ,' __.---'   |                          /
>>>>>                 |   `-.  |           \                        /
>>>>>                 `.    |  |            `.                    ,'
>>>>>                  |    |  |              `.                ,'
>>>>>  _____,----------`-------`-.              `-._        _,-'
>>>>> <___________________________)                 `------'
>>>>>                    | _|  |
>>>>>                    `.____|
>>>>>
>>>>>
>>>>>
>>>>> =================================
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> =================================
>>>> Fátima Castiglione Maldonado
>>>> Singer, Designer, Creative, Artificial Intelligence
>>>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>>>> castiglionemaldonado@gmail.com
>>>>
>>>>                      ____
>>>>                    ,'_   |
>>>>  __________________|__|__|__
>>>> <_____                      )                _.------._
>>>>       `-----------,------.-'              ,-'          `-.
>>>>                  |    |  |              ,'                `.
>>>>                 ,'    |  |            ,'                    `.
>>>>                 |  _,-'  |__         /                        \
>>>>               _,'-'    `.   `---.___|_____________             \
>>>>           .--'  -----.  | _____________________   `-. -----     |
>>>>           |    ___|  |  |                      \  ,- \          |
>>>>           |    ___|  |===========================((|) |         |
>>>>           |       |  |  | _____________________/  `- /          |
>>>>           `--._ -----'  |        _________________,-' -----     |
>>>>                `.-._   ,' __.---'   |                          /
>>>>                 |   `-.  |           \                        /
>>>>                 `.    |  |            `.                    ,'
>>>>                  |    |  |              `.                ,'
>>>>  _____,----------`-------`-.              `-._        _,-'
>>>> <___________________________)                 `------'
>>>>                    | _|  |
>>>>                    `.____|
>>>>
>>>>
>>>>
>>>> =================================
>>>>
>>>
>>>
>>
>>
>> --
>> =================================
>> Fátima Castiglione Maldonado
>> Singer, Designer, Creative, Artificial Intelligence
>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>> castiglionemaldonado@gmail.com
>>
>>                      ____
>>                    ,'_   |
>>  __________________|__|__|__
>> <_____                      )                _.------._
>>       `-----------,------.-'              ,-'          `-.
>>                  |    |  |              ,'                `.
>>                 ,'    |  |            ,'                    `.
>>                 |  _,-'  |__         /                        \
>>               _,'-'    `.   `---.___|_____________             \
>>           .--'  -----.  | _____________________   `-. -----     |
>>           |    ___|  |  |                      \  ,- \          |
>>           |    ___|  |===========================((|) |         |
>>           |       |  |  | _____________________/  `- /          |
>>           `--._ -----'  |        _________________,-' -----     |
>>                `.-._   ,' __.---'   |                          /
>>                 |   `-.  |           \                        /
>>                 `.    |  |            `.                    ,'
>>                  |    |  |              `.                ,'
>>  _____,----------`-------`-.              `-._        _,-'
>> <___________________________)                 `------'
>>                    | _|  |
>>                    `.____|
>>
>>
>>
>> =================================
>>
>
>
>
> --
> =================================
> Fátima Castiglione Maldonado
> Singer, Designer, Creative, Artificial Intelligence
> Cantante, Diseñadora, Creativa, Inteligencia Artificial
> castiglionemaldonado@gmail.com
>
>                      ____
>                    ,'_   |
>  __________________|__|__|__
> <_____                      )                _.------._
>       `-----------,------.-'              ,-'          `-.
>                  |    |  |              ,'                `.
>                 ,'    |  |            ,'                    `.
>                 |  _,-'  |__         /                        \
>               _,'-'    `.   `---.___|_____________             \
>           .--'  -----.  | _____________________   `-. -----     |
>           |    ___|  |  |                      \  ,- \          |
>           |    ___|  |===========================((|) |         |
>           |       |  |  | _____________________/  `- /          |
>           `--._ -----'  |        _________________,-' -----     |
>                `.-._   ,' __.---'   |                          /
>                 |   `-.  |           \                        /
>                 `.    |  |            `.                    ,'
>                  |    |  |              `.                ,'
>  _____,----------`-------`-.              `-._        _,-'
> <___________________________)                 `------'
>                    | _|  |
>                    `.____|
>
>
>
> =================================
>

Mime
View raw message