madlib-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Frank McQuillan <fmcquil...@pivotal.io>
Subject Re: full Python API for MADlib
Date Wed, 28 Dec 2016 03:36:03 GMT
Yes

Sent from my mobile.  Please excuse brevity.

On Dec 27, 2016 6:19 PM, "Fatima Castiglione Maldonado 发" <
castiglionemaldonado@gmail.com> wrote:

> Hi
>
> 1.
> I have installed CentOS 7 and GPDB 4.3.11.
> It works ok and I can run standard SQL examples, no problems.
>
> 2. I am now installing MADlib 1.9.1
>
> "This is an important note for installation of MADlib 1.9.1 on
> GPDB 4.3.10.  It does not apply to any other GPDB releases.
>
> After gppkg installation of MADlib, you must run the script
> fix_madpack.sh BEFORE running the madpack utility."
>
> Should I run this script for 4.3.11 ?
>
> Thanks in advance for any answer.
> Fatima
>
>
> 2016-12-24 0:11 GMT-03:00 Fatima Castiglione Maldonado 发 <
> castiglionemaldonado@gmail.com>:
>
>> > I think forking Pymadlib code and making it work for your use case
>> would be >great first step.
>>
>> Completely d'accord.
>>
>> > I do have thoughts on what Python API for MADlib should ​achieve and
>> how that can be designed, but that's a bigger discussion we can have after
>> we've made initial progress.
>>
>> Yap. Once I can make at least one algorithm to run with 1.9.1, ok? Maybe
>> fixing more than one will be useless, if we plan to change external API...
>> I would probably have to rework all the parameter-tweaking stuff... Boring
>> to make it twice.
>>
>> > An important step in building the API is consistency esp. with external
>> API. For that purpose following scikit-learn's structure would be helpful.
>>
>> That's would be smart. Honestly I did not see it coming, but now that you
>> said it, I agree 100%, as it would make Pymadlib instantly "pluggable" whit
>> what is probably a nice lot of pre-existing code.
>>
>> Will keep you updated.
>>
>>
>>
>>
>>
>> 2016-12-23 20:07 GMT-03:00 Rahul Iyer <rahulriyer@gmail.com>:
>>
>>> ​Hi Fatima,
>>>
>>> Thanks for starting this work.
>>> ​
>>>
>>>> When you get back to work please let me know if you are OK with me
>>>> forking this code base, or if you are thinking to make any important
>>>> changes.
>>>>
>>>> ​I think forking Pymadlib code and making it work for your use case
>>> would be great first step. I do have thoughts on what Python API for MADlib
>>> should ​achieve and how that can be designed, but that's a bigger
>>> discussion we can have after we've made initial progress.
>>>
>>> An important step in building the API is consistency esp. with external
>>> API. For that purpose following scikit-learn's structure would be helpful.
>>> We can go over specifics after initial progress.
>>>
>>>
>>>> Am also watching the videos so I get more familiar with available
>>>> algorithms.
>>>> In my next available time slot will install it all so am ready to start.
>>>>
>>>
>>> ​The videos + getting ​Pymadlib to work are the right goals to start
>>> with. Feel free to let this forum know about progress and questions.
>>>
>>> Best,
>>> Rahul
>>> ​
>>>
>>>> 2016-12-22 17:49 GMT-03:00 Fatima Castiglione Maldonado 发 <
>>>> castiglionemaldonado@gmail.com>:
>>>>
>>>>> Great, thanks. We will check it once I read a bit more and then we can
>>>>> talk.
>>>>>
>>>>> 2016-12-22 17:28 GMT-03:00 Frank McQuillan <fmcquillan@pivotal.io>:
>>>>>
>>>>>> This is an early attempt at a Python interface for MADlib
>>>>>> https://github.com/pivotalsoftware/pymadlib
>>>>>> but I would say it is preliminary in nature and we may want to take
a
>>>>>> different approach.
>>>>>>
>>>>>> @riyer can provide more details on this.
>>>>>>
>>>>>> Frank
>>>>>>
>>>>>>
>>>>>> On Thu, Dec 22, 2016 at 12:02 PM, Fatima Castiglione Maldonado 发
<
>>>>>> castiglionemaldonado@gmail.com> wrote:
>>>>>>
>>>>>>> I am reading documentation:
>>>>>>>
>>>>>>> Apache MADlib (Incubating)
>>>>>>> Created by Gavin, last modified by Frank McQuillan on Sep 13,
2016
>>>>>>> https://cwiki.apache.org/confluence/pages/viewpage.action?pa
>>>>>>> geId=61319606
>>>>>>>
>>>>>>> and watching videos:
>>>>>>>
>>>>>>> Pivotal Open Source Hub - Watch!
>>>>>>> https://www.youtube.com/channel/UCLQV6NlSaIZBGym1mEczuqQ
>>>>>>>
>>>>>>> This should take me a few days.
>>>>>>> If there is other relevant material please let me know.
>>>>>>>
>>>>>>> Best,
>>>>>>> Fatima
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> 2016-12-20 23:00 GMT-03:00 Fatima Castiglione Maldonado 发 <
>>>>>>> castiglionemaldonado@gmail.com>:
>>>>>>>
>>>>>>>> Hi Frank,
>>>>>>>>
>>>>>>>> thanks for your kind answer. Yeah, just yesterday night I
saw the
>>>>>>>> user's survey results, plus today I read some "top ten python
APIs" doc and
>>>>>>>> MADlib was not there, so two plus two four.
>>>>>>>>
>>>>>>>> I would like to use the python API in a POC. My main expertise
is
>>>>>>>> coding, so would probably need some help with architecture
design.
>>>>>>>>
>>>>>>>> Best,
>>>>>>>> Fatima
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> 2016-12-20 22:54 GMT-03:00 Frank McQuillan <fmcquillan@pivotal.io>:
>>>>>>>>
>>>>>>>>> Hi Fatima,
>>>>>>>>>
>>>>>>>>> Thank you for your email and offer to participate.
>>>>>>>>>
>>>>>>>>> A Python API for MADlib is something that a lot of people
have
>>>>>>>>> been asking for.  In the recent MADlib survey, it was
one of the top
>>>>>>>>> requests.
>>>>>>>>>
>>>>>>>>> There is already an R interface
>>>>>>>>> https://cran.r-project.org/web/packages/PivotalR/
>>>>>>>>> which could be a model for how to approach the Python
interface.
>>>>>>>>>
>>>>>>>>> There have been some prototyping done, but the feature
is a new
>>>>>>>>> one for Python API.
>>>>>>>>>
>>>>>>>>> But before we get into details, would you be able to
say a little
>>>>>>>>> bit about your planned use for the Python API.  Also,
what aspect would you
>>>>>>>>> be interested in working on? - architecture, core software
development,
>>>>>>>>> testing, etc.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Frank
>>>>>>>>>
>>>>>>>>> On Tue, Dec 20, 2016 at 1:28 PM, Fatima Castiglione Maldonado
发 <
>>>>>>>>> castiglionemaldonado@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> does anybody know how to participate in the "full
Python API for
>>>>>>>>>> MADlib" effort? I would like to give a helping hand.
>>>>>>>>>>
>>>>>>>>>> Best,
>>>>>>>>>> Fatima
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> =================================
>>>>>>>>>> Fátima Castiglione Maldonado
>>>>>>>>>> Singer, Designer, Creative, Artificial Intelligence
>>>>>>>>>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>>>>>>>>>> castiglionemaldonado@gmail.com
>>>>>>>>>>
>>>>>>>>>>                      ____
>>>>>>>>>>                    ,'_   |
>>>>>>>>>>  __________________|__|__|__
>>>>>>>>>> <_____                      )                _.------._
>>>>>>>>>>       `-----------,------.-'              ,-'   
      `-.
>>>>>>>>>>                  |    |  |              ,'      
         `.
>>>>>>>>>>                 ,'    |  |            ,'        
           `.
>>>>>>>>>>                 |  _,-'  |__         /          
             \
>>>>>>>>>>               _,'-'    `.   `---.___|_____________
            \
>>>>>>>>>>           .--'  -----.  | _____________________ 
 `-. -----     |
>>>>>>>>>>           |    ___|  |  |                      \
 ,- \          |
>>>>>>>>>>           |    ___|  |===========================((|)
|         |
>>>>>>>>>>           |       |  |  | _____________________/
 `- /          |
>>>>>>>>>>           `--._ -----'  |        _________________,-'
-----     |
>>>>>>>>>>                `.-._   ,' __.---'   |           
              /
>>>>>>>>>>                 |   `-.  |           \          
             /
>>>>>>>>>>                 `.    |  |            `.        
           ,'
>>>>>>>>>>                  |    |  |              `.      
         ,'
>>>>>>>>>>  _____,----------`-------`-.              `-._  
     _,-'
>>>>>>>>>> <___________________________)                
`------'
>>>>>>>>>>                    | _|  |
>>>>>>>>>>                    `.____|
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> =================================
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> =================================
>>>>>>>> Fátima Castiglione Maldonado
>>>>>>>> Singer, Designer, Creative, Artificial Intelligence
>>>>>>>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>>>>>>>> castiglionemaldonado@gmail.com
>>>>>>>>
>>>>>>>>                      ____
>>>>>>>>                    ,'_   |
>>>>>>>>  __________________|__|__|__
>>>>>>>> <_____                      )                _.------._
>>>>>>>>       `-----------,------.-'              ,-'          `-.
>>>>>>>>                  |    |  |              ,'              
 `.
>>>>>>>>                 ,'    |  |            ,'                
   `.
>>>>>>>>                 |  _,-'  |__         /                  
     \
>>>>>>>>               _,'-'    `.   `---.___|_____________      
      \
>>>>>>>>           .--'  -----.  | _____________________   `-. -----
    |
>>>>>>>>           |    ___|  |  |                      \  ,- \  
       |
>>>>>>>>           |    ___|  |===========================((|) | 
       |
>>>>>>>>           |       |  |  | _____________________/  `- /  
       |
>>>>>>>>           `--._ -----'  |        _________________,-' -----
    |
>>>>>>>>                `.-._   ,' __.---'   |                   
      /
>>>>>>>>                 |   `-.  |           \                  
     /
>>>>>>>>                 `.    |  |            `.                
   ,'
>>>>>>>>                  |    |  |              `.              
 ,'
>>>>>>>>  _____,----------`-------`-.              `-._        _,-'
>>>>>>>> <___________________________)                 `------'
>>>>>>>>                    | _|  |
>>>>>>>>                    `.____|
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> =================================
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> =================================
>>>>>>> Fátima Castiglione Maldonado
>>>>>>> Singer, Designer, Creative, Artificial Intelligence
>>>>>>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>>>>>>> castiglionemaldonado@gmail.com
>>>>>>>
>>>>>>>                      ____
>>>>>>>                    ,'_   |
>>>>>>>  __________________|__|__|__
>>>>>>> <_____                      )                _.------._
>>>>>>>       `-----------,------.-'              ,-'          `-.
>>>>>>>                  |    |  |              ,'                `.
>>>>>>>                 ,'    |  |            ,'                    `.
>>>>>>>                 |  _,-'  |__         /                      
 \
>>>>>>>               _,'-'    `.   `---.___|_____________          
  \
>>>>>>>           .--'  -----.  | _____________________   `-. ----- 
   |
>>>>>>>           |    ___|  |  |                      \  ,- \      
   |
>>>>>>>           |    ___|  |===========================((|) |     
   |
>>>>>>>           |       |  |  | _____________________/  `- /      
   |
>>>>>>>           `--._ -----'  |        _________________,-' ----- 
   |
>>>>>>>                `.-._   ,' __.---'   |                       
  /
>>>>>>>                 |   `-.  |           \                      
 /
>>>>>>>                 `.    |  |            `.                    ,'
>>>>>>>                  |    |  |              `.                ,'
>>>>>>>  _____,----------`-------`-.              `-._        _,-'
>>>>>>> <___________________________)                 `------'
>>>>>>>                    | _|  |
>>>>>>>                    `.____|
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> =================================
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> =================================
>>>>> Fátima Castiglione Maldonado
>>>>> Singer, Designer, Creative, Artificial Intelligence
>>>>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>>>>> castiglionemaldonado@gmail.com
>>>>>
>>>>>                      ____
>>>>>                    ,'_   |
>>>>>  __________________|__|__|__
>>>>> <_____                      )                _.------._
>>>>>       `-----------,------.-'              ,-'          `-.
>>>>>                  |    |  |              ,'                `.
>>>>>                 ,'    |  |            ,'                    `.
>>>>>                 |  _,-'  |__         /                        \
>>>>>               _,'-'    `.   `---.___|_____________             \
>>>>>           .--'  -----.  | _____________________   `-. -----     |
>>>>>           |    ___|  |  |                      \  ,- \          |
>>>>>           |    ___|  |===========================((|) |         |
>>>>>           |       |  |  | _____________________/  `- /          |
>>>>>           `--._ -----'  |        _________________,-' -----     |
>>>>>                `.-._   ,' __.---'   |                          /
>>>>>                 |   `-.  |           \                        /
>>>>>                 `.    |  |            `.                    ,'
>>>>>                  |    |  |              `.                ,'
>>>>>  _____,----------`-------`-.              `-._        _,-'
>>>>> <___________________________)                 `------'
>>>>>                    | _|  |
>>>>>                    `.____|
>>>>>
>>>>>
>>>>>
>>>>> =================================
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> =================================
>>>> Fátima Castiglione Maldonado
>>>> Singer, Designer, Creative, Artificial Intelligence
>>>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>>>> castiglionemaldonado@gmail.com
>>>>
>>>>                      ____
>>>>                    ,'_   |
>>>>  __________________|__|__|__
>>>> <_____                      )                _.------._
>>>>       `-----------,------.-'              ,-'          `-.
>>>>                  |    |  |              ,'                `.
>>>>                 ,'    |  |            ,'                    `.
>>>>                 |  _,-'  |__         /                        \
>>>>               _,'-'    `.   `---.___|_____________             \
>>>>           .--'  -----.  | _____________________   `-. -----     |
>>>>           |    ___|  |  |                      \  ,- \          |
>>>>           |    ___|  |===========================((|) |         |
>>>>           |       |  |  | _____________________/  `- /          |
>>>>           `--._ -----'  |        _________________,-' -----     |
>>>>                `.-._   ,' __.---'   |                          /
>>>>                 |   `-.  |           \                        /
>>>>                 `.    |  |            `.                    ,'
>>>>                  |    |  |              `.                ,'
>>>>  _____,----------`-------`-.              `-._        _,-'
>>>> <___________________________)                 `------'
>>>>                    | _|  |
>>>>                    `.____|
>>>>
>>>>
>>>>
>>>> =================================
>>>>
>>>
>>>
>>
>>
>> --
>> =================================
>> Fátima Castiglione Maldonado
>> Singer, Designer, Creative, Artificial Intelligence
>> Cantante, Diseñadora, Creativa, Inteligencia Artificial
>> castiglionemaldonado@gmail.com
>>
>>                      ____
>>                    ,'_   |
>>  __________________|__|__|__
>> <_____                      )                _.------._
>>       `-----------,------.-'              ,-'          `-.
>>                  |    |  |              ,'                `.
>>                 ,'    |  |            ,'                    `.
>>                 |  _,-'  |__         /                        \
>>               _,'-'    `.   `---.___|_____________             \
>>           .--'  -----.  | _____________________   `-. -----     |
>>           |    ___|  |  |                      \  ,- \          |
>>           |    ___|  |===========================((|) |         |
>>           |       |  |  | _____________________/  `- /          |
>>           `--._ -----'  |        _________________,-' -----     |
>>                `.-._   ,' __.---'   |                          /
>>                 |   `-.  |           \                        /
>>                 `.    |  |            `.                    ,'
>>                  |    |  |              `.                ,'
>>  _____,----------`-------`-.              `-._        _,-'
>> <___________________________)                 `------'
>>                    | _|  |
>>                    `.____|
>>
>>
>>
>> =================================
>>
>
>
>
> --
> =================================
> Fátima Castiglione Maldonado
> Singer, Designer, Creative, Artificial Intelligence
> Cantante, Diseñadora, Creativa, Inteligencia Artificial
> castiglionemaldonado@gmail.com
>
>                      ____
>                    ,'_   |
>  __________________|__|__|__
> <_____                      )                _.------._
>       `-----------,------.-'              ,-'          `-.
>                  |    |  |              ,'                `.
>                 ,'    |  |            ,'                    `.
>                 |  _,-'  |__         /                        \
>               _,'-'    `.   `---.___|_____________             \
>           .--'  -----.  | _____________________   `-. -----     |
>           |    ___|  |  |                      \  ,- \          |
>           |    ___|  |===========================((|) |         |
>           |       |  |  | _____________________/  `- /          |
>           `--._ -----'  |        _________________,-' -----     |
>                `.-._   ,' __.---'   |                          /
>                 |   `-.  |           \                        /
>                 `.    |  |            `.                    ,'
>                  |    |  |              `.                ,'
>  _____,----------`-------`-.              `-._        _,-'
> <___________________________)                 `------'
>                    | _|  |
>                    `.____|
>
>
>
> =================================
>
> while( love & passion ) {
>   for( fight = 0 ; rights < freedom ; rights++ )
>     fight = standup( rights );
>   free( babylon );
> }
> =================================
>
>
>

Mime
View raw message