madlib-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [madlib] Advitya17 commented on pull request #518: DL: [AutoML] Add support for Hyperopt on top of MOP for MPP + AutoML best-so-far
Date Mon, 12 Oct 2020 23:45:11 GMT

Advitya17 commented on pull request #518:
URL: https://github.com/apache/madlib/pull/518#issuecomment-707399640


   >  mst_key |                 metrics_elapsed_time                 
   > ---------+------------------------------------------------------
   >        1 | {627.882262945175,1264.80915999413,1896.74943590164}
   >        2 | {614.573877811432,1251.1022670269,1883.14707994461}
   >        3 | {638.407788038254,1286.73397421837,1939.58357810974}
   >        4 | {624.925609111786,1273.55782914162,1925.82674407959}
   >        5 | {650.984225034714,1307.78145503998,1962.8148560524}
   >        6 | {637.914520978928,1294.23532605171,1949.12843108177}
   >        7 | {651.188719987869,1301.32990193367,1948.88206887245}
   >        8 | {637.525157928467,1288.19901585579,1935.65923500061}
   >        9 | {651.277820110321,1301.09531402588,1947.13559818268}
   >       10 | {637.898158073425,1287.54387116432,1933.5972070694}
   >       11 | {650.482151985168,1309.5760037899,1961.18471598625}
   >       12 | {637.149097919464,1295.67461585999,1947.66235399246}
   >       13 | {651.543440818787,1299.3868060112,1948.78301692009}
   >       14 | {638.292811870575,1285.66767001152,1935.02927088737}
   >       15 | {650.077238082886,1305.37611913681,1962.8950419426}
   >       16 | {636.498329162598,1291.3173930645,1948.41972708702}
   >       17 | {649.946799993515,1303.33863401413,1949.58992981911}
   >       18 | {636.373380899429,1289.27607584,1936.36742186546}
   >       19 | {647.414880990982,1297.31931090355,1945.65248298645}
   >       20 | {634.09289598465,1284.170140028,1932.07456684113}
   
   It may be possible to do the following to get the graph:
   
   1. Have a 'time offset' like variable (initially set to zero)
   2. Time the individual fit multiple function calls (in seconds I presume) (for adding the
recorded times to the offset variable each time). 
   3. After 1 run of fit multiple, write an update like query to update `metrics_elapsed_time`
by adding the total offset to every element of the array value (for the first run, an offset
of 0 would be added, i.e. no offset) for the model configs trained in that round (this may
be determined by the `mst_key` ranges).
   4. Update the offset variable by incrementing it by the recorded time for the most recent
loop run (i.e. fit multiple function call).
   
   Let me know if anything doesn't seem clear.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



Mime
View raw message