tvm-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-tvm] jmorrill commented on issue #4995: [AutoTVM] Avoid using RPC for LocalRunner
Date Fri, 06 Mar 2020 23:08:27 GMT
jmorrill commented on issue #4995: [AutoTVM] Avoid using RPC for LocalRunner
URL: https://github.com/apache/incubator-tvm/pull/4995#issuecomment-596002645
 
 
   @comaniac When I was working on the Windows RPC server, my first design was to run the
trials all in the same process as Windows doesn't `fork(...)`.  It did indeed have a speed
improvement.
   
   After running CUDA autotune a while it looked like there was a GPU memory leak (some trial
made it jump hundreds of megs).  I spent a long time looking for a leak in the C++ code, but
couldn't find anything.  With my very limited understanding, it seemed as if the failed/slow
cuda kernels it would test, were themselves leaking.  Only killing the process would free
the GPU memory.
   
   I abandoned the in-process running of trials and moved to a similar design as the Linux
current implementation.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message