cmda-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lei Pan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CMDA-6) Docker container remaining issues
Date Sun, 03 Apr 2016 03:06:25 GMT

     [ https://issues.apache.org/jira/browse/CMDA-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lei Pan updated CMDA-6:
-----------------------
    Description: 
Remaining issues with the new Docker container:
1. The services are slower than normal. Check memory/core utilization (Wei);

Wei found some docker-compose commands:
cpu_shares:
 73 cpu_quota:
 50000 cpuset:
 0,1 user: postgresql
working_dir: /code 
domainname: 
foo.com hostname: foo 
ipc: host mac_address: 02:42:ac:11:65:43
mem_limit: 1000000000
memswap_limit: 2000000000 
privileged: true restart: always
read_only: 
true stdin_open: 
true tty: 
true

To: Lei and Wei: what are the default allocations
of cpu cores and main memory that a Docker player
would assign to a container?

2. The following services do not work yet (Lei):
  . Scatter and Histogram Plot of Two Variables
  . Difference Plot of Two Time Averaged Variables
  . Time-Lagged Correlation Map of Two Variables
  . Conditional Sampling with One Variable
  . Conditional Sampling with Two Variables
  . Empirical Orthogonal Function (EOF) Analysis
  . Random Forest Importance
  . Conditional Probability Density Function
  . Regrid and Download

All JPL services are working in the new Docker
container after Benyang created the following
symbolic links:
create dir: 
/mnt/hgfs/cmacws/data1/data

then within the dir, make symbolic links:
lrwxrwxrwx 1 root root   20 Jan 13 19:03 cmip5 -> /mnt/data_2015/cmip5/
lrwxrwxrwx 1 root root   18 Jan 13 19:04 des -> /mnt/data_2015/des/

In the future, this should not be necessary.
* What needs to be done to make this unnecessary?

3. Use RAID for source data for all cmacws servers.


  was:
Remaining issues with the new Docker container:
1. The services are slower than normal. Check memory/core utilization (Wei);

Wei found some docker-compose commands:
cpu_shares:
 73 cpu_quota:
 50000 cpuset:
 0,1 user: postgresql
working_dir: /code 
domainname: 
foo.com hostname: foo 
ipc: host mac_address: 02:42:ac:11:65:43
mem_limit: 1000000000
memswap_limit: 2000000000 
privileged: true restart: always
read_only: 
true stdin_open: 
true tty: 
true

2. The following services do not work yet (Lei):
  . Scatter and Histogram Plot of Two Variables
  . Difference Plot of Two Time Averaged Variables
  . Time-Lagged Correlation Map of Two Variables
  . Conditional Sampling with One Variable
  . Conditional Sampling with Two Variables
  . Empirical Orthogonal Function (EOF) Analysis
  . Random Forest Importance
  . Conditional Probability Density Function
  . Regrid and Download

All JPL services are working in the new Docker
container after Benyang created the following
symbolic links:
create dir: 
/mnt/hgfs/cmacws/data1/data

then within the dir, make symbolic links:
lrwxrwxrwx 1 root root   20 Jan 13 19:03 cmip5 -> /mnt/data_2015/cmip5/
lrwxrwxrwx 1 root root   18 Jan 13 19:04 des -> /mnt/data_2015/des/

In the future, this should not be necessary.
* What needs to be done to make this unnecessary?

3. Use RAID for source data for all cmacws servers.



> Docker container remaining issues
> ---------------------------------
>
>                 Key: CMDA-6
>                 URL: https://issues.apache.org/jira/browse/CMDA-6
>             Project: Apache Climate Model Diagnostic Analyzer
>          Issue Type: Improvement
>         Environment: Docker container
>            Reporter: Lei Pan
>            Assignee: Lei Pan
>              Labels: features, performance
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> Remaining issues with the new Docker container:
> 1. The services are slower than normal. Check memory/core utilization (Wei);
> Wei found some docker-compose commands:
> cpu_shares:
>  73 cpu_quota:
>  50000 cpuset:
>  0,1 user: postgresql
> working_dir: /code 
> domainname: 
> foo.com hostname: foo 
> ipc: host mac_address: 02:42:ac:11:65:43
> mem_limit: 1000000000
> memswap_limit: 2000000000 
> privileged: true restart: always
> read_only: 
> true stdin_open: 
> true tty: 
> true
> To: Lei and Wei: what are the default allocations
> of cpu cores and main memory that a Docker player
> would assign to a container?
> 2. The following services do not work yet (Lei):
>   . Scatter and Histogram Plot of Two Variables
>   . Difference Plot of Two Time Averaged Variables
>   . Time-Lagged Correlation Map of Two Variables
>   . Conditional Sampling with One Variable
>   . Conditional Sampling with Two Variables
>   . Empirical Orthogonal Function (EOF) Analysis
>   . Random Forest Importance
>   . Conditional Probability Density Function
>   . Regrid and Download
> All JPL services are working in the new Docker
> container after Benyang created the following
> symbolic links:
> create dir: 
> /mnt/hgfs/cmacws/data1/data
> then within the dir, make symbolic links:
> lrwxrwxrwx 1 root root   20 Jan 13 19:03 cmip5 -> /mnt/data_2015/cmip5/
> lrwxrwxrwx 1 root root   18 Jan 13 19:04 des -> /mnt/data_2015/des/
> In the future, this should not be necessary.
> * What needs to be done to make this unnecessary?
> 3. Use RAID for source data for all cmacws servers.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message