CIME workflow ./case.setup, ValueError: current limit exceeds maximum limit

Submitted by xia.sun on Fri, 04/10/2020 - 17:35
Forums
Medium-range Weather Application

Hello,

I am running the cime workflow on Orion. There is an error message when ./case.setup:

./case.setup
Setting resource.RLIMIT_STACK to -1 from (307200000, 6144000000)
6144000000
(-1, 6144000000)
Traceback (most recent call last):
  File "./case.setup", line 62, in <module>
    _main_func(__doc__)
  File "./case.setup", line 59, in _main_func
    case.case_setup(clean=clean, test_mode=test_mode, reset=reset)
  File "/work/noaa/gmtb/xiasun/models/ufs-mrweather-app/cime/scripts/Tools/../../scripts/lib/CIME/case/case_setup.py", line 250, in case_setup
    run_and_log_case_status(functor, phase, caseroot=caseroot)

▽
        self._get_resources_for_case(case)
  File "/work/noaa/gmtb/xiasun/models/ufs-mrweather-app/cime/scripts/Tools/../../scripts/lib/CIME/utils.py", line 1739, in run_and_log_case_status
    rv = func()
  File "/work/noaa/gmtb/xiasun/models/ufs-mrweather-app/cime/scripts/Tools/../../scripts/lib/CIME/case/case_setup.py", line 234, in <lambda>
    functor = lambda: _case_setup_impl(self, caseroot, clean, test_mode, reset)
  File "/work/noaa/gmtb/xiasun/models/ufs-mrweather-app/cime/scripts/Tools/../../scripts/lib/CIME/case/case_setup.py", line 97, in _case_setup_impl
    case.load_env()
  File "/work/noaa/gmtb/xiasun/models/ufs-mrweather-app/cime/scripts/Tools/../../scripts/lib/CIME/case/case.py", line 1451, in load_env
    env_module.load_env(self, job=job, verbose=verbose)
  File "/work/noaa/gmtb/xiasun/models/ufs-mrweather-app/cime/scripts/Tools/../../scripts/lib/CIME/XML/env_mach_specific.py", line 84, in load_env
    self._get_resources_for_case(case)
  File "/work/noaa/gmtb/xiasun/models/ufs-mrweather-app/cime/scripts/Tools/../../scripts/lib/CIME/XML/env_mach_specific.py", line 98, in _get_resources_for_case
    resource.setrlimit(attr, limits)
ValueError: current limit exceeds maximum limit

 

Below is the ulimit -a output on Orion:

core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 767207
max locked memory       (kbytes, -l) unlimited
max memory size         (kbytes, -m) unlimited
open files                      (-n) 16384
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 300000
cpu time               (seconds, -t) unlimited
max user processes              (-u) 4096
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

Can anybody help me with this?

Thank you so much!

Xia Sun

NOAA/GSL/EPAD

Permalink

Submitted by jedwards on Fri, 04/10/2020 - 17:49

In your case you can adjust this value in env_mach_specific.xml

For all cases adjust it in cime/config/ufs/machines/config_machines.xml in the section for Machine Orion.  If you do this please consider submitting a PR to the cime repository with the required change.

Permalink

Submitted by xia.sun on Fri, 04/10/2020 - 18:59

Thank you for your reply. Should I change RLIMIT_STACK from -1 to  300000000 in the env_mach_specific.xml?  The case.setup passed without error messages, But the case.build is hanging now without staring to compile ufs.exe. Thank you again for your time and help!
 

Permalink

Submitted by jedwards on Fri, 04/10/2020 - 19:23

Yes change RLIMIT_STACK from -1 to  300000000 in the env_mach_specific.xml.

Are you sure it's hanging?  The build process for ufs takes several minutes and doesn't update status.  I would suggest checking back after about 10 minutes before you assume that it's hanging.

  • 142 views

Copyright © 2023. All rights reserved.