Segmentation Fault

Submitted by stevefletcher395 on Wed, 10/28/2020 - 20:37
Forums
Initialization

I am trying to run a test case at the C192 resolution.  I ran into one memory allocation problem last week that i was able to correct but now have the problem below.  What would be causing this fault please?I also cannot find these files to work out the problem.  My fear is i did find a variable called Bufsize which is hard wired which would imply a recompile. 

Also i stillhave not heard anything about sfc_ctrl.nc which is required but does not appear to be anywhere and no one has advised me on how to generate this file.

thanks

Steve

 

forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source
ufs_weather_model  0000000001361CE6  Unknown               Unknown  Unknown
libpthread-2.17.s  00002AAFE24BE5D0  Unknown               Unknown  Unknown
ufs_weather_model  0000000000B6BDD2  Unknown               Unknown  Unknown
ufs_weather_model  0000000000B682C0  Unknown               Unknown  Unknown
ufs_weather_model  0000000000B650B0  Unknown               Unknown  Unknown
ufs_weather_model  0000000000A3AA0B  Unknown               Unknown  Unknown
ufs_weather_model  0000000000A36B7E  Unknown               Unknown  Unknown
ufs_weather_model  00000000005FC821  Unknown               Unknown  Unknown
libiomp5.so        00002AAFE1FA8C53  __kmp_invoke_micr     Unknown  Unknown
libiomp5.so        00002AAFE1F787ED  __kmp_fork_call       Unknown  Unknown
libiomp5.so        00002AAFE1F4FE2A  __kmpc_fork_call      Unknown  Unknown
ufs_weather_model  00000000005EEAB4  Unknown               Unknown  Unknown
ufs_weather_model  00000000005A6D02  Unknown               Unknown  Unknown
ufs_weather_model  0000000000526F59  Unknown               Unknown  Unknown
ufs_weather_model  00000000004BD98B  Unknown               Unknown  Unknown
ufs_weather_model  00000000004AEBCA  Unknown               Unknown  Unknown
libesmf.so         00002AAFDD1DDEBC  _ZN5ESMCI6FTable1        2010  ESMCI_FTable.C
libesmf.so         00002AAFDD1E186A  ESMCI_FTableCallE         746  ESMCI_FTable.C
libesmf.so         00002AAFDD6569BA  _ZN5ESMCI2VM5ente        1178  ESMCI_VM.C
libesmf.so         00002AAFDD1DF367  c_esmc_ftablecall         898  ESMCI_FTable.C
libesmf.so         00002AAFDD871135  esmf_compmod_mp_e        1209  ESMF_Comp.F90
libesmf.so         00002AAFDDA57864  esmf_gridcompmod_        1889  ESMF_GridComp.F90
 

Permalink

Submitted by Linlin.Pan on Tue, 11/03/2020 - 18:10

Hi, Steve,

There is another file with the information before "SIGSEGV, segmentation fault occurred".

Do you have that file?

Thanks,

Linlin

Permalink

Submitted by Linlin.Pan on Wed, 11/11/2020 - 18:33

Hi, Steve,

I want to see the the file contains the error messages you reported:

forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source
ufs_weather_model  0000000001361CE6  Unknown               Unknown  Unknown

I don't find these error messages in the log you provided.

Do you have access to NOAA HPC (Jet, Hera), Orion, or NCAR Cheyenne? I can access these machines to check the runs for you.

Thanks,

Linlin

 

Permalink

Submitted by Linlin.Pan on Wed, 11/11/2020 - 22:37

Thanks, Steve!

The default settings for C192 are dt_atmos=         450, and  ntasks=         144

Your settings are dt_atmos = 1800, and ntasks = 6

You may need to reduce the time step and increase the ntasks. I have an example run on NCAR Cheyenne for C192, you may check it:

cheyenne1:/glade/scratch/lpan/11022020/ufs-mrweather-app-workflow.c192/run

Thanks,

Linlin

Permalink

Submitted by stevefletcher395 on Thu, 11/12/2020 - 14:34

Hi Linlin

Where would i change the n tasks part please and do you have a copy of the input and the model configure files as i do not have access to neither a noaa machine, nor cheyenne.  I did change the dt_atmos to 450 but could only set the ntasks in the sbatch file, i now have the following error.  I says in the output file that the ntask =6 occurs in in fcst comp init, ntasks=           6  what is this please?

forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source

Stack trace terminated abnormally.
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source

Stack trace terminated abnormally.
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source

Stack trace terminated abnormally.
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source

Stack trace terminated abnormally.
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source

Stack trace terminated abnormally.
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source

Stack trace terminated abnormally.
Model ended:     Thu Nov 12 03:47:57 MST 2020
RESULT: ERROR 174
 

Permalink

Submitted by Linlin.Pan on Thu, 11/12/2020 - 15:48

Hi, Steve,

There are several places related to ntasks, e.g., input.nml, model_configure, and job submitting, here is an instruction on how to set up and run the model:

https://ufs-mrweather-app.readthedocs.io/en/ufs-v1.1.0/

Here are the UFS training materials:

https://dtcenter.org/events/2020/unified-forecast-system-ufs-medium-range-weather-mrw-application-users-training/agenda

Thanks,

Linlin

  • 168 views

Copyright © 2023. All rights reserved.