Errors when run get ics script

Hello all,

I just start to learn how to run UFS in Cheyenne. I have finished setting up the environment variables.

For some reason, when I tried to run the run_get_ics.sh, the log showed errors. The log file is below:

 

The arguments to the script in file

"/glade/work/haochen/UFS/ufs-srweather-app/regional_workflow/scripts/exregional_get_extrn_mdl_files.sh"

have been set as follows:

declare -- ics_or_lbcs="ICS"
declare -- use_user_staged_extrn_files="FALSE"
declare -- extrn_mdl_cdate="2019061500"
declare -a extrn_mdl_lbc_spec_fhrs='([0]="")'
declare -a extrn_mdl_fns_on_disk='([0]="gfs.t00z.pgrb2.0p25.f000")'
declare -a extrn_mdl_fns_in_arcv='([0]="gfs.t00z.pgrb2.0p25.f000")'
declare -- extrn_mdl_source_dir="/glade/p/ral/jntp/UFS_SRW_app/COMGFS/gfs.20190615/00"
declare -- extrn_mdl_staging_dir="/glade/work/haochen/UFS/expt_dirs/UFS_SR_TEST1/2019061500/FV3GFS/for_ICS"
declare -- extrn_mdl_arcv_fmt="tar"
declare -a extrn_mdl_arcv_fns='([0]="gpfs_dell1_nco_ops_com_gfs_prod_gfs.20190615_00.gfs_pgrb2.tar")'
declare -a extrn_mdl_arcv_fps='([0]="/NCEPPROD/hpssprod/runhistory/rh2019/201906/20190615/gpfs_dell1_nco_ops_com_gfs_prod_gfs.20190615_00.gfs_pgrb2.tar")'
declare -- extrn_mdl_arcvrel_dir="./gfs.20190615/00"

 File fp does NOT exist on disk:
fp = "/glade/p/ral/jntp/UFS_SRW_app/COMGFS/gfs.20190615/00/gfs.t00z.pgrb2.0p25.f000"
Will try fetching all external model files from HPSS.  Not checking
presence and age of remaining external model files on disk.

Fetching external model files from HPSS.  The full paths to these files
in the archive file(s) (extrn_mdl_fps_in_arcv), the archive files on HPSS
in which these files are stored (extrn_mdl_arcv_fps), and the staging
directory to which they will be copied (extrn_mdl_staging_dir) are:
extrn_mdl_fps_in_arcv = ( "./gfs.20190615/00/gfs.t00z.pgrb2.0p25.f000" )
extrn_mdl_arcv_fps = ( "/NCEPPROD/hpssprod/runhistory/rh2019/201906/20190615/gpfs_dell1_nco_ops_com_gfs_prod_gfs.20190615_00.gfs_pgrb2.tar" )
extrn_mdl_staging_dir = "/glade/work/haochen/UFS/expt_dirs/UFS_SR_TEST1/2019061500/FV3GFS/for_ICS"

ERROR:
From script:  "exregional_get_extrn_mdl_files.sh"
Full path to script:  "/glade/work/haochen/UFS/ufs-srweather-app/regional_workflow/scripts/exregional_get_extrn_mdl_files.sh"
htar file list operation ("htar -tvf ...") failed.  Check the log file
htar_log_fn in the staging directory (extrn_mdl_staging_di)r for details:
extrn_mdl_staging_dir = "/glade/work/haochen/UFS/expt_dirs/UFS_SR_TEST1/2019061500/FV3GFS/for_ICS"
htar_log_fn = "log.htar_tvf.00"
Exiting with nonzero status.

ERROR:
From script:  "JREGIONAL_GET_EXTRN_MDL_FILES"
Full path to script:  "/glade/work/haochen/UFS/ufs-srweather-app/regional_workflow/jobs/JREGIONAL_GET_EXTRN_MDL_FILES"
Call to ex-script corresponding to J-job "JREGIONAL_GET_EXTRN_MDL_FILES" failed.
Exiting with nonzero status.

 

I feel like this error is due to the command lines are in bold above. I have checked that directory and it does not exist.

I have changed my IC and BC files into my own directory, see config.sh below:

EXTRN_MDL_SOURCE_BASEDIR_ICS="/glade/work/haochen/UFS/expt_dirs/UFS_SR_TEST1/ICS"
EXTRN_MDL_FILES_ICS=( "gfs.pgrb2.0p25.f000" )
EXTRN_MDL_SOURCE_BASEDIR_LBCS="/glade/work/haochen/UFS/expt_dirs/UFS_SR_TEST1/ICS"
EXTRN_MDL_FILES_LBCS=( "gfs.pgrb2.0p25.f006" "gfs.pgrb2.0p25.f012" "gfs.pgrb2.0p25.f018" "gfs.pgrb2.0p25.f024" \
                       "gfs.pgrb2.0p25.f030" "gfs.pgrb2.0p25.f036" "gfs.pgrb2.0p25.f042" "gfs.pgrb2.0p25.f048" )

But it's still not working. Can someone help me with this? Much much appreciated.

 

Edit:

The lines in bold are not shown.

I meant this line "declare -- extrn_mdl_source_dir="/glade/p/ral/jntp/UFS_SRW_app/COMGFS/gfs.20190615/00"

and fp = "/glade/p/ral/jntp/UFS_SRW_app/COMGFS/gfs.20190615/00/gfs.t00z.pgrb2.0p25.f000"

Hi

I still have this error after I added this line.

 

ERROR:
  From script:  "exregional_get_extrn_mdl_files.sh"
  Full path to script:  "/glade/work/haochen/UFS/ufs-srweather-app/regional_workflow/scripts/exregional_get_extrn_mdl_files.sh"
htar file list operation ("htar -tvf ...") failed.  Check the log file
htar_log_fn in the staging directory (extrn_mdl_staging_di)r for details:
  extrn_mdl_staging_dir = "/glade/work/haochen/UFS/expt_dirs/UFS_SR_TEST1/2019061500/FV3GFS/for_ICS"
  htar_log_fn = "log.htar_tvf.00"
Exiting with nonzero status.

 

My config.sh:

MACHINE="cheyenne"
ACCOUNT="haochen"
EXPT_SUBDIR="UFS_SR_TEST1"
USE_USER_STAGED_EXTRN_FILES="TRUE"

 

Hi Haochen,

The config.sh script in the ush directory is the only one you need to worry about.  The one in the run directory is simply copied from the /ush directory for reference.  Regarding the staged external model data used for IC/LBC creation, you need to place them within a YYYYMMDDHH folder, so they need to go in /glade/work/htan2013/UFS/expt_dirs/ICS/2019061500.  The YYYYMMDDHH folder should not be included in the paths provided in the config.sh script.  Hopefully that fixes the problem.