METplus StatAnalysis Template Error

[lindsayrblank]

Hello again,

I am running the metplus_4.1.0-beta4 Docker image on an HPC using Singularity. I am running StatAnalysis in my use case. The relevant code snippet is here:

# stat_analysis job info
STAT_ANALYSIS_JOB_NAME = aggregate_stat
# if using -dump_row, put in JOBS_ARGS "-dump_row [dump_row_file]"
# if using -out_stat, put in JOBS_ARGS "-out_stat [out_stat_file]"
# METplus will fill in filename
STAT_ANALYSIS_JOB_ARGS = -out_line_type CTC -out_thresh '>0' -by OBS_SID,FCST_VAR,FCST_INIT_HOUR -out_stat [out_stat_file]

I have set the following template:

STAT_ANALYSIS_OUT_STAT_TEMPLATE = {model?fmt=%s}_{valid?fmt=%y%m%d}_fcstlead{lead?fmt=%H}_ctc.stat

When I run, the output file is named as such: modelA__fcstlead120000_ctc.stat

Other templates work just fine i.e.
FCST_PCP_COMBINE_OUTPUT_TEMPLATE = {init?fmt=%Y%m%d}/{init?fmt=%H}/upp.t00z.pgrb2.0p125.{valid?fmt=%Y%m%d%H}_combined

Why is this template not working?

Thank you,
Lindsay

[j-opatz]

Hi Lindsay,

And thank you for your question. It looks like the template that's causing the issues may be set with a syntax error on the date; specifically, the %y should be a %Y. Try

STAT_ANALYSIS_OUT_STAT_TEMPLATE = {model?fmt=%s}_{valid?fmt=%Y%m%d}_fcstlead{lead?fmt=%H}_ctc.stat

and see if that fixes the issue.

[lindsayrblank]

Sure, here it is. I gave it a ".txt" suffix so GitHub would upload it.
PCPCombine_PointStat_StatAnalysis_ModelA_ctc.conf.txt

[lindsayrblank]

I just saw your reply! That is a handy list to know. However, I was using 'valid' and it still didn't work so I'm not sure what's going on.

[lindsayrblank]

Hi @malloryprow and Happy New Year! I was wondering if you've had a chance to investigate this issue further?

[malloryprow]

@lindsayrblank I haven't, I'm sorry! Have you tried any of the other options in place of valid?

[lindsayrblank]

I've used 'fcst_valid' and 'valid'. The file format I need to use requires the forecast valid date in the file name.

'lead' works, interestingly enough, but not 'valid' or 'fcst_valid'.

[georgemccabe]

Hi @lindsayrblank , StatAnalysis wrapper is not like many of the other wrappers where you can freely switch between init and valid in the filename templates. If you set LOOP_BY = INIT, you can reference 'init' template tags but not 'valid' ones. The wrapper does not loop over the forecast leads and process once for each init/lead or valid/lead combination. It actually just runs once and passes in the lead list to the STATAnalysis config file. Because of this, there is no way to compute what the corresponding valid time "should" be when "looping" by INIT. Switching your filename template for the output file to reference init instead of valid should fix the issue:

STAT_ANALYSIS_OUT_STAT_TEMPLATE = {model?fmt=%s}_{init?fmt=%Y%m%d}_fcstlead{lead?fmt=%H}_ctc.stat

[lindsayrblank]

Thanks for the explanation, @georgemccabe. Unfortunately, that template you gave me does not work either. Neither does substituting in 'fcst_init' or changing the format to '%Y%m%d%H'. Any ideas?

[georgemccabe]

Try using 'fcst_init_beg' or 'fcst_init_end'

[lindsayrblank]

'fcst_init_beg' worked, thank you. I can work with that going forward.