Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Address diffs v2.12.1 to v3 #907

Merged
merged 26 commits into from
Jan 15, 2025
Merged

Address diffs v2.12.1 to v3 #907

Show file tree
Hide file tree
Changes from 25 commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
a84b860
address_diffs_v2.12.1_to_v3
chengzhuzhang Dec 11, 2024
796ca4c
Revert "address_diffs_v2.12.1_to_v3"
chengzhuzhang Dec 11, 2024
0591c39
add_test_scripts
chengzhuzhang Dec 11, 2024
ee009c1
Fix incorrect logic for `udunits` conversions in `convert_units()`
tomvothecoder Dec 12, 2024
528bac6
Add complete run script
tomvothecoder Dec 16, 2024
8982c31
Update run script to save netCDF
tomvothecoder Dec 16, 2024
09e853c
Update dev dir for regression notebook
tomvothecoder Dec 16, 2024
b9da444
Add time slicing before `.load()` for performance
tomvothecoder Dec 17, 2024
4ad47a7
Add arm_diags and merra2 debug scripts
tomvothecoder Jan 7, 2025
b1a5a77
Fix hanging for derived vars with convert_units()
tomvothecoder Jan 8, 2025
3ea5422
Add arm_diags back into complete run script
tomvothecoder Jan 8, 2025
a76cfd8
Squeeze time dim for climo files before loading into memory
tomvothecoder Jan 9, 2025
af046a2
Update arm diags debug scripts with info on specific issues
tomvothecoder Jan 9, 2025
65f61ac
Add script debug H2OLNZ
tomvothecoder Jan 9, 2025
45277e6
Add H2OLNZ unit conversion from PR #874
tomvothecoder Jan 10, 2025
f346c51
Add v3 regression testing results
tomvothecoder Jan 10, 2025
94959cc
Add v2 data regression testing
tomvothecoder Jan 10, 2025
9221c5b
Update regression testing scripts
tomvothecoder Jan 10, 2025
313a641
update site data pre-processing script based on xarray
chengzhuzhang Jan 11, 2025
7020a25
Update v2 regression test notebooks
tomvothecoder Jan 14, 2025
d94ed40
Add `pywavelets` dependency to fix scipy `cwt` deprecation
tomvothecoder Jan 14, 2025
2144f51
Clean up postprocessing script for arm_diags
tomvothecoder Jan 14, 2025
60f53bc
figure out how to use pywavelets
tomvothecoder Jan 14, 2025
dd19a17
Add final v3 data regression test results
tomvothecoder Jan 15, 2025
01a91e4
Revert pywavelets code changes and constrain `scipy <1.15`
tomvothecoder Jan 15, 2025
1b0f998
Apply suggestions from code review
tomvothecoder Jan 15, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 5 additions & 3 deletions ..._tools/cdat_regression_testing/843-migration-phase3/run-script-model-vs-obs/run_script.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
Or: source /lcrc/soft/climate/e3sm-unified/load_latest_e3sm_unified_anvil.sh

NERSC perlmutter cpu:
salloc --nodes 1 --qos interactive --time 01:00:00 --constraint cpu --account=e3sm
salloc --nodes 1 --qos interactive --time 0:00:00 --constraint cpu --account=e3sm
tomvothecoder marked this conversation as resolved.
Show resolved Hide resolved
source /global/common/software/e3sm/anaconda_envs/load_latest_e3sm_unified_pm-cpu.sh
"""
# flake8: noqa E501
Expand Down Expand Up @@ -67,7 +67,9 @@ def run_all_sets():
"ANN",
"JJA",
] # Default setting: seasons = ["ANN", "DJF", "MAM", "JJA", "SON"]
param.results_dir = "/global/cfs/cdirs/e3sm/www/cdat-migration-fy24/843-migration-phase3-perf-benchmark"
param.results_dir = (
"/global/cfs/cdirs/e3sm/www/cdat-migration-fy24/25-01-10-907-v2-data-2"
)
param.multiprocessing = True
param.num_workers = 24

Expand Down Expand Up @@ -168,7 +170,7 @@ def run_all_sets():
"area_mean_time_series",
"diurnal_cycle",
"streamflow",
"arm_diags",
# "arm_diags",
tomvothecoder marked this conversation as resolved.
Show resolved Hide resolved
"tc_analysis",
"aerosol_aeronet",
"aerosol_budget",
Expand Down
Loading
Loading