Skip to content

Conversation

JohnHalleyGotway
Copy link
Collaborator

Expected Differences

This PR explains the differences flagged by the nightly build in seneca:/d1/projects/MET/MET_regression/main_v11.0/NB20230403.

PR #2500 (re-)created the 11.0.2 release. Updating main_v11.0 to get past the differences flagged in the MTD and SEEPS output caused by the version difference.

cd /d1/projects/MET/MET_regression/main_v11.0/NB20230403
egrep -i "error:|file1:" test_regression_20230403.log   | egrep -B 1 "ERROR:" | egrep file1

Flags the following diffs:

file1: MET-main_v11.0-ref/test_output/grid_stat/grid_stat_SEEPS_000000L_20211202_000000V_seeps.txt
file1: MET-main_v11.0-ref/test_output/grid_stat/grid_stat_SEEPS_000000L_20211202_000000V.stat
file1: MET-main_v11.0-ref/test_output/mtd/mtd_BASIC_20100517_010000V_2d.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_BASIC_20100517_010000V_3d_pair_cluster.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_BASIC_20100517_010000V_3d_pair_simple.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_BASIC_20100517_010000V_3d_single_cluster.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_BASIC_20100517_010000V_3d_single_simple.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_CONV_TIME_20100517_010000V_2d.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_CONV_TIME_20100517_010000V_3d_pair_cluster.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_CONV_TIME_20100517_010000V_3d_pair_simple.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_CONV_TIME_20100517_010000V_3d_single_cluster.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_CONV_TIME_20100517_010000V_3d_single_simple.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_SINGLE_20100517_010000V_2d.txt
file1: MET-main_v11.0-ref/test_output/mtd/mtd_SINGLE_20100517_010000V_3d_single_simple.txt
file1: MET-main_v11.0-ref/test_output/point_stat/point_stat_NCMET_NAM_NDAS_SEEPS_360000L_20120410_120000V_seeps_mpr.txt
file1: MET-main_v11.0-ref/test_output/point_stat/point_stat_NCMET_NAM_NDAS_SEEPS_360000L_20120410_120000V_seeps.txt
file1: MET-main_v11.0-ref/test_output/point_stat/point_stat_NCMET_NAM_NDAS_SEEPS_360000L_20120410_120000V.stat
file1: MET-main_v11.0-ref/test_output/python/mtd_PYTHON_20050807_120000V_2d.txt
file1: MET-main_v11.0-ref/test_output/python/mtd_PYTHON_20050807_120000V_3d_pair_cluster.txt
file1: MET-main_v11.0-ref/test_output/python/mtd_PYTHON_20050807_120000V_3d_pair_simple.txt
file1: MET-main_v11.0-ref/test_output/python/mtd_PYTHON_20050807_120000V_3d_single_cluster.txt
file1: MET-main_v11.0-ref/test_output/python/mtd_PYTHON_20050807_120000V_3d_single_simple.txt
file1: MET-main_v11.0-ref/test_output/stat_analysis_ps/CONFIG_POINT_STAT_filter_seeps.stat

All of these diffs flagged are in the output of the MTD tool and SEEPS. Those are the output types that the existing PERL testing logic does not know how to handle. So if a simple file diff command doesn't suffice, then it's flagged as a difference.
This is part of what needs to be fixed by the MET test logic overhaul and transition from PERL to python.

Updating main_v11.0-ref to get past these expected differences.

JohnHalleyGotway and others added 30 commits December 12, 2022 15:13
* Updating compile_MET_all.sh for a newer version of NetCDF (4.7.4)

* Updating config files

* Updating modulefiles
…in_v11.0

#2387 Do not increase n_file_obs when n_derived_obs is increased
* Update modulefiles

* Updating modulefiles
Co-authored-by: MET Tools Test Account <met_test@seneca.rap.ucar.edu>
…ic_main_v11.0

Feature #2218 main_v11.0 polar stereographic
jprestop and others added 28 commits February 20, 2023 23:04
Updating Python version to be 3.8 for Read the Docs
Remove pdf from builds
Switch back to Python 3.7 to see if that resolves failed check.
Co-authored-by: Howard Soh <hsoh@seneca.rap.ucar.edu>
Co-authored-by: Howard Soh <hsoh@seneca.rap.ucar.edu>
…rance score equation in Appendix C is slightly incorrect. Updating the main_v11.0 branch to make it consistent with equation 8 in Gneiting et al 2005.
…b64 dir instead of a lib dir; Updated related config files
MET_PYTHON should be the location containing the bin, include, lib and share directories for Python; Removing "/bin" from MET_PYTHON value
…dd_main_v11.0

Bugfix #2482 main_v11.0 time slicing yyyymmdd
* Updated release notes for 11.0.2 bugfix release

* Updating date and version

* Update docs/Users_Guide/release-notes.rst

Co-authored-by: John Halley Gotway <johnhg@ucar.edu>

* Update docs/Users_Guide/release-notes.rst

Co-authored-by: John Halley Gotway <johnhg@ucar.edu>

---------

Co-authored-by: John Halley Gotway <johnhg@ucar.edu>
* Updated release notes for 11.0.2 bugfix release

* Updating date and version

* Update docs/Users_Guide/release-notes.rst

Co-authored-by: John Halley Gotway <johnhg@ucar.edu>

* Update docs/Users_Guide/release-notes.rst

Co-authored-by: John Halley Gotway <johnhg@ucar.edu>

* Update date, and version number in new location

---------

Co-authored-by: John Halley Gotway <johnhg@ucar.edu>
@JohnHalleyGotway JohnHalleyGotway added this to the MET 11.0.3 (bugfix) milestone Apr 3, 2023
@JohnHalleyGotway JohnHalleyGotway merged commit e7ff10f into main_v11.0-ref Apr 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging this pull request may close these issues.

4 participants