Project

General

Profile

Support #25771

Prepare PyCAMA release 0.10.0

Added by Maarten Sneep about 1 month ago. Updated 9 days ago.

Status:
Feedback
Priority:
Normal
Assignee:
PDGS Operations
Target version:
-
Start date:
04/28/2020
Due date:
05/21/2020
% Done:

100%

Description

  • Documentation
  • Update configuration
  • Test cases

PyCAMA-0.10.0.zip (3.65 MB) Maarten Sneep, 05/23/2020 02:23 PM

Related issues

Related to PyCAMA - Support #25701: Verify and update settings of PyCAMA for S5P-NPP Cloud Closed 04/28/2020 05/11/2020
Related to PyCAMA - Bug #25711: Verify and update PyCAMA settings for UPAS products Closed 04/28/2020 05/11/2020
Related to PyCAMA - Support #25721: Verify and update settings for PyCAMA for NL-L2 products Closed 04/28/2020 05/11/2020
Related to PyCAMA - Support #24861: [PyCAMA] Test on CentOS 7.7 Sandbox Closed 03/05/2020

History

#1 Updated by Maarten Sneep about 1 month ago

  • Related to Support #25701: Verify and update settings of PyCAMA for S5P-NPP Cloud added

#2 Updated by Maarten Sneep about 1 month ago

  • Related to Bug #25711: Verify and update PyCAMA settings for UPAS products added

#3 Updated by Maarten Sneep about 1 month ago

  • Related to Support #25721: Verify and update settings for PyCAMA for NL-L2 products added

#5 Updated by Maarten Sneep about 1 month ago

  • Related to Support #24861: [PyCAMA] Test on CentOS 7.7 Sandbox added

#6 Updated by Maarten Sneep about 1 month ago

  • Subject changed from Prepare PyCAMA release to Prepare PyCAMA release 0.10.0
  • Status changed from New to In Progress

#7 Updated by Maarten Sneep 11 days ago

  • Status changed from In Progress to Feedback
  • Assignee changed from Maarten Sneep to PDGS Operations
  • % Done changed from 0 to 100

PyCAMA 0.10.0 is ready, and has been placed on the DMSF of this project. The user manual has been updated to reflect the current status.

The last two items are included in the distribution package.

Test data is not included in the package because of volume concerns (about 110 GB in total). When testing on the sandbox for CentOS 7.7, the test case failed, but the reason is unclear. The comparison tool reports differences, and while some insignificant rounding differences can be observed, other reported differences are not understood - I do not see how an empty string doesn't compare to an empty string. I ran the same test on my laptop, and did not find any differences. We're likely dealing with some version difference of the python packages, but I do not think it is worth to get the test to reproduce, the code itself works fine. Using Python version 3.7.6 (final), numpy 1.18.1, netCDF4 1.5.1.2 (with netCDF4 library 4.6.2), and h5py 2.9.0 (with hdf5 library 1.10.4) will likely resolve the differences.

All 22 tests (offline and NRTI across all products) have been executed at KNMI, and test data is available on request. Before uploading I need to know how we want to continue. A smaller package for a single test case is available as well.

#8 Updated by Maarten Sneep 11 days ago

Attached distribution package here for easy access.

#9 Updated by Maarten Sneep 9 days ago

  • Target version deleted (PyCAMA 0.10.0)

#10 Updated by Maarten Sneep 9 days ago

As an extra test, I transferred the file generated in the sandbox to KNMI, and generated the report locally. This is working as expected. I do not see an issue here. Of course, if updates to the python modules are required for other processors then this issue may disappear as well.

Locally tested with python version 3.7.7 (final), numpy 1.18.1, netCDF4 1.5.3 (using netCDF4 library version 4.7.3), h5py 2.10.0 (with hdf-5 library version 1.10.4).

Also available in: Atom PDF