Project

General

Profile

Support #9321

Update configuration of PyCAMA for daily extractions

Added by Maarten Sneep about 3 years ago. Updated over 2 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Maarten Sneep
Target version:
PyCAMA 0.9.0
Start date:
04/23/2018
Due date:
12/31/2018
% Done:

100%

Description

Configuration update for PDGS.

PyCAMA_config_generator.py View (175 KB) Maarten Sneep, 11/23/2018 05:51 PM

Related issues

Related to PyCAMA - Support #14161: Time dependent QC questionnaire Feedback 11/28/2018

History

#1 Updated by Maarten Sneep over 2 years ago

  • Due date set to 11/30/2018

The PyCAMA tool is now running for about 6 months on (near) operational data for most products. This also means that you have some experience with the output of PyCAMA and the reports on http://mpc-l2.tropomi.eu/

I think that this is a good moment to review the settings we use in PyCAMA. In particular:

  • Are there parameters that can be removed from the list?
  • Are there graphs that should be removed from the output? Specifically we can easily remove a parameter from the scatter density plots. Is there a parameter that doesn't add anything to those graphs?
  • Are there parameters that should be monitored, but can be excluded from the L3 plots?
  • Are the ranges of the histograms appropriate?
  • Are there other errors in the output?
  • Are we missing parameters?

This issue is for the configuration of PyCAMA. Feature requests can be added as issues to this project.

#2 Updated by Maarten Sneep over 2 years ago

Added the configuration file generator for PyCAMA to show what the starting point is.

#3 Updated by Maarten Sneep over 2 years ago

#4 Updated by Maarten Sneep over 2 years ago

  • Subject changed from Update configuration to Update configuration of PyCAMA for daily extractions

#5 Updated by Maarten Sneep over 2 years ago

  • Due date changed from 11/30/2018 to 12/31/2018

Extended feedback period to match the time dependent questionnaire.

#6 Updated by Klaus-Peter Heue over 2 years ago

Hi Maarten

There is one variable for the OFFL report we want to include here as well as in the time dependent reports, namely the "effective_albedo". Range (-0.1 to 1.3)

I suggest to skip AMF trueness completely from the NRTI report - it is a function of SZA and this how it looks like in the report.

Moreover the data ranges for the following variables might be adapted:
O3 vertical column precision [mol/m^2]: 0 - 0.015 for NRTI and 0 - 0.01 for OFFL
Fitting RMS 0 - 0.006 for both
shift: +0.03 and stretch: + 0.01
Effective temperature NRTI 200 - 280 [K] no change for OFFL
O3 ghost column 0-0.01 only available in OFFL

Klaus-Peter

#7 Updated by Maarten Sneep over 2 years ago

  • Target version set to PyCAMA 0.9.0

Thank you Klaus-Peter for hte feedback. I've incorporated your requests in the upcoming version.

All others: please let me know ASAP if you have changes for the PyCAMA configuration.

#8 Updated by Maarten Sneep over 2 years ago

Some of you requested a different range for the histogram and the world-plot. This is already possible. If you want to use this, please update the configuration to include a 'map_range' key, with the desired range for your world plot. If not available, the data_range key will be used.

#9 Updated by Maarten Sneep over 2 years ago

  • Status changed from New to Closed
  • % Done changed from 0 to 100

As PyCAMA 0.9.0 has been released I'm closing this issue here. A new request will be made for PyCAMA 0.10.0, which will likely be the version used for collection 2 reprocessing and the start for long-term monitoring.

Also available in: Atom PDF